Skip to content

Lua Hooks: databricks alter table #8975

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
nadavsteindler opened this issue Apr 20, 2025 · 0 comments · May be fixed by #8976
Open

Lua Hooks: databricks alter table #8975

nadavsteindler opened this issue Apr 20, 2025 · 0 comments · May be fixed by #8976
Assignees

Comments

@nadavsteindler
Copy link
Contributor

nadavsteindler commented Apr 20, 2025

Extension to Lua Runtime

We are extending our Lua runtime to support the following Databricks client method:

databricks/client.alter_table(table_name, schema_name, catalog_name, alter_statement)
Usage example:

client.alter_table("my_table", "main", "my_table", "ALTER COLUMN ORG_NAME SET MASK some_catalog.some_schema.pii_mask")
This will generate and execute the following SQL statement:

ALTER TABLE my_catalog.main.my_table
ALTER COLUMN ORG_NAME SET MASK some_catalog.some_schema.pii_mask
see ALTER TABLE reference

Update: we will implement a more general API similar to the databricks sql API
databricks/client.execute_statement(warehouse_id, catalog_name, schema_name, sql_statement)
returns status

see also https://github.com/treeverse/product/issues/770

@nadavsteindler nadavsteindler self-assigned this Apr 20, 2025
@nadavsteindler nadavsteindler linked a pull request Apr 20, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant