Databricks DBR 15: Three Interesting Features

Ganesh Chandrasekaran
3 min readMar 17, 2024

I am happy to see these three features in DBR 15, which I have been waiting for some time.

Spark.Catalog.TableExists

spark.catalog.tableExists("catatalog.database.table")

This has been a bug/issue for Unity Catalog Shard Compute customers. Till 14.x Unity Catalog + Shared Compute, the above statement will return an…

--

--

Big Data Solution Architect | Adjunct Professor. Thoughts and opinions are my own and don’t represent the companies I work for.