Ganesh Chandrasekaran – Medium

Ganesh Chandrasekaran

Ganesh Chandrasekaran

Databricks: How to connect Tableau to SQL Warehouse or Spark Compute

With Simba Spark ODBC driver, connecting Tableau to SQL Warehouse or Spark compute has been super easy.

3 min read2 days ago

--

Databricks: How to connect Tableau to SQL Warehouse or Spark Compute

--

Ganesh Chandrasekaran

Azure Databricks: How to identify the ADLS storage type on a mounted path

This article will help you identify the type of Azure storage protocols used as part of workspace mounts.

2 min read3 days ago

--

Azure Databricks: How to identify the ADLS storage type on a mounted path

--

Ganesh Chandrasekaran

Databricks: Delta Sharing 101

Delta Sharing in Databricks is a secure data-sharing platform that lets you share assets in Databricks with users outside your…

3 min readApr 9, 2024

--

1

Databricks: Delta Sharing 101

--

1

Ganesh Chandrasekaran

Databricks: UC Shared access mode

This article discusses why certain features don’t work when using the Unity Catalog Shared compute cluster.

2 min readApr 8, 2024

--

Databricks: UC Shared access mode

--

Ganesh Chandrasekaran

Databricks UC: How to migrate from a 2-part namespace to a 3-part namespace.

One significant change when migrating from Hive Metastore to Unity Catalog is changing PySpark / SQL from 2 namespaces to 3 namespaces.

3 min readMar 19, 2024

--

Databricks UC: How to migrate from a 2-part namespace to a 3-part namespace.

--

Ganesh Chandrasekaran

Databricks: Unity Catalog Storage Patterns

Whether it is a new Unity Catalog workspace or a migration from Hive Metastore (HMS), determining where to physically store the metadata/…

2 min readMar 18, 2024

--

1

Databricks: Unity Catalog Storage Patterns

--

1

Ganesh Chandrasekaran

Databricks DBR 15: Three Interesting Features

I am happy to see these three features in DBR 15, which I have been waiting for some time.

3 min readMar 17, 2024

--

1

Databricks DBR 15: Three Interesting Features

--

1

Ganesh Chandrasekaran
in
Python in Plain English

Databricks: Non-RDD Scripts for RDDs

RDDs are not supported in Databricks Unity Catalog — Shared compute clusters. This article will help you mitigate the common RDDs you…

4 min readFeb 22, 2024

--

Databricks: Non-RDD Scripts for RDDs

--

Ganesh Chandrasekaran
in
Python in Plain English

Medallion Architecture in PySpark: From Basic Scripts to Advanced OOP Methods

In this article, I will introduce you to the Medallion Architecture approach to organizing data processing tasks into manageable layers…

4 min readFeb 12, 2024

--

4

Medallion Architecture in PySpark: From Basic Scripts to Advanced OOP Methods

--

4

Ganesh Chandrasekaran

Multi-Column Pivots in PySpark

This example is implemented using PySpark, but the concept works with ANSI SQL, too.

3 min readFeb 11, 2024

--

Multi-Column Pivots in PySpark

--

Ganesh Chandrasekaran

Ganesh Chandrasekaran

Big Data Solution Architect | Adjunct Professor. Thoughts and opinions are my own and don’t represent the companies I work for.

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams