Partition C360 Config Queries Output

Requirement:

Develop a PySpark script to execute SQL queries in c360_config table and store the result in volume location by partitioning the result based on the column names specified in the partition_column. Note: partition_column may have multiple values(multiple columns) separated by commas.

 

Unity Catalog: c360_config

 

Volume: /Volumes/agilisium_playground/purgo_playground/de_dq/C360/