Load Json file

Requirement: Develop a Databricks pyspark script to read the json file from dbfs location (/FileStore/tables/product_json_file/d_product_sample.json) which has json string column product_details expand that and store all columns in json file as data frame along with expanded columns and drop product_details column from the final data frame.

 

  The product_details column contains the data like:

 

{ 

 

  "batch_number": "BATCH2024-5678", 

 

  "expiration_date": "2025-12-31", 

 

  "manufacturing_site": "Site A", 

 

  "regulatory_approval": "Approved", 

 

  "price": 250.75 

 

}