Health checkup of RAW table 'items' to ensure data quality

Introduction: Health check-up of any RAW tables is an important step before the data is being published to the PROD environment. This ensures not only the quality of data on granularity level but also the availability of metadata in Unity Catalog for other downstream applications.

 

Requirement: Create SQL logic to check the duplicates in 'f_item' table using 'item_nbr' and 'item_vb' and also check if table is in unity catalog.

 

Table Definition: The table name is ‘f_item’. The primary keys are 'item_nbr' and 'item_vb'.

 

Unity Catalog Information: purgo_playground.f_item

 

Expected output: Databricks SQL