Archive Historical Data from customer_file_data_bronze_clone to customer_file_data_bronze_ar

Information:

 

A data engineer is responsible for data management and compliance, I want to archive historical data from the last five years to ensure data integrity, availability, and compliance with data retention policies.

 

Requirement:

 

Create a Databricks SQL queries to archive the data in customer_file_data_bronze_clone table into a separate table named customer_file_data_bronze_ar using the logics mentioned in the attached excel.

 

 

 

Prerequisites:

 

1. Drop the table customer_file_data_bronze_clone if exist.
2. Create replica of customer_file_data_bronze table in customer_file_data_bronze_clone   table and perform the requirement in the replica table.