Data value validation quality check with indication_config to target

Requirement: Create a PySpark code to perform Data value check comparison between sql queries in ‘indication_config' table and the target table 'indication_level_metric’. Display the DQ validation results by comparing each value of every column in target and sql query output and it should display the validation column: query_<column_name>, target_<column_name>, <column_name>_validation_result (PASS/FAIL)….

 

Unity catalog: ‘indication_level_metric', 'indication_config’