Repository files navigation

SQLDataValidationFramework

Using SQL data validation framework you can build a data validation process to validate data against complex data validation rules.

The salient features of this framework including example data validation process can be found in my 3-part blog post and 2 YouTube videos as below:

https://SQLSurya.com.au/2021/11/14/sql-data-validation-framework-1-overview/

https://SQLSurya.com.au/2021/11/14/sql-data-validation-framework-2-example/

https://SQLSurya.com.au/2021/11/14/sql-data-validation-framework-3-details/

Video 1: sql-data-validation-framework-1-overview https://youtu.be/JhvwioFUZsI

Video 2: sql-data-validation-framework-2-example https://youtu.be/6aifTHLF5Ik

Once the source code is downloaded, refer to the "00_01_ReadMe_SQLDataValidationFramework.txt" file for detailed instructions on how to deploy and run the example data validation process in your development environment.

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
.gitignore		.gitignore
00_01_ReadMe_SQLDataValidationFramework.txt		00_01_ReadMe_SQLDataValidationFramework.txt
00_Master_Script_01_Deploy_DVFramework_objects.sql		00_Master_Script_01_Deploy_DVFramework_objects.sql
00_Master_Script_02_Deploy_Example_ValidationProcess_objects.sql		00_Master_Script_02_Deploy_Example_ValidationProcess_objects.sql
00_Master_Script_03_DataValidation_BatchRun.sql		00_Master_Script_03_DataValidation_BatchRun.sql
DVFramework_01_CreateTables.sql		DVFramework_01_CreateTables.sql
DVFramework_02_dbo_usp_DataValidation_CheckNecessityOfIsValidColumn.sql		DVFramework_02_dbo_usp_DataValidation_CheckNecessityOfIsValidColumn.sql
DVFramework_02_dbo_usp_DataValidation_Cleanup_BeforeRerun.sql		DVFramework_02_dbo_usp_DataValidation_Cleanup_BeforeRerun.sql
DVFramework_02_dbo_usp_DataValidation_CreateOrGetBatchID.sql		DVFramework_02_dbo_usp_DataValidation_CreateOrGetBatchID.sql
DVFramework_02_dbo_usp_DataValidation_Generate_JOIN_clause_On_BusinessKeys.sql		DVFramework_02_dbo_usp_DataValidation_Generate_JOIN_clause_On_BusinessKeys.sql
DVFramework_02_dbo_usp_DataValidation_Generate_ORDER_BY_clause_on_BusinessKeyCols.sql		DVFramework_02_dbo_usp_DataValidation_Generate_ORDER_BY_clause_on_BusinessKeyCols.sql
DVFramework_02_dbo_usp_DataValidation_Generate_WHERE_clause_BusinessKey_NULL.sql		DVFramework_02_dbo_usp_DataValidation_Generate_WHERE_clause_BusinessKey_NULL.sql
DVFramework_02_dbo_usp_DataValidation_Generate_XML_Output.sql		DVFramework_02_dbo_usp_DataValidation_Generate_XML_Output.sql
DVFramework_02_dbo_usp_DataValidation_GetEntityID.sql		DVFramework_02_dbo_usp_DataValidation_GetEntityID.sql
DVFramework_02_dbo_usp_DataValidation_GetValidationRule.sql		DVFramework_02_dbo_usp_DataValidation_GetValidationRule.sql
DVFramework_02_dbo_usp_DataValidation_Mark_Invalid_Rows.sql		DVFramework_02_dbo_usp_DataValidation_Mark_Invalid_Rows.sql
DVFramework_02_dbo_usp_DataValidation_UpdateBatchStatus.sql		DVFramework_02_dbo_usp_DataValidation_UpdateBatchStatus.sql
DVFramework_02_dbo_usp_DataValidation_ValidateEntityAndRulesSetup.sql		DVFramework_02_dbo_usp_DataValidation_ValidateEntityAndRulesSetup.sql
Example_DataValidationProcess_01_CreateTables.sql		Example_DataValidationProcess_01_CreateTables.sql
Example_DataValidationProcess_02_Example_DataValidation_Rules.sql		Example_DataValidationProcess_02_Example_DataValidation_Rules.sql
Example_DataValidationProcess_03_Example_Data_in_staging_tables.sql		Example_DataValidationProcess_03_Example_Data_in_staging_tables.sql
Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier01_Multi_Entity.sql		Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier01_Multi_Entity.sql
Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier02_Multi_Entity.sql		Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier02_Multi_Entity.sql
Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier03_Multi_Entity.sql		Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier03_Multi_Entity.sql
Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier0_stg_Account.sql		Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier0_stg_Account.sql
Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier0_stg_Address.sql		Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier0_stg_Address.sql
Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier0_stg_Customer.sql		Example_DataValidationProcess_04_usp_DataValidation_DemoRuleset_Tier0_stg_Customer.sql
Example_Output_SQLQuery_for_standard_output_01_Customer.sql		Example_Output_SQLQuery_for_standard_output_01_Customer.sql
Example_Output_SQLQuery_for_standard_output_02_Account.sql		Example_Output_SQLQuery_for_standard_output_02_Account.sql
Example_Output_SQLQuery_for_standard_output_03_Address.sql		Example_Output_SQLQuery_for_standard_output_03_Address.sql
Example_SQLQuery_for_XML_Output_01_Customer.sql		Example_SQLQuery_for_XML_Output_01_Customer.sql
Example_SQLQuery_for_XML_Output_02_Account.sql		Example_SQLQuery_for_XML_Output_02_Account.sql
Example_SQLQuery_for_XML_Output_03_Address.sql		Example_SQLQuery_for_XML_Output_03_Address.sql
README.md		README.md

jpilli/SQLDataValidationFramework

Folders and files

Latest commit

History

Repository files navigation

SQLDataValidationFramework

About

Topics

Resources

Stars

Watchers

Forks

Languages