Business Intelligence (BI)
- Business Intelligence is meant to convert the operational data into strategic information which is used for decision making by end-users in an organization
- BI is a type of application software designed to retrieve, analyze, transform, and report data for business needs.
- BI technologies provide historical, current, and predictive views of business operations.
- BI helps people to take the right decision at the right moment with the right data
ETL and Reports
ETL – is a process that extracts data from source systems, transforms the information into a consistent data type, then loads the data into the destination system.ETLs have a scheduler option to run their jobs.
Data Warehouse – is a system used for reporting and data analysis. It is used to store current and historical data in one single place.
Reports – Representing the data that got loaded into the data warehouse in a specific format which is useful for end-users to make business decisions.
ETL Process
ETL Testing
- Transportation of data from extraction to loading could result in human or system errors which would result in poor information conveyed across the enterprise.
- We do ETL testing to prevent duplicate records and data loss during the ETL process
- Below are the major checks that we need to do as part of ETL testing
- Check the source data extraction logic in the destination system (ETL will not take all available data from source.It has to extract specific data as per business requirement)
- Example: Pick Companies data(employees data) who crossed 100 billion dollars profit across countries
- Check the data /business logics are applied on destination data
- Example: Annual income money conversion should be based on region
- Check the Data Reports are expected as per user inputs
- Example: Min and Max salary for designation X of A Company
- Check the source data extraction logic in the destination system (ETL will not take all available data from source.It has to extract specific data as per business requirement)
For more validation checks @ https://www.tutorialspoint.com/etl_testing/etl_testing_quick_guide.htm
Popular ETL Tools
Happy Learning 🙂