Solved

Data quality checks

Posted on 2016-10-18
2
110 Views
Last Modified: 2016-11-03
Hi,

I need to do data quality checks soon writing sql. I have the understanding of doing the following test types

1)validity -if the field is populated or not, if it has valid values or not

2)completeness-null or blank occurrences

First steps I am thinking of is doing data profiling on specific fields that I will be performing data quality test that I know if it allows null values or not..Any specific questions I should ask the team that is been doing testing(They haven't given me walkthrough and they wont too but I just want to ask intelligent questions regarding data quality testing)

Anything else that I should do to make sure the data quality test  is done properly.

Thanks in advance.
0
Comment
Question by:techEverest
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
2 Comments
 
LVL 51

Accepted Solution

by:
Ryan Chong earned 500 total points
ID: 41849368
aside of what you have mentioned above, basically you can ask further for the relationship of the data. That's relating to data integrity/validity, just imagine if the data need to be mapped to other tables. because we need to know the possible values of your data, then we can define and judge whether the data quality is good. if we don't, we may treat the data is good but actually it's not.

you can also include other verification such as data type and precision checks.

it's better if you have documented all info into some technical specs or data dictionary for references.
0
 

Author Comment

by:techEverest
ID: 41873274
Thanks
0

Featured Post

How our DevOps Teams Maximize Uptime

Our Dev teams are like yours. They’re continually cranking out code for new features/bugs fixes, testing, deploying, responding to production monitoring events and more. It’s complex. So, we thought you’d like to see what’s working for us. Read the use case whitepaper.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

CCModeler offers a way to enter basic information like entities, attributes and relationships and export them as yEd or erviz diagram. It also can import existing Access or SQL Server tables with relationships.
Read about achieving the basic levels of HRIS security in the workplace.
Video by: Steve
Using examples as well as descriptions, step through each of the common simple join types, explaining differences in syntax, differences in expected outputs and showing how the queries run along with the actual outputs based upon a simple set of dem…
With the power of JIRA, there's an unlimited number of ways you can customize it, use it and benefit from it. With that in mind, there's bound to be things that I wasn't able to cover in this course. With this summary we'll look at some places to go…

726 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question