  | April 2023 |   | ||||
| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
| 1 | ||||||
| 2 | 3 | 4 | 5 | 6 | 7 | 8 |
| 9 | 10 | 11 | 12 | 13 | 14 | 15 |
| 16 | 17 | 18 | 19 | 20 | 21 | 22 |
| 23 | 24 | 25 | 26 | 27 | 28 | 29 |
| 30 | ||||||
Events available for Registration...
PNSQC December Meetup
12/18/2024
register for this event...
PNSQC 2025 Quality Jam
1/23/2025
register for this event...
PNSQC December Meetup
12/18/2024
register for this event...
PNSQC 2025 Quality Jam
1/23/2025
register for this event...
Events in the month of April 2023
Storage is cheap, processing is flexible, and data is a hidden trove of value increasingly used to drive business decisions and priorities. We generate it by the terabyte. We copy it from database to database, transform it from NoSQL to Relational data to graphs and charts. We ingest it from customers and reflect it back to them with augmentations and additions our Sales departments have promised are just what is needed to drive them to the next level. Yet whether it’s an unstructured data lake or a decades-old dusty schema everyone eventually comes to a point where they realize that a lot of this data is possibly wrong, missing, or maybe just useless junk.
How do you measure the quality of your data? What are the actual metrics that can be used to measure data quality to ensure confidence in your decision-making process? What does data quality even mean?
Data Quality is a comparison of the actual state of a particular set of data to a desired state.
For data quality to be measured you need a standard of comparison. Within a given data set you can compare that data with itself or statistically with similar data sets. Between copies of data you can compare the source data to the target data while compensating for business rules that transform or selectively filter data between the two.
Each of those methods has a number of data quality measurements that can be used as components of total data quality such as:
If your business and customers depend on data you need date you can depend on.
Nick Bonnichsen is a Software QA Engineer with over 20+ years of experience, some of it actually worthwhile. He has focused on data and data centric testing for the last 8 years or so having worked in various parts of testing and deciding to stay the heck away from UIs whenever possible. In his free time Nick enjoys live music, overly complicated video games, poor attempts at woodworking, international travel, and the occasion backpacking trip.
This will be a hybrid meetup - both in person in Portland and on zoom. PNSQC will provide some drinks and food for those who can attend in person.
4/12/2023
Measuring Data Quality and Data StewardshipStorage is cheap, processing is flexible, and data is a hidden trove of value increasingly used to drive business decisions and priorities. We generate it by the terabyte. We copy it from database to database, transform it from NoSQL to Relational data to graphs and charts. We ingest it from customers and reflect it back to them with augmentations and additions our Sales departments have promised are just what is needed to drive them to the next level. Yet whether it’s an unstructured data lake or a decades-old dusty schema everyone eventually comes to a point where they realize that a lot of this data is possibly wrong, missing, or maybe just useless junk.
How do you measure the quality of your data? What are the actual metrics that can be used to measure data quality to ensure confidence in your decision-making process? What does data quality even mean?
Data Quality is a comparison of the actual state of a particular set of data to a desired state.
For data quality to be measured you need a standard of comparison. Within a given data set you can compare that data with itself or statistically with similar data sets. Between copies of data you can compare the source data to the target data while compensating for business rules that transform or selectively filter data between the two.
Each of those methods has a number of data quality measurements that can be used as components of total data quality such as:
- Consistency
- Completeness
- Validity
- Exactness
- Aptronymity
- Uniqueness
If your business and customers depend on data you need date you can depend on.
Nick Bonnichsen is a Software QA Engineer with over 20+ years of experience, some of it actually worthwhile. He has focused on data and data centric testing for the last 8 years or so having worked in various parts of testing and deciding to stay the heck away from UIs whenever possible. In his free time Nick enjoys live music, overly complicated video games, poor attempts at woodworking, international travel, and the occasion backpacking trip.
This will be a hybrid meetup - both in person in Portland and on zoom. PNSQC will provide some drinks and food for those who can attend in person.