Why Proficiency Testing Is Essential in a Data-Driven World
Blog
Why Proficiency Testing Is Essential in a Data-Driven World
Imagine a company that asks three different laboratories to analyse the same gas mixture. The cylinder is identical, the certificate is identical, and each lab follows the same standard method. Yet the reported concentrations differ. This impacts emission reports, compliance with limit values, and ultimately environmental permits. So which laboratory is right?
This is exactly the kind of question interlaboratory comparisons, also known as proficiency tests, are designed to address. In a world where almost every important decision rests on data, it is crucial that different parties, even if they are on opposite sides of the globe, can arrive at comparable results.
Would you like to know more about our services?
Our experts are happy to help.
Adriaan van der Veen
Chief Scientist Chemistry and Data Science & Modelling
From Single Measurement to Shared Reality
Measurement is only truly useful when results can be compared and exchanged. A single result tells you very little if you do not know how it relates to other measurements, how it compares to other laboratories, or whether there is any external confirmation of performance.
Proficiency tests turn isolated measurement results into a shared reality. Multiple laboratories measure the same sample or item using the procedures they normally apply for their customers. The results are then compared anonymously and assessed statistically.
The goal is not to pick a “winner”, but to help every participant answer three fundamental questions:
- How does our laboratory perform compared to other participants?
- Are there signs of systematic errors or drift over time?
- How well does our day‑to‑day practice align with international references and standards?
Proficiency Testing Is More Than Ticking a Box for the Audit
For laboratories accredited to ISO/IEC 17025:2017, proficiency tests are a key tool for demonstrating the validity of their results. In turn, this requires a provider that operates under ISO/IEC 17043:2023, which sets requirements for things like competence, impartiality, confidentiality, and appropriate methods to evaluate participant performance.
But treating proficiency testing merely as an accreditation or audit obligation misses the point. In practice, proficiency testing is one of the most powerful instruments for continuous quality improvement. Regular proficiency testing makes it possible to:
- See trends over time instead of isolated snapshots
- Check whether measurement procedures and calibrations perform as intended
- Create concrete training materials for analysts based on realistic datasets
- Make strategic choices on where to focus and invest in methods and equipment
Proficiency testing does not just check whether a laboratory has their “house in order”; it also gives direction on how to raise performance further.
How a Proficiency Test Works in Practice
Although the exact design will vary by discipline and provider, a well‑structured proficiency testing program generally follows the same steps.
- One Measurement by Multiple Laboratories
All participating labs receive identical samples or so‑called “measurement artefacts” (often an instrument or standard). These can be gas mixtures, where each participant receives a separate cylinder, or physical standards such as flow meters, resistors, or mass pieces that circulate from lab to lab. Each laboratory then performs the required measurements using its normal procedures, instruments, and routines. The aim is to test everyday practice.
- Anonymous Comparison
The results are collected and anonymised. Each laboratory receives a unique identifier. This code allows every participant to recognise its own data in the anonymised report. At group level this provides a picture of the spread: how many labs are close to the reference value, and how many deviate. Individually, each lab can use its code to see where it sits in that distribution, without others being able to trace the results back to them.
- Statistical Evaluation According to International Standards
Providers that comply with ISO/IEC 17043 apply internationally accepted statistical methods to interpret performance. Typical tools include Eₙ- or Z‑scores to assess deviations from a consensus or reference value. This shows whether a deviation falls within the normal variation, or whether there are indications of a systematic issue, for example in calibration, in the method, or even in how the sample was handled.
- Detailed Reporting
The strength of a good proficiency test lies in the feedback. Participants receive a detailed report that shows their own results in relation to the group, together with an interpretation of any deviations. This turns the interlaboratory comparison into a tool for learning and improvement, rather than merely an administrative checkmark.
Finding Errors Before You Have to Deal With Consequences
Internal quality controls are an essential foundation, but only cover part of the quality picture. They are typically tuned to the laboratory’s own routine, using the same instruments, the same people, and often the same types of samples. Proficiency testing adds a crucial extra layer: external perspective.
This external perspective can reveal slow drift in instruments that internal checks alone would miss, or uncover unexpected sensitivities in a measurement method. In a wide range of sector-specific applications, including clinical chemistry, food safety, environmental monitoring, and energy measurements, this can mean the difference between fixing errors in time or having to explain afterwards why results turned out to be unreliable. In that sense, proficiency testing is a form of proactive risk management.
Trust as the Ultimate Outcome
Ultimately, proficiency testing is an exercise in building trust in measurement results. That trust is essential for sound decision‑making, about patients, the safety of drinking water, industrial emissions, and the quality of our energy infrastructure. Without it, every individual result becomes a point of contention instead of a shared foundation for debate.
Proficiency testing makes trust testable. It shows that laboratories can live up to their accreditations, not just on paper but in daily practice, and that their data can be relied on.