Project

Status: September 2023

Overview

LED-based lighting contributes to energy saving and the reduction of the environmental impact of lighting. However, LED lamps can show fluctuations in the light output known as temporal light modulation (TLM) which could, above certain limits and under certain conditions, impact the health, well-being and safety of people. The new EU Ecodesign 2019/2020 ‘Single Lighting Regulation’ sets limitations on TLM. The overall aim of this project is to create the metrology infrastructure for the measurement of TLM in LED lighting and the visual effects induced by TLM, known as temporal light artefacts (TLAs). This project will develop and validate measurement methods for quantitative measurement of TLAs, such as flicker and the stroboscopic effect, and it will advance the development of a metric for the phantom array effect. The project results will underpin the development of standardisation on TLM and will provide the lighting industry, instrument manufacturers and market surveillance authorities with undisputable results of their TLM measurements.

Need

LED-based lighting is ever increasing, and the market is estimated to be worth more than 35 € billion in 2022. The ongoing transition to LED lighting is an important step in achieving the European goals on improved energy efficiency. However, LED lighting may show temporal variation of the light output, covering a large range of waveform shapes and frequencies. This temporal variation can often be perceived by humans. And as stated by the International Commission on Illumination (CIE) in TN 006:2016: “can lead to a decrease in performance, increased fatigue as well as acute health problems like epileptic seizures and migraine episodes”. Also, distorted perception of moving objects could give rise to safety concerns, for instance, in traffic or work environments.

The three types of TLAs, caused by variations in light output, as defined in the TN 006:2016 by the CIE, are:

flicker, zhich is the direct perception of temporal changes of the light output;
stroboscopic effect, which is observed as a discretised motion of moving objects resulting from illumination by a temporally modulated source; and
phantom array effect (or ghosting), which corresponds to a change in perceived shape or spatial position induced by saccadic eye movements across a temporally modulated light source.

While metrics for flicker and the stroboscopic effect have been recommended by CIE, the metric for the phantom array effect is still missing due to a lack of the required research.

The need for worldwide harmonised TLM measurements has been recognised by the CIE. The European Commission has explicitly required the development of standards for the measurement of flicker and stroboscopic effect (Mandate M/519, Ares(2013)205169), and in 2021 the new EU Ecodesign 2019/2020 ‘Single Lighting Regulation’ will come into effect. In view of public health and safety, the regulation will introduce limits on the allowed modulation of light sources for flicker and the stroboscopic effect. To demonstrate compliance with the regulation, lighting industry, measurement instrument manufacturers and market surveillance authorities need to be able to perform reliable, mutually comparable measurements of these TLAs. However, the metrology infrastructure to provide validated and SI-traceable measurements of TLM and TLAs is currently not available and international agreed standards do not exist.

Real scenes and life environments, such as offices and tunnels, are often illuminated with a combination of multiple light sources and daylight presenting an effective luminance pattern of high contrast and an inhomogeneous distribution of TLM parameters. Mapping the TLM of such environment would require multiple measurements with a single spot TLM measurement device. Such measurement procedures are inefficient and do not provide a full assessment regarding TLA perception. Multispectral cameras could map the spatially distributed TLM as seen from an observer’s position. This provides a promising approach to map spatially resolved TLM and thereby to judge about the perception of TLAs in illuminated scenes. Although commercial state-of-the art image sensors, used in industrial cameras and imaging luminance measurement devices (ILMDs), already contain fast modes that provide the needed temporal resolution, methods for the evaluation of spatially resolved TLM are not yet available. Also, light sources comprised of multiple temporally modulated coloured LEDs potentially induce colour TLM, often leading to the perception of colour-breakup in the phantom-array effect. Although spectroradiometers have become widely available for spectral measurements, a framework for spectrally resolved TLM measurements is missing.

Objectives

The overall aim of this project is to create the metrology infrastructure required for the measurement of TLM and to contribute to the development of standardisation on the measurement of TLM. The specific objectives of the project are:

To establish methods for traceable TLM measurement of individual light sources and luminaires with a focus on flicker and stroboscopic effect. These should be based on IEC TR 61547-1 and IEC TR63158 and include:
1. methods for generating and measuring optical waveforms in the time‑domain and power spectra in the frequency-domain,
2. calibration and characterisation of TLM measurement devices and the evaluation of uncertainty budgets,
3. quality metrics (e.g., frequency response, dynamic range of signal) for the classification of TLM measurement instruments.
To validate the traceable TLM measurement methods, developed in Objective 1, through an interlaboratory comparison between metrology institutes and industry, whilst ensuring compliance with the new EU Ecodesign 2019/2020 regulation. To develop a recommendation on associated standardised measurement conditions.
To develop novel methods for measuring TLM of the illuminated environment in extended scenes (e.g., offices, roads or tunnels) and for multispectral TLM measurement of light sources.
To develop a model for the visibility of the phantom array effect based on perception experiments that measure the visibility threshold for various lighting conditions (e.g., modulation frequency, amplitude, shape of the modulation and light level). This model should be shared with CIE TC 1-83 or its successor in a suitable format that enables its use in a future metric for the phantom array.
To facilitate the take up of methods, technology and measurement infrastructure developed in the project by the standards developing organisations (e.g., CIE) and end-users (e.g., regulatory bodies, lighting industry and instrument manufacturers). This should include providing input to CIE TC 2-89 and CIE TC 1-83 (or its successor) and support for a new CIE TC for addressing the measurement of spatially resolved TLM and colour TLM.

Progress beyond the state of the art and results

Standardised and validated methods for traceable measurement of TLM are currently not available and measurement conditions have not yet been defined. Methods for testing equipment for flicker and the stroboscopic effect have been developed (IEC TR 63158:2018 and IEC TR 61547-1:2020), but these do not consider SI traceability or the measurement uncertainty for these quantities. So far, the efforts of national metrology institutes (NMIs) to provide SI traceability to TLM measurement devices and sources have been very limited and do not cover the TLA metrics for short-term flicker severity (PstLM) and stroboscopic visibility measure (SVM) used in the EU Ecodesign regulation.

This project will deliver validated methods and measurement conditions for traceable measurement of temporal light modulation for flicker and the stroboscopic effect, and it will support the development of standardisation on TLM measurement. It will contribute to the development of TLM measurement capability at NMI level. The developed TLM calibration methods will be validated by an interlaboratory comparison. The project outcomes will be summarised in a publicly available good practice guide (GPG), which will support CIE in the development of standardisation of TLM measurement via CIE TC 2-89 ‘Measurement of Temporal Light Modulation of Light Sources and Lighting Systems’. The overall goal is to provide stakeholders with reliable measurement results and well-underpinned measurement uncertainties for their TLM measurements, which is a prerequisite for the implementation and enforcement of regulations on modulated light sources.

Currently only single dimensional TLM measurement devices are available to measure TLM locally. However, for the phantom array effect, the spatial luminance pattern is important and imaging techniques are nowadays widely used to characterise lighting situations regarding its time-averaged luminance distribution. This project will investigate high-speed imaging as a new approach to measure the TLM distribution of structured luminaires and in extended scenes. This work is expected to contribute to a next generation of TLM measurement instruments.

With Red, Green, Blue (RGB) modulated displays and multispectral Red, Green, Blue, White (RGBW) or tuneable white luminaires colour-dependent temporal light modulation is also gaining attention. Measurement methods to quantify colour (or spectral) TLM are currently not available. In this project, methods to assess colour- and (multi)spectral TLM will be investigated and demonstrated.

A metric for the phantom array effect has currently not yet been defined. Although several studies on the human perception of the phantom array effect have been executed, there is currently insufficient scientific evidence available to serve as a base for a definition of the phantom array effect.

This project aims to develop a model for the visibility of the phantom array effect based on representative perception experiments that measure the visibility threshold for various lighting conditions. This model should contribute to the definition of a suitable metric for the phantom array effect.

Impact

The first results of the project, related to calibration of TLM measurement devices, were presented at the CIE Midterm Meeting hosted by MyCIE, the Malaysian CIE committee, in 2021. The project contributed to the CIE Expert Tutorial on the Measurement of Temporal Light Modulation in Athens, Greece, October 2022. The attendees were trained in measurement of TLM, estimation of measurement uncertainties and uncertainties in calculation of predictors of TLAs. The tutorial was followed by a project stakeholder meeting, which was attended by about fifty participants. After the presentations, the consortium and stakeholders engaged in open discussion. Stakeholders endorsed the need for guidance on implementation of TLM models as well as on the propagation of uncertainties. In addition, stakeholders endorsed the need for spectrally resolved TLM measurements, referring to colour-breakup perceived in light sources comprised of multiple temporally modulated coloured LEDs. At the CIE quadrennial session, held in Ljubljana, Slovenia, in September 2023, results of the MetTLM project have been presented by four members of the consortium in a dedicated session on temporal light modulation. Linked to this event, in a meeting of the CIE research forum on matters relating to temporal light modulation, project results have been presented and discussed. In conjunction with the final project meeting at PTB in April 2024 a training session was held, focusing on measurements, measurement uncertainty as well as verification and validation. Using an RGB-based smart lighting product also technical aspects of handheld flicker-meters that cover a huge price range, namely sampling rate and duration, aliasing, signal ringing at steep slopes, offset, and time constants and their dependence on the measurement range as well as digital low-pass filtering, had been demonstrated in the training.

A project website was regularly updated: https://www.mettlm.eu. In total, 104 people registered on the website to receive periodic project updates via email. Registrants include EU Member State representatives, government experts, test organisations, manufacturers of measurement instruments, NGOs and other associations. As a result of direct engagement with stakeholders, 7 stakeholders confirmed the need for standardized measurement methods for TLM. To generate further awareness of the project, results have been presented at meetings of CIE, DIN, IEA SSL Annex and EURAMET TC PR. A YouTube video has been released aimed at explaining definitions related to TLM to the general public, a longer video on the subject of TLM contains an interview with a prominent researcher.

Impact on industrial and other user communities

The availability of reliable TLM measurements and related temporal light artefacts is important for the lighting industry, because the Ecodesign Commission Regulation (EU) 2019/2020 sets limits for flicker and the stroboscopic effect of the light sources and luminaires they bring to the market. The project outcomes will further support the lighting industry in its efforts to demonstrate compliance of lighting products with the regulation. Similarly, market surveillance authorities will benefit from the availability of metrological methods and calibrated TLM measurement instruments, which is required for them to fulfil their role to enforce compliance with the regulation.

The project provided novel methods using multispectral imaging measurement devices to measure TLM of extended scenes or large area luminaires and displays. The findings already initiated an improvement of the TLM measurement mode implemented in a commercial imaging luminance measurement device (ILMD). The initiated luminance, multichannel, and tristimulus TLM meters were demonstrated regarding their advantages compared to illuminance TLM meters. These results are especially relevant to end users who want to measure the quality of lighting in field installations e.g., in an office space under mixed lighting conditions or on a building façade. The research on the visibility of the phantom array effect of car taillights could provide the automotive industry and lighting manufacturers with a quantitative measure for the visibility of this effect. This could enable them to improve lighting products such that the visibility threshold for the phantom array effect is not exceeded, enhancing the safety and consumer appreciation of their products.

To promote the uptake of the project’s outcomes by the lighting industry and instrument manufacturers, the consortium invited stakeholders from these sectors to participate in the interlaboratory comparison. To increase the number of participants the comparison was joined with the IEA 4E SSL Annex comparison.

The consortium built up LED- and laser-based facilities to characterise and calibrate TLM measurement devices. The first commercially available TLM measurement devices have been tested against the facilities. Further characterisation and calibration of TLM measurement devices is foreseen to support regulatory compliance assessments. Preliminary tests were conducted on several (commercially available) TLM sources, using a variety of imaging devices, demonstrating the benefit of imaging TLM measurement modes.

In collaboration with stakeholder LightingEurope the project conducted at webinar on “Measurement of lighting with temporal light modulation and EcoDesign”. The webinar was attended by at least 150 participants, with 300 signing up beforehand. A LinkedIn announcement of the Webinar generated more than 1000 impressions on the platform.

Impact on the metrology and scientific communities

The project has strengthen the knowledge and measurement capabilities of national metrology institutes on the characterisation and calibration of TLM measurement devices and TLM sources. This will enable NMIs to establish calibration services of TLM measurement devices and/or reference sources for their stakeholders. The project will publish a set of representative computer-generated and real-life waveforms and the corresponding values and measurement uncertainties for flicker and the stroboscopic effect. This will allow scientists and metrologists involved in TLM measurement to validate their models and uncertainty calculations. Within the project, novel techniques for measuring temporal light modulation of complete scenes will be investigated, based on high-resolution time-resolved and spatially resolved imaging. The development of metrology for this type of measurement is new and challenging and is expected not only to impact the field of TLM measurement, but also the wider field of metrology for time and spatially resolved photometry. The project will impact the research field on human perception of TLM. In particular, it will progress scientific knowledge on the phantom array effect with the work on the development of a metric for this TLA. More generally, the developed metrology on TLM measurement will support ongoing research on health, performance and safety effects of TLM.

To promote the uptake of the project results by the metrology community, two presentations have been given at the CIE midterm meeting (2021). In the first presentation, a laser-based TLM calibration facility is evaluated for characterisation of TLM measurement devices, in relation to the Ecodesign Commission Regulation (EU) 2019/2020. In the second presentation, the findings of sensitivity analyses of TLM measurements to noise and sampling frequency have been shown. The findings of both presentations are taken into account in the current draft of the technical report on measurement of TLM, by CIE 2-89.

At the CIE Expert Symposium on the Measurement of Temporal Light Modulation in Athens, Greece, October 2022, the setup to determine the visibility of the phantom array effect was presented. The first results have been presented as well as an outline of methods that will be used to evaluate the data.

At Lux junior 2023 in Dörnfeld bei Ilmenau, Germany, June 2023, arranged by LitTG and Technische Universität Ilmenau two presentations were given on the characterization of TLM in scenes using imaging devices.

To facilitate impact a Zenodo community has been established, where data items related to TLM in general and MetTLM specifically will be curated and collected. So far, the dataset posted there has been viewed 320 times and downloaded 120 times. The Zenodo community can be accessed here:
• https://zenodo.org/communities/mettlm20nrm01

Impact on relevant standards

The project is contributing to the work of the technical committee under the CIE, TC 2-89 “Measurement of Temporal Light Modulation of Light Sources and Lighting Systems”. One of the project deliverables is a GPG on metrological methods, instrumentation and conditions for calibration of TLM measurement devices, which will contribute to an international CIE standard on TLM measurement. CIE is the chief stakeholder of the project and the involvement of TC 2-89 in the stakeholder board of the project ensured that the needs of CIE was met and that project results can be taken up effectively. Since CIE and CEN have a formal agreement on technical cooperation, it is expected that CEN will adapt the CIE standard once available. This will help CEN to respond to the mandate issued by the European Commission (Ares(2013)205169), requiring the development of standardisation on LED lighting and the development of standards for flicker and the stroboscopic effect. This project delivered a significant contribution to scientific data on the sensitivity for the phantom array effect and the development of a metric for this TLA. This will contribute to the work of CIE continuing work with visual aspects of time-modulated lighting systems. Other standards and guidelines that are likely to be impacted by this work are IEC TR 63158:2018 and 61547-1:2020.

The project’s outcomes are being disseminated to standardisation bodies via the involvement of project partners in technical committees such as CIE TC 2-89, CIE TC 1-83, CEN 169, ISO 274, IEA 4E SSL Annex and two new TCs of CIE that are responsible for the revision of ISO/CIE 19476 on the “Characterization and performance of illuminance meters and luminance meters”, which will include characterisation of photometers with relation to TLM, and the revision of CIE S 025/E:2015, which specifies the requirements for measurement of electrical, photometric, and colorimetric quantities of LED lamps, LED modules and LED luminaires.

Over the 36 months duration of the project, the consortium was actively involved in the following international standardisation committees: CIE TC 2-89, CIE TC 2-96, CIE TC 2-97, CIE RF 02, CEN TC 169, ISO TC 274 JWG1, and the national standardisation committees DIN- NA058-00-03AA and DS-061. On behalf of the consortium direct input has been provided to the draft technical report of CIE TC 2 89, to ISO/CIE 19476:2024 “Characterisation of the performance of illuminance meters and luminance meters”, which should be published in 2024 and falls under the responsibility of CIE TC 2-96, and to CIE S 025/E:2015 Test Method for LED Lamps, LED Luminaires and LED Modules, which should be published in 2024 and is being prepared by CIE TC 2-97.

Longer-term economic, social and environmental impacts

The project outcomes will support the execution of the EU Ecodesign Commission Regulation (EU) 2019/2020, which protects EU citizens against potentially negative health, performance and safety effects resulting from modulated light sources like LED lighting. Having only compliant light sources on the market protects people against these potentially negative effects like decrease of performance, fatigue, eye strain or more severe effects like migraine episodes or epileptic seizures.

This EU regulation currently focuses on light sources that produce flicker and/or the stroboscopic effect and will be revised in 2024. Requirements on dimmable light sources, known for exhibiting TLM, will probably also be included in the revision.

The project indirectly contributes to energy saving and reduction of the environmental impact of lighting by supporting regulations that put limits on the allowed TLM of light sources. The ability to enforce compliance with regulations, based on appropriate standardisation, will be supportive to the adaption of LED lighting by the public and the phase-out of incandescent lighting. This supports European and international goals on energy saving and reduction of the emission of greenhouse gasses. End users such as building owners and governmental organisations will benefit from the outcomes of the project, since it supports them in their efforts to save energy and cost by using efficient lighting.

Impact

Impact on industrial and other user communities

Impact on the metrology and scientific communities

Impact on relevant standards

Longer-term economic, social and environmental impacts

Project administrative information

Project start date and duration:	1 May 2021, 36 months
Coordinator:	Paul Dekker, VSL tel: + 31 15 269 1500 e-mail: pdekker@vsl.nl
Project website address:	https://www.vsl.nl/en/mettlm/
Chief Stakeholder Organisation:	CIE
Chief Stakeholder Contact:	Dong-Hoon Lee
Internal Funded Partners:	VSL, Netherlands Aalto, Finland PTB, Germany RISE, Sweden
External Funded Partners:	CSTB, FranceDTU, Denmark ICCS, Greece TU-E, Netherlands VHK, Netherlands
Unfunded Partners:	GGO, Germany LMT, Germany Signify, Netherlands