Accessing SERL data

Accessing SERL data2023-02-02T15:54:28+00:00

What data is available?

The SERL research environment allows accredited UK academic researchers access to pseudo-anonymised data via a Secure Lab environment.

  • daily and half-hourly energy (electricity and gas) consumption data
  • additional smart meter technical data
  • contextual data
    • a short SERL survey completed by participant households providing information about the household and the building
    • Energy Performance Certificate (EPC)
    • weather data
  • tariff data – see documentation for more detail

SERL has recruited 13,300 GB households to form the core Observatory panel (with the above data) over three waves:

  • Wave 1, (Pilot phase) August to October 2019: recruited 1,700 households
  • Wave 2, August to October 2020: recruited 3,100 households
  • Wave 3, January to March 2021: recruited 8,500 households

You can learn more about the type of data available by viewing the SERL Stats report and accompanying datasets on our reports page.

Introductory videos

SERL – a new energy data resource (Webinar 12/05/21). (PDF version)

Accessing SERL Data (UKDS webinar 21/01/21). Full video on UKDS site.

Accessing the SERL Observatory data

Access to Smart Energy Research Lab (SERL) Observatory data is provided via a secure lab environment and is restricted to accredited researchers working on approved projects. This aligns with the 5 Safes protocols used by the UK Data Service (UKDS) for all access to any controlled data via a secure lab. Currently, SERL only provides controlled datasets via a secure lab environment.

The process to obtain access to controlled data is appropriately rigorous so it is strongly recommended that researchers read the detailed documentation associated with the SERL catalogue record (SN 8666) in the UKDS data catalogue to ensure that SERL data is appropriate for your research project before any other steps.

Summary of steps and rough timelines:

  1. Accredited Researcher status – Safe Researcher training and exam – 1 month
  2. University Ethics approval – this varies by institution but allow at least 3-4 weeks
  3. Project application – UKDS triage and SERL Data Governance Board review – 4-6 weeks

Therefore, if starting from scratch, it is recommended that researchers allow at least 3 months for completion of the above processes before access to the data is actually required.

One page application overview – with estimated applicant time and processing time needed for each step.

For full details and to begin an application visit the UKDS website

SERL Laboratory function

In addition to the Observatory, SERL supports a ‘Laboratory’ function whereby third-party researchers may collaborate with SERL to recruit their own participants and use SERL to gain access to smart meter data and other linked contextual data for these participants. Use of the Laboratory requires additional support from SERL and comes with additional requirements of third-party researchers.

More information on using the laboratory function is available here: SERL laboratory – user summary (PDF)

Other users

Direct access to granular data via SERL is only available to accredited researchers (where accredited researchers are not based at UK HEI institutions they will need to collaborate with colleagues from a UK HEI institution to act as lead applicant on the project). Other interested parties may be able to obtain valuable insights or aggregated results by collaborating with a UK university on a relevant research project (which will need to go through the approval process described above). For more information please contact [email protected]

Updates

If you would like to receive occasional updates on SERL’s work via our mailing list, please email your name to [email protected] (your name and email address will only be used to email you updates about SERL portal and you can ask to be removed from the list at any time).

For further information please see FAQs below. You can also contact [email protected] or fill in the below contact form if you would like an initial discussion before applying to access the data.

Contact form

FAQS for researchers

What location data is available in the SERL dataset2021-10-28T15:16:57+01:00

The SERL dataset includes ‘Region in GB’, ‘Lower Super Output Area in GB (LSOA)’ and ‘Grid cell for linking to climate data’. For more detail see ‘SERL Participant Summary Documentation’ in the Smart Meter data: Technical Documentation Please contact [email protected] if you require any further information.

Where can I find detailed information on SERL data?2020-08-03T15:55:58+01:00

See the relevant UK Data Service page for detailed technical documentation of SERL smart meter and contextual data.

Who can access SERL data?2022-04-28T16:18:59+01:00

Normally SERL granular data will only be accessible to accredited UK researchers. Accredited researchers who are not affiliated to a UK Higher Education Institution (HEI) will need to have a UK HEI partner to act as project lead on their application. 

PhD students can access the data if their supervisor is included on the application and goes through the project approval process with the student as above. Masters and undergraduate students will not be able to access the granular data.  

Other parties such as policymakers, overseas academics or private sector organisations wishing to use the SERL portal would need to do so in partnership with accredited UK researchers. SERL hopes to develop a mechanism to put academic and non-academic parties interested in researching similar topics in touch with each other to develop projects.  Please contact [email protected] if you would like to enquire further about this possibility.

Can I upload my own data to SERL?2020-07-10T14:18:23+01:00

The laboratory function of the researcher portal will allow you to upload your own project data to SERL to compare with the SERL core data – subject to adherence to rigorous security and data governance procedures. See more on Data Governance

More detailed information is available in the Key Documents section. Please contact [email protected] if you require any further information on researcher use of SERL.

Where can I find publications that use SERL data?2020-06-18T17:05:04+01:00

Publications using SERL data will be posted on this site under the Key Documents section as they appear.

How does SERL recruit participants?2020-07-10T14:16:29+01:00

SERL recruits households randomly selected from a list of addresses with a DCC-enrolled smart meter in England, Scotland and Wales. These households are sent a letter (and reminders) by post inviting them to participate by consenting to data collection and (optionally) completing a survey. More details about participant recruitment can be found in the Participants section and in the Key Documents.

What contextual data will be available?2021-08-04T14:36:22+01:00

SERL asked all participants to complete an optional contextual survey about their household and dwelling when they signed up. We also link relevant external datasets such as weather and Energy Performance Certificate (EPC) data to smart meter and SERL survey data.

What is the sample size of the data available?2022-09-16T15:44:58+01:00

SERL recruited 13,000 GB households from 2019-2021. The data for the full sample was first made available in the 3rd Edition of the SERL dataset, released in August 2021. All recruited homes have DCC-enrolled smart meters (electricity and/or gas).

Do I need ethics approval for my research?2019-07-05T12:56:01+01:00

Applications to SERL will be assessed by the SERL Data Governance Board. A prerequisite of applications to use SERL data is that the project has been approved by the applicants’ institutional ethics committee.

Go to Top