Using the SERL dataset for public good research
The Smart Energy Research Group at UCL are working on a number of public good projects utilising the SERL dataset with a variety of partners including the Department for Energy Security and Net Zero (DESNZ), the Ministry of Housing, Communities and Local Government (MHCLG) and the University of Oxford. See the UCL website for more details.
External projects
Projects funded from outside the SERL consortium that use the SERL data and infrastructure.
Institution: University of Bath
Project researcher: Samuel Hampton
Funder / grant reference: ESRC ES/V015133/1
Project description: ACCESS seeks to understand what it will take for the diverse UK population to become more ‘carbon capable’. How can low carbon lifestyles be made fulfilling, desirable, affordable, and accessible to all? This project addresses this question through four tasks. Task 1 will combine insights from a nationally representative survey with analysis of SERL data. Task 2 will involve in-depth qualitative research with (1) social housing tenants; (2) digitally excluded people aged over-60; and (3) micro businesses. Task 3 will develop a theoretical model for carbon capability, and Task 4 involves co-creating solutions with stakeholders.
Contact: [email protected]
Institution: Loughborough University
Project researcher: Stephen Watson
Funder / grant reference: Active Building Centre Research Programme
Project description: Project to develop a model of Active Buildings based on monitored data. Active Buildings make use of local generation, storage and load-shifting to modify demand/supply in response to external signals. This will enable greater integration of renewables and reduce the need for upgrading grid infrastructure. Assessing the benefits of Active Buildings requires a model giving high temporal resolution (e.g. half-hourly). This model will be based on monitored data, capturing the patterns of demand found in real buildings.
Contact: [email protected]
Institution: University of Aberdeen
Project researchers: Russell McKenna, Febin Lachirayil
Funder/grant reference: PhD Research
Project description: The general objective of this project is to obtain a better understanding of the interactions between the decentralized energy system (of the future) and the centralized energy system (of today), especially in the context of energy modelling. The specific objective is to better understand what is today referred to as the domestic “demand side” in general, but in the future will be less distinct and much more flexible, incorporating large amounts of local storage capacities. The focus is on two or all of the following aims:
- Develop domestic heat and electricity load profiles and their potential evolution in the future, especially within the context of more decentralized generation, reducing future heat demand in buildings due to more efficient building fabric and changing householder behavior.
- Investigate the effect of scale on load profiles and energy autarky, and the effects it may have on the overarching energy system, by considering both heat and electricity demand at a higher spatial resolution.
- Analyse demand response and load shifting, which are likely to have profound effects on the domestic load profiles in the future, as households encounter variable tariffs and automatic real-time optimization of their generation and demand becomes possible through increased local energy storage.
Contact: [email protected]
Institution: University of Edinburgh
Project researchers: Martin Pullinger, Nigel Goddard, Jonathan Kilgour, Lynda Webb
Funder/grant reference: ESPRC EP/V042955/1
Project description:
DISPATCH is a 3-year, EPSRC-funded project to identify socially just and efficient pathways for decarbonising heating and cooling in the UK. This SERL-based component of DISPATCH will describe typical patterns of heating and cooling energy use in several physical building types common in GB, identifying the impact of different heating and cooling systems and building envelopes within each. The typical change in energy use under different changes in heating/cooling system and building envelope will be estimated. Results will feed into the wider project as well as into published outputs relevant to stakeholders involved in UK heating and cooling decarbonisation.
Project website: https://www.research.ed.ac.uk/en/projects/decarbonisation-pathways-for-cooling-and-heating-dispatch
Institution: University of Strathclyde
Project researchers: Jethro Browell, Ciaran Gilbert, Bruce Stephen, Rory Telford.
Funder/grant reference: EP/S030131/1
Project website: https://www.amidine.net/about-amidine/amidine-people/
Lead institution: University College London
Project researchers: Eoghan McKenna, Ellen Webborn, Jessica Few, Despina Manouseli, Callum Cheshire, Harry Masters, Alex Whittaker.
Funder/grant reference: Western Power Distribution (WPD) Venice Project (funded by Ofgem via the Network Innovation Allowance)
Project description: Understanding the impact of the pandemic on residential electricity consumption will have two benefits for electricity distribution network operators. The first benefit of the project will be to understand how customers in vulnerable situations have responded to the pandemic, and whether the pandemic has exacerbated vulnerability. It is a network operator’s responsibility to ensure vulnerable customers’ energy needs are cared for, and so understanding the impact of the pandemic on those customers will be vital to understanding what kind of care and which types of customers they will need to prioritise in the future.
The second benefit will be at a distribution network level; being able to understand customers that have changed energy consumption behaviour during the pandemic will have wider network planning impacts. In particular, being able to identify the extent to which this behaviour might persist in the future will mean being able to better identify future stress on the network, and make more efficient planning decisions, ultimately leading to lower costs for consumers.
Contact: [email protected]
Outputs: Project VENICE: The impact of the pandemic on electricity consumption
Institution: University of Oxford
Project researcher: Nick Banks
Funder / grant reference: BEIS Heat Pump Ready Phase 1
Project description:
This project aims to use advanced cluster analysis techniques to:
- Derive distinct thermal energy demand profiles and then calculate the impacts of adoption of heat pumps on energy demand.
- Link technical and socio-economic attributes and capabilities with each demand profile.
- Analyse how each heat pump demand profile could be shifted based on each household’s technical, economic and social capability profile and the various interventions available.
- Map projected demand profiles at postcode level.
The main benefits are improved understanding of:
- The impacts of mass adoption of heat pump technology.
- The most effective means of facilitating adoption of heat pump technology.
More information: Clean Heat Streets | Social Sciences Division
Institutions: UCL, Frontier Economics
Project researchers: Ellen Zapata-Webborn, Eoghan McKenna. Jessica Few, Gesche Huebner, Martin Pullinger, Simon Elam. Callum Cheshire, Harry Masters, Alex Whittaker.
Funder/grant reference: National Grid Electricity Distribution
Project description: This project aims to estimate the impact of the Cost-of-Living Crisis (CoLC) on energy use and energy bills in GB homes. Using SERL data we’ll compare electricity and gas use during autumn/winter 2022/23 with counterfactuals that predict what would have happened had energy prices and the cost of living not increased significantly since the previous year. SERL survey data that asks about energy behaviour changes in response to the CoLC will help explain any changes we see, and identify the most popular energy-saving behaviours. Tariff data will show how bills have changed.
Contact: [email protected]
Outputs: Project Venice – Impact of the Cost-of-Living Crisis on Domestic Energy Consumption.
Institution: University of Reading
Project researcher: Mehdi Shahrestani
Project description: The aim of this study is to develop a model to manage the energy consumption in buildings and reduce the pressure from the electricity network when we have the uptake of heat pump technology. The following are the objectives of the research:
1. Review of the existing model for the demand side management in buildings.
2. Investigate the pattern and profiles of energy demand using the smart meter data.
3. Identify the main drivers of energy demand in buildings available considering EPCs and weather data as well as published work on the impact of social practices on energy demand.
4. Developing a numerical model to manage the energy demand under different scenarios for controlling the heating and hot water systems in buildings to avoid increasing electricity demand in peak hours of energy demand.
5. Evaluation of the model through the identification of the uncertainties in the model and carrying out a set of sensitivity analysis.
Contact: [email protected]
Institution: UCL / University of Oxford
Project researchers: Clare Hanmer et al
Project description:
The Energy Demand Observatory and Laboratory is a 5 year £9m collaboration between UCL and Oxford University which aims to build on the work of SERL by adding additional data streams such as internal temperature monitoring to the existing SERL data of gas and electric smart meter data plus weather and EPC. This exploratory project provides access to SERL data for Oxford and UCL teams in order to plan for EDOL recruitment, data gathering and data analysis.
Contact: [email protected]
Institution: University of Glasgow
Project researchers: Jethro Browell, Vincent Davies, Jethro Linley
Funder: University of Glasgow / Natwest
Project description:
This project will analyse electricity and gas smart meter data from UK households to understand and predict carbon emissions associated with domestic energy consumption. We aim to model household emissions based on characteristics such as household composition, size of dwelling, and Energy Performance Certificate data. The purpose of this project is to improve the accuracy with which the carbon emissions associated with financial produces such as mortgages is calculated, and to support the development of new policy and products that support decarbonisation and the UK’s net-zero targets.
Contact: [email protected]
Institution: UCL
Project researchers: Jessica Few, Minnie Ashdown, Daniel Godoy Shimizu, Frances Hollick, Tadj Oreszczyn
Funder: DESNZ
Project description:
Energy Performance Certificates (EPCs) underpin the majority of home decarbonisation and fuel poverty policies of the Government. It is therefore important that they accurately reflect the difference in efficiency between different homes. However, EPCs have been widely criticised for inaccuracy and recent research by the applicants has quantified the significant level of discrepancy between EPC calculated energy use and metered energy demand which persists after correcting for the commonly assumed causes of performance gap (e.g. underheating). This project seeks to understand the ‘performance gap’ and thereby contribute to improving EPCs in the future.
Contact: [email protected]
Institution: University of Salford
Project researchers: Diyar Alan, Ioannis Paraskevas
Funder/grant reference: PhD research
Project description: In response to the climate crisis, the UK extended the 80% carbon reduction to Net-Zero greenhouse gases by 2050. Domestic space heating is recognized as a major contributor to greenhouse gases, therefore requires attention. Energy Performance Certificates (EPCs) were created by Standard Assessment Procedure (SAP) to address efficiency, which is said to be empirical and inaccurate at times. A quantified Heat Transfer coefficient (HTC) can be estimated using smart meter data to verify the EPC ratings. HTC value can be used to measure the effectiveness of retrofitting and quality of building materials.
Project website/contact: https://www.salford.ac.uk/our-staff/diyar-alan
Institution: University of Surrey/BEIS
Project researchers: Kavin Narasimhan, Nigel Gilbert
Funder / grant reference: BEIS Net Zero Digital, Data Social Science ESRC Policy Fellowship
Project description:
This project will:
1) Explore how energy price changes (including the energy price cap which sets out the amount energy suppliers can charge per kilowatt hour of electricity and gas each year) affects demand. Because of various geopolitical factors and the pandemic, the energy price cap has increased significantly in recent times and is set to increase further in the coming months. The term ‘price elasticity’ refers to change in the quantity of a resource (e.g., energy) corresponding to a change in price. This project would estimate the price elasticity of residential energy demand.
2) Explore and scope out how the SERL database can be used to inform the evaluation of UK energy policy.
Institutions: University of East Anglia, Loughborough University
Project researchers: Andrew Burlinson, Monica Giulietti
Funder/grant reference: UKERC/ESRC/EPSRC, see: Gas price volatility: distributional impacts and mitigations | UKERC | The UK Energy Research Centre
Project description: Concerns are growing in the UK and in other European countries about the social and economic implications of recent unprecedented increases in the level and volatility of energy prices. This raises questions about how governments and other economic actors might mitigate these negative impacts over the short- and the long-term. This project will assess the impact of policy measures aimed at increasing consumers’ resilience to energy price volatility, including those specifically directed at vulnerable consumers. It will also consider whether more robust legal and institutional mechanisms are required to maintain the credibility of the energy regulation system
Contact: [email protected]
Institution: UCL
Project researchers: Eoghan McKenna, Ellen Zapata-Webborn, Jessica Few, Gesche Huebner, Martin Pullinger, Simon Elam, Clare Hanmer,
Funder / grant reference: Department of Energy Security and Net Zero (DESNZ)
Project description: The aim of this project is to produce insights and aggregated statistical data about GB household energy consumption trends drawing on analysis of smart metered electricity and gas consumption data provided by SERL Observatory participants, investigating how household energy consumption changes over time, and the possible causes of this change. This project will make these insights and data available to the Department for Energy Security and Net Zero to provide an evidence base for public policy decision-making.
Contact: [email protected]
Institution: UCL / Energy Systems Catapult
Project researchers: Clare Hanmer, Jessica Steinemann, Will Rowe, Martin Pullinger, Minnie Ashdown,
Funder: DESNZ
Project description:
Homes for Net Zero is a research programme aiming to improve the evidence base for DESNZ on the costs and energy savings for energy efficiency interventions in typical British homes. 1,000 homes will be recruited and monitored by the Energy Systems Catapult (ESC), with 200 of these receiving low cost, low disruption measures (draught proofing, loft insulation, heating efficiency improvements and advice). UCL will be analysing smart meter and temperature data to assess the impact of the interventions, and to compare the intervention group with the ‘control’ group which is monitored but does not receive interventions. The monitoring data will also include measurements indoor air quality. SERL Observatory data will be used to provide a comparison of energy demand for homes of similar characteristics to those in the HfNZ trial, but not receiving interventions.
Contact: [email protected]
Institution: UCL
Project researchers: Eoghan McKenna, Lin Zheng. Ellen Zapata-Webborn, Jessica Few, Martin Pullinger, Clare Hanmer, Minnie Ashdown, Simon Elam
Funder: EC Horizon Europe
Project description:
Energy poverty refers to the condition where a household is unable to afford to adequately heat their home. Energy poverty can severely impact the quality of life, health, and safety of individuals and is a problem that affects many households in UK. In 2023 almost 50% of households in England were in energy poverty according to one definition of the condition. This project aims to develop and test methods to identify whether a household is in or at risk of energy poverty using their smart meter data. The intended outcome of the project is improving the speed and ease of identifying households who are in or at risk
Contact: [email protected]
Institution: Nesta / UCL
Project researchers: Martin Pullinger, Sofia Pinto, Elizabeth Gallagher, Daniel Lewis
Funder: Nesta
Project description: This project will aim to identify archetypal energy usage patterns in UK households and contextual factors that are associated with particular patterns. This will help inform the development of new products, interventions and advice to enable households to reduce and shift their energy usage in an equitable way. Subject to our findings, this work may be extended to explore how these patterns have changed over time, perform simulations to estimate the impact of interventions and/or build models to predict usage patterns for households without smart meters.
Contact: [email protected]
Outputs: Using smart meters to identify energy-use profiles | Nesta
Lead institution: University College London
Project researchers: Kentaro Mayr, Paolo Agnolucci
Funder/grant reference: PhD project
Project description: The UK government implemented multiple policies of varying severity to ameliorate the impact of the COVID-19 pandemic. Many of these public health measures require households to significantly change their day-to-day behaviour, thus affecting their energy consumption patterns. This research project aims to investigate how these measures affected household electricity and gas consumption. Heterogeneity in the time of introduction of restrictions across regions can be exploited to identify the causal/treatment effect of each. Ultimately, this research aids policymakers and academics in understanding the contribution of each health measure on household energy consumption.
Contact: [email protected]
Institutions: UCL, Urbantide Ltd
Project researchers: Ellen Webborn, Eoghan McKenna, Simon Elam
Funder / grant reference: UKRI/Innovate UK: 97728 Supporting fuel poor households through data integration and AI
Further information: https://www.ukri.org/news/ukri-announces-net-zero-driven-energy-data-application-winners/
Contact: [email protected]
Institution: Imperial College London
Project researchers: Jacek Pawlak, Faghih Imani Ahmadreza, Aruna Sivakumar,
Funder/grant reference: EPSRC EP/R045518/1
Project description:
The IDLES programme aims to provide the evidence needed to facilitate a cost-effective and secure transition to a low-carbon future. It aims to create a modelling tool that can better coordinate the complex interactions within the energy domain and indicate optimal forms of future, integrated, energy systems to policy makers. It has the potential to enable large cost savings in providing decarbonised energy, to ensure security of supply and compliance with emissions targets. Energy consumption, exploitation of demand flexibility, stakeholder investment decisions, market design, incentivisation and policy objectives will all be considered in the programme’s analysis.
Project website: https://www.imperial.ac.uk/energy-futures-lab/idles/
Institution: University of Oxford
Project researcher: Philipp Grunewald
Funder / grant reference: EPSRC EP/M024652/1
Project description: Learning from changes in energy use patterns when adopting new technologies and practices can inform and accelerate the transition of net-zero living. This project learns from smart meter and contextual data about empirical changes in demand and seeks to develop models for feedback to reinforce and accelerate the uptake of best practice.
Proect website: https://www.energy-use.org/about.php
Contact: [email protected]
Institution: University of Edinburgh
Project researchers: Desen Kirli, Androniki Papathanasi
Funder: EPSRC
Project description:
This research project focuses on leveraging energy retrofit modelling to predict and optimise residential energy consumption, targeting decarbonisation and fuel poverty mitigation in Scotland. By integrating occupant behaviour dynamics, it aims to develop tailored solutions for energy-efficient renovations. The benefits include informed policymaking, reduced carbon emissions and alleviation of fuel poverty through targeted interventions. This interdisciplinary approach contributes to transitioning towards a sustainable, equitable and resilient energy future while addressing the pressing challenges of climate change and social inequality. To this extent, the proposed project will use the SERL dataset available on the UKDS platform to produce and analyse findings.
Contact: [email protected]
Institution: UCL
Project researchers: Yingying Ou, Mark Barrett, Tadj Oreszczyn
Funder: PhD project
Project description:
While heat pumps are crucial to the UK’s low-emission strategy, their adoption remains limited. This project is part of a PhD research, focusing on generating GB heat pump consumer archetypes, categorized by primary energy sources (main gas, main electricity, off-gas/electricity grid) and status regarding heat pump adoption (already switched or potential adopters). Clustering analysis will be used to develop profiles that include household socio-demographic characteristics, dwelling characteristics, and attitudes towards energy costs for both users and non-users of heat pumps. These profiles help simulate future energy demand and assist in developing policies to encourage adoption of heat pumps.
Contact: [email protected]
Project institution: UCL
Project Researcher: Jamal Russell Black
Funder: PhD project
Project description:
Energy poverty has significant repercussions on individuals’ physical and mental well-being. Over the years, efforts by the UK stakeholders have aimed to understand and alleviate energy poverty through diverse support programs and initiatives targeting building energy efficiency and energy bill subsidies. Current energy poverty scholarship primarily focuses on a financial objective definition, neglecting subjective-financial, environmental-objective, and environmental-subjective dimensions. This oversight potentially skews reported energy poverty levels in England. This research aims to rectify this gap in the literature by redefining energy poverty. It will update the metrics used to measure it and assess how this redefinition alters energy poverty statistics.
Contact: [email protected]
Institution: University of Nottingham
Project researcher: Samir Soares
Funder/ grant reference: Nottingham / EPSI
Project description:
The project aims to explore in some detail low/zero carbon heat and power systems for rural, off national gas grid homes. Exploring the technical feasibility of technologies such as biomass boilers, heat pumps, hybrid heat pumps, hydrogen boiler and fuel cells in further detail than is publicly available. UK government policy to decarbonise heat for such homes is to primarily use heat pumps, which requires preconditions of insulation and electric grid connections to make this work. These preconditions can make decarbonising a building economically or technically unfeasible. There is no one size fits all solution to this and this project will look at some of the other solutions to off gas grid rural heating.
Contact: Samir Soares
Outputs: SERL smart meter data of GB EPCs, Rural EPCs and rural archetypes
(n.b. the above dataset has been produced using the SERL dataset but is not processed and quality checked by the SERL research team.)
Institution: UCL
Project researchers: Alexander Mellers, Ellen Zapata-Webborn
Funder: PhD project / ERBE centre (EP/S021671/1)
Project description:
This project proposes the development of a methodology for disaggregating heat pump (HP) and electric vehicle (EV) data within the SERL dataset. Leveraging smart meter data and advanced techniques in Non-Intrusive Load Monitoring (NILM) and machine learning, the project aims to provide detailed insights into the energy consumption patterns of these devices in residential buildings. By analysing device-specific energy usage, the project seeks to inform energy management strategies and contribute to the decarbonization of the grid. Over a 4 year timeline, the project will undergo phases of data preprocessing, model development, validation, and result analysis, ultimately advancing research in energy disaggregation and sustainable energy practices.
Contact: [email protected]
Institution: UCL, Centre for Sustainable Energy
Project researchers: Charlotte Johnson, Sam Homan, Martin Pullinger
Funder/grant reference: National Grid Electricity System Operator (ESO)
Project description: The Smart and Fair research programme explores social justice in the future (smarter) energy system and aims to influence national policy and industry practice to ensure the UK’s low carbon energy transition is built on principles of fairness and equality. We are working with stakeholders across the sector, including government, industry, and non-profits, to ensure the research programme addresses current policy issues and provides policy-relevant tools and insights. We have a number of funded projects that sit within the research programme that are live at the moment. Accessing the SERL dataset will allow us to base our analysis on the most up-to-date, high quality, real-world energy consumption data. The SERL dataset is especially attractive for this research project due to the fact that it has linked granular energy consumption data with people/buildings survey data.
Outputs:
Consumer Building Blocks | National Energy System Operator –
Contact: [email protected]
Institutions: UCL, DNV
Project researchers: Martin Pullinger, Chris Bell, Simon Elam
Project description: This project aims to develop a smart meter leak detection system capable of identifying potentially dangerous household gas leaks and further the evidence base regarding the safety of hydrogen as an energy vector. On average, there are 31 gas explosions in UK homes every year – causing at least 13 fatalities in the last 5 years. Developing a detection system based on already-collected smart meter data could reduce the impact of gas leaks without the cost of installing new systems. Increasing the safety of the gas network would help support a transition to a hydrogen network and towards the goal of Net Zero.
Contact: [email protected]
Institution: Imperial College London
Project researchers: Shefali Khanna, Mirabelle Muuls, Ralf Martin
Funder / grant reference: EPSRC EP/R045518/1
Project description: This project will use half-hourly energy consumption data from smart meter users in the UK to assess how residential electricity and gas usage responds to weather shocks. The analysis will compare the responsiveness of electricity and gas usage across households located within a Government Office Region. Using household survey and EPC data, we will study the factors that drive greater responsiveness to weather changes. Mapping this baseline potential for load shifting will help policymakers and regulators efficiently target policies that incentivise households to shift their electricity consumption to the hours when the grid is the least carbon intensive and switch from using gas to electricity for cooking and heating. Finally, we will examine how product attributes such as cost and energy efficiency as well as household and housing-unit characteristics predict adoption and usage of large electric appliances and heating systems. Our empirical estimates will be used to parameterize engineering models that simulate the energy system under alternative climate policy scenarios.
Contact: [email protected]
Institution: University College London
Project researchers: Paolo Agnolucci, Chrysanthi Rapti, Hamid Nejadghorban, Abraham Lartey, Kentaro Mayr, Simon Elam, Eoghan McKenna, Ellen Webborn, Frances Hollick.
Funder / grant reference: Department for Business, Energy and Industrial Strategy (BEIS)
Project description: The Green Homes Grant (GHG) is a £2bn UK Government scheme to fund and target the delivery of energy efficiency measures and low carbon heating for homes in England with the aim of delivering a green recovery from COVID-19 which will facilitate the transition to net zero emissions by 2050. The GHG schemes include the Green Homes Grant Vouchers (GHGVS), Green Homes Grant Local Authority Delivery (GHG-LAD), and the Social House Decarbonisation Fund Demonstrator Schemes (SHDF(D)).
UCL has been appointed by the Department of Business, Energy, and Industrial Strategy to scope the cross-cutting evaluation of GHG schemes and provide early insights into their impact as well as estimate the impact of the GHGVS on energy consumption.
Institution: University of Birmingham
Project researchers: Grant Wilson, Joseph Day
Funder / grant reference: Innovate UK: Regional Energy Systems Operator
Project description: The aim of the Regional Energy Systems Operator project is to provide a detailed design for the city of Coventry’s energy system to help meet its decarbonisation targets. It is one of ten detailed design studies funded under Innovate UK’s Prospering from the Energy Revolution. The design’s target year is 2032, and considers the mix of technologies, required infrastructure and also the governance structures of achieving this.
The Work Package from the University of Birmingham titled ‘Data Foundations’ provides cross-cutting support to the wider project on data including a more detailed understanding of existing and future energy flows in Coventry.
Further information: https://www.coventry.gov.uk/home-energy-warmth/reso
SERL Research Consortium projects
Projects carried out by SERL Consortium partner institutions as part of the original SERL EPSRC award.
- DEDEUS: Describing and Explaining Domestic Energy Use in Scotland (University of Edinburgh)
- Domestic Operational Rating (DOR): Development, Programming and Testing (Loughborough University)
- Identifying wintertime comfort in UK homes (Leeds Beckett University)
- SERL Annual Report project (University College London)
- Social Housing Research on Energy from Welsh Data (SHREWD) (Cardiff University)
- The short and long-term impact of COVID-19 on building energy demand and future decarbonisation (UCL/CREDS)
- Understanding domestic building thermal efficiency with smart meter data (University College London)
- Understanding habitual energy consumption (University of Southampton)
SENS project – these trials were carried out as part of the Department for Business, Energy and Industrial Strategy (BEIS) Smart Energy Savings (SENS) competition which used the SERL portal to provide energy data to help evaluate the various trials.