Data Engineer (G7)


Company:	Government Recruitment Service
Salary:	£57,946 to £75,664 a year
Hours:	Full-time
Location:	M2 3LR
Job type:	Permanent
Posting date:	16 Oct 2026
Closing date:	1 Nov 2026

Apply for this job

Summary

Please note this role requires you to pass Security Check clearance. For further information, please see 'Selection process details'.

You must have resided continuously in the UK for at least 3 of the last 5 years, 2 of which must have been the immediately preceding years from the point of applying for this job.

Are you a Senior Data Engineer with expert-level experience in Azure data engineering, ETL/ELT pipeline design and technical team leadership?

Join DWP as part of our Data Engineering community, where you will lead the design and delivery of secure, scalable data solutions that power services used by millions of people across the UK. This role plays a key part in ensuring our data estate is reliable, well-governed and continuously improving, enabling analysts, data scientists and operational teams to access trusted data at scale.

Roles and Responsibilities:

Lead the team in designing, developing and maintaining scalable ETL/ELT pipelines using a strong knowledge of PySpark and Python to ensure best practice and standards are met in optimizing, validating and standardising all team data workflows as well as batch processes.
Lead collection of complex data requirements from a wide range of stakeholders, interpret the data and shape data sets to for Data Analysts to fulfil requirements in their creation of analysis and insight dashboards.
Lead the build and management as well as the supply of data to multiple systems and applications including database management. This to secure data availability and the construction of efficient scripts to extract data for cross business usage.
Leading immediate team though large-scale data and platform transformation and/or migration programmes, ensuring best practice and building capability within the team as the transformation occurs. Set direction of change and proactively identify key issues.
Apply a deep understanding and experience of cloud data engineering toolsets in developing complex pipelines, lead development of products and automation processes. Lead development of logging, monitoring and assuring tool performance information.
Oversee, support and manage team in developing and using a range of operational tracking and cataloguing tools to track data and metadata through its journey such as: Google Cloud Data Catalog, AWS Glue Data Catalog, Azure Data Catalog, Informatica Enterprise Data Catalog, Alation, Apache Atlas etc. Ensuring compliance with business standards.
Lead the use of Agile practices in the team to leverage data engineering tools like version control, automation, monitoring to streamline data pipelines, automate testing, deployment and track changes.

Skills England is an executive agency of the Department for Work and Pensions (DWP), working with employers, training providers, local partners and government to create better skills for better jobs. We play a leading role in identifying current and future skills needs across the economy, helping to ensure that people can access high-quality education, training and employment opportunities while supporting businesses to develop the skilled workforce they need. As part of the Digital and Data Services team you will play a key role in ensuring Skills England creates, maintains and uses data efficiently and effectively to drive decisions and produce high quality technical education products and labour market insights.

Locations for this team are: London, Coventry, Darlington, Sheffield, Leeds. Roles within other teams will be based in the locations advertised above. This can be discussed further, should you be successful.

Apply for this job

Proud member of the Disability Confident employer scheme

About Disability Confident

Disability Confident is a government scheme. It encourages employers to recruit and retain disabled people and those with long term health conditions.