UK jobs. Bigger possibilities.

Lead Data Engineer (Databricks)

Hybrid in Warrington·Added 3 days ago (last checked 9 Oct)

Overview

Job details

  • Permanent contract

    Per the ad.

  • Hybrid

    Office and home days — the ad has the split.

Requirements

  • Be near Warrington for hybrid days

    No relocation package mentioned.

  • Have 5+ years of experience

    Lead-level role.

Skills

Nice to have

Requirements

What we're looking for

  • Deep expertise in Databricks (Spark / PySpark, Delta Lake, Unity Catalog, Workflows)
  • Strong experience building ETL/ELT pipelines, both batch and streaming
  • Advanced Python and SQL skills
  • Hands-on experience with cloud platforms (Azure, AWS or GCP)
  • Solid understanding of data modelling and modern architectures
  • Strong knowledge of data governance, security and compliance

Nice to have

  • Experience with orchestration tools such as Airflow
  • Familiarity with CI/CD pipelines, Git workflows and automated testing
  • Exposure to real-time, IoT or environmental telemetry data

Education & certifications

  • Bachelor's degree in Computer Science, Data Engineering or a related discipline
  • 5+ years' experience in data engineering roles, including 3+ years with Databricks

Proven ability to lead technically and mentor engineers

Pay & benefits

What you'll get

We believe in rewarding our people properly:

  • Up to 10.5% annual bonus
  • Outstanding pension - up to 21% combined contribution
  • Private healthcare
  • Share buy scheme
  • Wellbeing benefits and support programmes

The role

As the Lead Data Engineer on our River Water Quality Programme, you'll design, build, and optimise Databricks-based data pipelines that enable timely, reliable and well-governed data across the organisation.

You'll:

What you'll do

  • Design and develop scalable batch and streaming data pipelines using Databricks, Spark and Delta Lake
  • Implement medallion architecture (bronze/silver/gold) to ensure data quality, lineage and efficient consumption
  • Optimise Spark jobs and workflows to meet near real-time monitoring SLAs
  • Build and maintain streaming pipelines using Structured Streaming and Delta Live Tables
  • Ensure strong data governance, including schema enforcement, validation rules and ACID compliance
  • Orchestrate and automate pipelines using Databricks Jobs, APIs or cloud-native schedulers
  • Collaborate with data scientists, analysts and environmental specialists to deliver high-quality, well-documented datasets
  • Monitor, troubleshoot and continuously improve production pipelines for reliability, performance and cost efficiency
  • Champion best practices across CI/CD, testing, version control and documentation

Act as a technical leader and mentor, raising standards across the data engineering community

Hiring process

United Utilities' recruitment process has several stages, with the team updating you at each one; some roles include online multiple-choice tests (with practice tests offered first), and interviews may be in person or virtual

  • Candidates can track application status online at any time, and most correspondence is by email.
  • AI tools may help with grammar or preparation, but application content, interview answers and technical assessments (unless AI is explicitly permitted) must reflect the candidate's own work.
  • Reasonable adjustments during the application or interview process are available on request.

About United Utilities

Industry
Utilities

In their own words

About the company & team

River Water Quality Programme
Warrington (Hybrid - 3 days onsite per week)

At United Utilities, we're committed to protecting the environment that millions of people depend on every day. As part of our Digital Services team, you'll play a pivotal role in one of our most important and high-impact initiatives: near real time monitoring of river water quality.

We're looking for a Lead Data Engineer to take technical ownership of modern, scalable data platforms that turn complex environmental and telemetry data into trusted insights for regulators, scientists, and operational teams.

Additional information

You'll be working on data that truly matters - protecting rivers, supporting environmental compliance, and helping shape the future of sustainable water management across the North West.

If you're passionate about modern data engineering, enjoy technical leadership, and want your work to have real-world environmental impact, we'd love to hear from you.

All open roles at United Utilities

Junior Project Manager Intern

United Utilities5d ago
From £26k a yearWarrington

Regional Grounds Maintenance Operative

United Utilities5d ago4 locations
£29.1k a yearPenrith

Environmental Graduate

United Utilities5d ago
From £32.3k a yearWarrington
From £32.3k a yearHybrid in Warrington

Assistant Property Surveyor

United Utilities3d ago
Warrington
Warrington

Business Improvement Partner

United Utilities3d ago
Hybrid in Warrington
See all 90 jobs