UK jobs. Bigger possibilities.

Data Engineer

On-site in Llys Cadwyn Pontypridd·Added yesterday (last checked 18 Nov)

Our summary

Work mode
On-site, Llys Cadwyn Pontypridd
Contract
Fixed-term

Skills

Requirements

Languages

While not essential for this role, Welsh language skills would make a great addition to your application.

TfW support anyone who wants to learn Welsh or improve their skills. We offer online learning, classroom courses and funding attendance at local community courses.

The role

The Data Engineer will develop, maintain, and support robust, scalable, and secure data pipelines and platforms that enable Transport for Wales (TfW) to make data-driven decisions.

What you'll do

  • Develop, maintain, and support a resilient and scalable data platform by building and deploying well-governed data pipelines using Microsoft Azure technologies including Microsoft Fabric, Data Factory, and Synapse Analytics to enable organisational growth, support cross-functional analytics, and facilitate data-driven decision-making.
  • Implement data management practices focused on data quality, lineage, and domain ownership by integrating data from multiple internal and external sources and applying appropriate governance controls to ensure data is accurate, consistent, traceable, and trusted for business analysis and reporting.
  • Develop, maintain, and optimise physical data models by aligning data structures with pipeline architecture and applying effective data modelling techniques to support scalable storage, efficient processing, and evolving analytical, business, and operational requirements.
  • Transform raw data into meaningful and usable datasets by developing, maintaining, and optimising ETL processes that cleanse, validate, and structure data to support business reporting, analytics, and informed decision-making.
  • Apply data engineering and cloud governance standards by developing solutions that comply with security, privacy, regulatory, and GDPR requirements and adhere to established frameworks and best practices to ensure organisational data is managed securely, responsibly, and compliantly.
  • Collaborate with data analysts, architects, DevOps teams, and business stakeholders by maintaining effective communication and working relationships throughout the development lifecycle to ensure data solutions meet business requirements and user needs.
  • Monitor, troubleshoot, and optimise the performance of data systems by identifying issues, supporting system availability, and implementing performance improvements to ensure reliable, efficient, and continuous access to organisational data.
  • Contribute to the delivery of the Data Strategy by maintaining accurate and up-to-date documentation of data processes, architectures, and workflows to support effective knowledge sharing, governance, value for money, and continuous improvement.
  • Optimise the performance, utilisation and cost-efficiency of cloud data platforms by proactively monitoring resource consumption, capacity, performance and expenditure, applying FinOps principles to identify optimisation opportunities, manage costs, minimise waste and ensure cloud resources deliver value for money.

The Role

Please note: this is a fixed-term contract until 31/03/2028

Who we're looking for

  • Degree or MSc in Computer/Data Science or Data Engineering or equivalent experience in data engineering, data management, or a related field.
  • Experience in designing, building, and maintaining data pipelines using tools such as Azure Data Factory, or Apache Spark, following modern ETL/ELT principles.
  • Experience of using programming languages such as Python, Scala and SQL and of data transformation, testing, and automation.
  • Knowledge of data modelling (star/snowflake schemas, dimensional models) and experience of data warehousing using technologies such as Microsoft Fabric SQL Warehouse, Azure Synapse Analytics and Oracle.
  • Practical experience with Microsoft data technologies, such as Fabric, Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud-based architectures.
  • Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery.
  • Robust understanding of data governance, data quality, and metadata management, aligned to DDaT and UK Government Data Standards.

Next steps

See attached Job Description for further details and how to apply. If you want to find out more about what we're doing in Wales, see our Annual Report.

We're a Disability Confident Leader. Let us know about any reasonable adjustments you may need in the recruitment process and as part of the role if you are successful.

This advert will close at 23:59 on the day of the application closing date stated above. However, we reserve the right to close this vacancy early if we receive enough applications. We encourage you to submit your application as early as possible.

About Transport for Wales

Industry
Transport

In their own words

About the company & team

Transport for Wales is changing the way Wales travels, making sustainable transport the first choice. We're building a multimodal integrated transport network called the T Network, making it easier for people to travel by train, bus, walking, wheeling and cycling.

Additional information

We're changing the way the transport industry looks. By celebrating and embracing differences, we're building a workforce that represents Wales. We need talented people from all backgrounds and cultures to bring their perspectives and experiences. Diverse teams make better decisions and drive innovation. Join us in transforming the way Wales travels."

All open roles at Transport for Wales
WhatsApp