Senior Data Engineer

Software engineering

London

• That if a job is worth doing, it's worth doing properly
• That work should be fulfilling but can also be fun
• That kindness matters and should be extended to employees and clients alike
• That by being trusting and trustworthy as an organisation and as individuals we can dispense with tedious bureaucracy and rules

• Lead the data architecture and modelling for Moorfields Eye Hospital's INSIGHT programme, defining standards and guiding the team to support pioneering ophthalmic research
• Own the technical strategy for data pipelines, cloud infrastructure, and dashboards on Elexon's Azure platform, driving reliability and performance at the heart of Britain's electricity market
• Define the end-to-end solution design for a financial services company migrating legacy Excel workflows into a modern cloud-native scheduler, accountable for technical risk and stakeholder sign-off
• Lead data modelling and advisory work for a civil service department replacing a legacy HR system, acting as the senior technical voice in client engagements
• Architect and lead the delivery of an AI transcription service for the BBC using GenAI, shaping both the technical approach and team execution

Technical

• You have 5+ years' experience in a data engineering, software engineering or similar relevant context, with a demonstrable track record of delivering at senior or lead level
• You have strong hands-on experience across several of our core technologies, including Python, PySpark, SQL, Databricks, Snowflake, Fabric, and major cloud platforms (AWS/Azure/GCP), and can credibly advise clients on technology choices
• You are experienced with software development best practice (DRY, YAGNI, SOLID, CI/CD, automated testing)
• You bring deep pattern recognition from prior projects and can rapidly assess unfamiliar tech stacks, client environments, and sectors, getting to grips quickly and providing sound technical guidance from the outset
• You have a deep understanding of data engineering best practice, including data modelling, pipeline design, data governance, data infrastructure & security, testing, and observability, and are confident setting standards and making architectural decisions on complex, ambiguous projects

People skills

• You are an exceptional communicator, able to translate complex technical concepts for senior stakeholders, build trust with clients at all levels, and represent Softwire with credibility and confidence
• You are outcome-focused and have a strong track record of driving delivery across complex, multi-team engagements, holding yourself and others to high standards to ensure genuinely high-impact results for clients
• You actively shape the technical direction of your team, leading on architecture, data modelling, technical design, and client interactions and take genuine ownership of the growth and performance of more junior engineers

• You are deeply passionate about leveraging technology to deliver outstanding outcomes for clients and end users, and you stay current with the data and AI landscape to bring fresh thinking to every engagement
• You set a high bar for technical quality and delivery rigour not just in your own work, but in the standards you embed across the team and the practices you champion with clients
• You drive meaningful improvements in your clients' technical maturity, bringing a strategic, advisory mindset that balances long-term engineering ambition with pragmatic business realities
• You are a natural collaborator who energises those around you creating an environment where engineers do their best work and feel challenged, supported, and invested in shared success
• You bring a solutions-first mindset to cross-functional collaboration working with developers, product owners, and architects to shape technically excellent, commercially astute solutions that genuinely meet client needs
• You thrive in ambiguous, fast-paced environments able to bring structure and clarity to complex problems and provide a steady, authoritative technical hand when it matters most

• Base salary from £58,100- £76,100 depending on your background and how many years of relevant experience you have
• You can expect to receive a profit share depending on your experience and company performance. Over the last four years, this ranged between £5,750- £11,250
• Pension: Additional 5% of salary

Additional benefits

• 25 days annual leave (with the option to buy and sell)
• Flexible work options (e.g. working from home 2dpw; 4-day working contract)
• Time off for company-wide morale activities, time off for charitable / CSR activities
• Income protection, cycle to work, electric vehicle lease schemes, and payroll charity donations