Back to list

Vacancy description

Lead Data Engineer - AWS / AI / SQL in Manchester, United Kingdom

Adria Solutions Ltd

  • HybridMix of office and remote

£70k - £90k per annum

Manchester, United Kingdom

Salary: £70,000 - 90,000 per year Requirements:

  • We are looking for an experienced Data Engineer who has built and operated complete data platforms rather than solely delivering individual components.
  • Experience across batch data processing, ELT and orchestration.
  • Experience with modern streaming technologies such as Flink or comparable platforms.
  • Experience with AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS.
  • Experience with infrastructure as code using Terraform.
  • Experience with CI/CD and automated testing.
  • Experience with lakehouse architecture and open table formats such as Iceberg.
  • Experience with medallion architecture and dimensional data modelling.
  • Strong SQL and Python skills.
  • Experience with SQL Server, SSIS/SSDT and Power BI.
  • Experience with semantic layers, common metrics and data glossaries.
  • Experience with data governance, lineage, retention, classification and auditability.
  • Experience managing and developing a small technical team.
  • Comfortable using advanced AI coding assistants, such as Claude Code or equivalent tools, to improve engineering productivity while maintaining high standards of quality, governance and security.
  • Desirable experience in a regulated environment.
  • Desirable experience with PySpark for large-scale data transformations.
  • Desirable experience migrating legacy data estates to lakehouse or metadata-driven architectures.
  • Desirable experience with Customer Data Platforms or event-driven systems.
  • Desirable experience with data-quality tools such as dbt tests or Great Expectations.
  • Desirable experience with MCP servers or governed natural-language data interfaces.
  • Desirable experience with financial crime, fraud or regulatory-reporting data.
  • Desirable experience with Power BI administration and semantic modelling.
Responsibilities:
  • Own the reliability, security and ongoing development of the data platform.
  • Modernise the existing SQL Server, SSIS/SSDT and Power BI environment.
  • Develop scalable batch and real-time data-processing solutions.
  • Lead the design of a Customer Data Platform.
  • Build and evolve a lakehouse architecture using AWS technologies.
  • Create governed semantic models, consistent metrics and clear data definitions.
  • Enable secure, self-service data analysis using modern AI tooling.
  • Automate manual, repetitive or fragile data processes.
  • Support BI, Data Science, Machine Learning and Applied AI teams.
  • Take ownership of data governance, security, monitoring and platform costs.
  • Line-manage, develop and help grow the Data Engineering team.
  • Work closely with technical, operational and senior business stakeholders.
Technologies:
  • AI
  • AWS
  • Lambda
  • Business Intelligence
  • CI/CD
  • Claude Code
  • Flink
  • Support
  • Machine Learning
  • MCP
  • Power BI
  • Python
  • PySpark
  • SQL
  • Security
  • SSIS
  • Terraform
  • dbt
  • Cloud

More:

We are an established organisation offering a hands-on Lead Data Engineer opportunity in Manchester on a hybrid working pattern, with a salary circa £85K. This is an influential role where we want someone to take ownership of our existing data estate and lead the development of a modern, scalable data platform. You will help build a platform supporting Business Intelligence, Data Science and Applied AI, introduce modern batch and real-time data-processing capabilities, automate inefficient processes and make trusted data more accessible across the organisation. Alongside remaining technically hands-on, you will manage and develop a small team of Data Engineers, with the scope to shape how data and AI are used across the organisation.

last updated 40 week of 2026

Apply to vacancy

Similar vacancies

More like this role

Lynx Recruitment Limited

AWS Data Engineer

  • Hybrid
  • On-site

£60k per annum

... Agentic AI - AI - AWS - Lambda - Cloud - Databricks - ETL - Git - Python - SQL - Terraform - dbt More: Were growing our team in London and work on high-impact data projects for well-known UK brands. Youll work across a variety of projects and explore how Agentic AI is transforming data engineering. The role is hybrid, with ...

Charing, United Kingdom

CGI

Data Engineer (Databricks and AWS) (IT)

  • Hybrid
... delivery. You must have: ? Hands-on commercial expertise with Databricks. You should have: - Proven experience as a Data Engineer working with large, complex datasets. - Hands-on expertise with Apache Spark, and SQL. - Strong proficiency in Python (PySpark preferred). - Experience with AWS cloud services including S3, Glue, ...

Leeds, United Kingdom

Permutable

Senior Data Platform Engineer - Python & AWS

  • Remote
  • Hybrid
  • On-site
  • Full-time
  • Contract
  • DevOps
... build, test and maintain substantial Python services and data pipelines. Strong AWS experience: Hands-on experience building and operating production systems on AWS, including services such as S3, RDS/PostgreSQL, Lambda, ECS or EKS. Experience building data platforms: A substantial track record in data platform engineering, ...

London, United Kingdom

CreateFuture

Lead Cloud Platform Engineer (AWS)

  • Remote
  • Hybrid
  • On-site
  • Full-time
  • DevOps
... looking for a hands-on Lead engineer embedded in the client's platform team, responsible for the reliability, scalability, and evolution of their infrastructure on AWS. The right candidate is comfortable working autonomously in a mature, opinionated stack and can influence without authority across engineering teams. This role ...

United Kingdom

Datatech

Lead Data Engineer

  • Full-time

£80k - £90k per annum

Company: DATATECH Job Type: Permanent, Full Time Salary: £80000 - £90000/annum [{"name": "permanent_employment", "text": "Permanent", "categoryName": "Type of employment"}]

London, United Kingdom

Howden

Lead Data Engineer

  • Hybrid
  • On-site
  • Full-time
... balance, career progression, sustainability, volunteering – you’ll find like-minded people driving change at Howden. Lead Data Engineer Position Senior Data Engineer to lead and drive forward complex and high-impact data initiatives. Summary of the Role Howden Group Services is expanding its internal data engineering capability ...

London, United Kingdom

Tenth Revolution Group

Lead Data Engineer

  • Remote

£110k per annum

Lead Data Engineer Remote UK - £110,000 + Share Options + Private Medical Insurance A high-growth, venture-backed AI technology company is looking for a Lead Data Engineer to play a pivotal role in shaping the future of its data, analytics and AI capabilities. This is an opportunity to join an innovative organisation delivering ...

Bampton, United Kingdom

Trust In SODA

Lead Data Engineer

  • Full-time
  • Contract

£33 GBP

... a Lead Data Engineer to build and lead the data infrastructure powering LightWork AI’s platform. This role will architect and scale the systems that power our AI products — from real-time data pipelines and analytics infrastructure to vector databases and machine learning data workflows. You will work closely with AI engineers, ...

London, United Kingdom

PlayStation Global

Lead Data Engineer

  • Remote
  • Hybrid
  • On-site
... collaboration sessions and business activities where in-person engagement is beneficial. Role Overview: As a Lead Data Engineer, you’ll work in our cross-disciplinary Data Platform team to ingest and process high-volume data. You’ll work closely with our Game Analytics analysts and analytics engineers, who use this data to gain ...

London, United Kingdom

LiveScore Group

Lead Data Engineer

  • Hybrid
  • On-site
... their growth in coding, data modeling, and general data engineering best practices. - Hands-On Contribution: Maintain a significant hands-on role in coding, data modeling, infrastructure-as-code development, and platform configuration, leading by example and ensuring high-quality output. - Data Quality and Performance ...

London, United Kingdom

Scott Logic

Lead Data Engineer

  • Remote
  • Hybrid
  • On-site
... their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that ...

Newcastle, United Kingdom