Back to list

Vacancy description

Databricks Data Engineer in London, United Kingdom

Exl

  • HybridMix of office and remote
  • On-siteWork from the office
  • Full-timeStandard weekly hours

London, United Kingdom

EXL (NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute complex operations for the world’s leading corporations.

EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others.

Headquartered in New York, our team is over 60,000 strong, with more than 50 offices spanning six continents. For information, visit

Role Title: Databricks Data Engineer

BU/Segment:  Analytics / Data Management

Location: Leeds, United Kingdom (Hybrid, 1-2 days in the office)

Employment Type:  Permanent to start ASAP

Summary of the role

We’re looking for a highly skilled Azure Databricks Data Engineer to design, develop and deliver cloud-based data integration and analytics solutions within our Retail portfolio .

You’ll work across data engineering, modelling and transformation initiatives, building scalable pipelines, optimising performance and ensuring best practices in data quality and governance. This is a hands-on technical role requiring strong Azure and Databricks experience, coupled with a solid understanding of Retail data and business processes .

As part of this role, you’ll have the opportunity to work on high-impact Retail data transformation programmes , collaborating with experienced data professionals in a forward-thinking, innovative environment. You’ll gain exposure to cutting-edge Azure and Databricks technologies .

As part of your duties, you will be responsible for:

  • Design, build and deploy scalable data pipelines using Azure Databricks , Azure Data Factory and Azure SQL Database .
  • Optimise Databricks environments for performance, cost and security.
  • Develop and maintain data integration , ETL/ELT processes and data quality frameworks.
  • Translate retail business requirements into data models, ensuring consistency and accuracy across data layers.
  • Partner with business and technology stakeholders to deliver effective data solutions, analytics and insights that support retail operations and decision-making.
  • Create technical documentation including data flow diagrams, architecture designs and test plans.
  • Support the delivery of Retail data transformation initiatives, ensuring adherence to data governance and best practice standards.
  • Stay current with emerging data engineering and Azure ecosystem technologies to drive continuous improvement.

Qualifications and experience we consider to be essential for the role:

  • Retail industry experience is essential, with a strong understanding of retail data domains, including customer, product, sales, inventory and supply chain data.

  • Minimum of 5 years' management experience required, leading technical delivery or overseeing project teams within data engineering or integration environments.

  • 8-10 years' experience in data engineering and integration, ideally in enterprise-scale environments.

  • Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake.

  • Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration.

  • Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts.

  • Experience working with large, complex retail datasets and distributed computing environments.

  • Proficiency in SQL, version control (e.g. Git) and CI/CD pipelines.

  • Familiarity with Agile delivery and DevOps practices (Azure DevOps, JIRA, etc.).

  • Preferred Skills & Experience:

  • Knowledge of EDM (Enterprise Data Management) practices, data governance, metadata management and lineage tools.
  • Exposure to multi-cloud environments ( AWS or GCP ).
  • Understanding of modern data architecture methodologies (Dimensional, ODS, Data Vault) and real-time cloud data capabilities.
  • Experience supporting data-driven decision-making across retail functions, including merchandising, customer analytics, supply chain and omnichannel operations.

As part of a leading global analytics and digital solutions company, you can look forward to:

  • A competitive salary with a generous bonus, private healthcare, critical illness life assurance at 4 x your annual salary, income protection insurance, and a rewarding pension.
  • EXL provides everyday financial well-being solutions, such as cash back cards, in which you can earn cashback while enjoying discounts, promotions, and offers from top retailers. We also offer a Cycle Scheme where you can save money on bikes and cycling accessories.
  • At EXL , we are committed to providing our employees with the tools and resources they need to succeed and excel in their careers. We offer a wide range of professional and personal development opportunities. We also support a range of learning initiatives that allow our employees to build on their existing skills and knowledge. From online courses to seminars and workshops, our employees have the opportunity to enhance their skills and stay up to date with the latest trends and technologies.
  • As an Equal Opportunity Employer, EXL is committed to diversity. Our company does not discriminate based on race, religion, colour, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, age, or disability status.
  • EXL employees are eligible to purchase stock as part of our Employee Stock Purchase Plan (ESPP).
  • At EXL , we offer a flexible hybrid working model that allows employees to live a balanced, healthy lifestyle while strengthening our culture of collaboration.

To be considered for this role, you must already be eligible to work in the United Kingdom.

Similar vacancies

More like this role

Syntax Consultancy Ltd

Data Engineer (Databricks)

  • Remote
  • Hybrid
  • On-site
  • Full-time
  • Contract
... Databricks - Git - GitLab - Hive - IAM - Support - Jenkins - Linux - Python - PySpark - SQL - Spark - Terraform - UX UI Design - Cloud More: We are seeking a Data Engineer for a large-scale government project as part of a global IT transformation. This is a six-month contract based in Leeds, with a hybrid working model: ...

Leeds, United Kingdom

  • Hybrid
  • On-site
  • Full-time
  • Marketing

£55k - £67k per annum

... ownership of data solutions that directly influence customer acquisition, sales and operational performance. A financial services business is seeking a Staff BI & Data Engineer with strong, hands-on Azure Databricks, Unity Catalog and Power BI experience, combined with an understanding of how data supports commercial and operational ...

United Kingdom

  • AI / ML
... Science, Information Systems, Data Engineering, Software Engineering, or a related field - Databricks Data Engineer Associate certification or higher preferred - Databricks Generative AI Engineer Associate certification preferred Responsibilities Design, build, and support scalable data, analytics, and artificial intelligence ...

London, United Kingdom

Syntax Consultancy Ltd

Data Engineer

  • Remote
  • Hybrid
  • On-site
  • Full-time

£60k - £65k per annum

... run and maintain production data pipelines on Databricks and AWS. - Youll keep scheduled data processing reliable, resolve incidents, apply fixes, and improve data service performance. - Youll provide a combination of L2/L3 production support and data engineering. - Youll support and maintain production data pipelines, including ...

Leeds, United Kingdom

Two Circles

Data Engineer

  • On-site
  • Full-time
... people, based out of 15 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world. We're looking for a Data Engineer with strong, hands-on Databricks expertise to join our squad of >50 Data & BI Engineers, working on our Fan Intelligence Platform. Databricks is a core ...

London, United Kingdom

Jackson Hogg Ltd

Senior Data Engineer

  • Full-time

£55k - £65k per annum

... similar programming language - Data engineering or data integration experience - Understanding of data modelling and ETL/ELT concepts - Experience implementing data validation and testing processes - Strong communication and stakeholder engagement skills - Familiarity with Azure Data Factory, Databricks, Synapse Analytics, ...

Sunderland, United Kingdom

REPERIO HUMAN CAPITAL

Senior Data Engineer

  • Hybrid
  • Contract
... experience as a Senior or Lead Data Engineer, with strong hands-on data modelling expertise - Proficiency in SQL and Python - Proficiency with a modern cloud data platform such as Microsoft Fabric, Azure, Databricks or Snowflake - Experience setting architecture and standards for pipeline engineering and data modelling ...

United Kingdom

REPERIO HUMAN CAPITAL

Senior Data Analytics Engineer

  • Hybrid
  • Contract
  • Data Analytics
Salary: £? - ? per year Requirements: - Previous experience in a data engineering role - Proficiency in Python, SQL, and .NET/C# - Strong understanding of database design for transactional (OLTP) and analytical (OLAP) systems - Proficiency with Azure Databricks and PySpark is desirable - Previous experience building and ...

United Kingdom

Oxford Quantum Circuits

Data Engineer

  • Hybrid
  • On-site
  • Full-time

£260 GBP

... evaluation and synthetic-data use cases across cloud, on-premise and datacentre environments. The Role Based in London and working closely with our Platform Engineering team, you'll own data pipelines from ingestion through transformation, governance and consumption. You'll work with technologies including Databricks, Spark ...

London, United Kingdom

General Atlantic

Data Engineer

  • Contract

$126 USD

... initiatives migrating legacy data processes to cloud-native solutions Self-Service Data Platform - Help prepare curated datasets for use in data lakes, enterprise data hubs, and data warehouses - Work with senior engineers to support scalable, performant data storage and compute solutions using Databricks and cloud data services ...

London, United Kingdom

£120k per annum

... Associate level Engineer Technology The environment is centred around a modern Microsoft/Azure data stack, including: Python | SQL | Azure | Databricks | Azure Data Lake Storage | Microsoft Foundry | Microsoft Fabric | Delta Lake | GitHub | Terraform What We're Looking For - Around 3–7 years of professional engineering experience ...

London, United Kingdom