Data Engineer (Databricks) in Leeds, United Kingdom
Syntax Consultancy Ltd
RemoteWork from anywhere
HybridMix of office and remote
On-siteWork from the office
Full-timeStandard weekly hours
ContractFixed-term or freelance
Leeds, United Kingdom
Salary: £? - ? per year Requirements:
Strong hands-on experience with Databricks, PySpark, AWS, SQL, and Python.
Databricks experience with notebooks, scheduled jobs, cluster configuration, driver and executor logs, Spark UI, and performance troubleshooting.
Experience with Spark SQL, Delta Lake, Parquet, and Hive metastore tables, including schemas, partitions, and the relationship between table metadata and underlying files.
Hands-on AWS experience, particularly with S3, IAM, and CloudWatch; understanding of role-based access, KMS encryption, and diagnosing data access failures.
Working knowledge of Git, code reviews, CI/CD, and controlled production deployments, including testing, rollback, and release validation.
Advantageous: experience with AWS Glue, Lambda, Step Functions, Linux, shell scripts, Terraform, GitLab, or Jenkins.
Responsibilities:
Run and maintain production data pipelines on Databricks and AWS.
Keep scheduled data processing reliable by resolving incidents, applying fixes, and improving data services performance.
Support and maintain production data pipelines, including incident investigation, safe recovery, root cause analysis, and permanent remediation.
Own incidents from investigation through recovery and closure; diagnose issues across Python, PySpark, SQL, Databricks jobs, and AWS integrations.
Provide clear progress updates and escalate issues in a timely manner.
Technologies:
AWS
AWS Glue
Lambda
CI/CD
CloudWatch
Databricks
Git
GitLab
Hive
IAM
Support
Jenkins
Linux
Python
PySpark
SQL
Spark
Terraform
UX UI Design
Cloud
More:
We are seeking a Data Engineer for a large-scale government project as part of a global IT transformation. This is a six-month contract based in Leeds, with a hybrid working model: primarily working from home, with travel to our Leeds office one to two days per month. The role combines L2/L3 production support with data engineering work and is due to start as soon as possible in October 2026. The rate is listed as £ per day, Inside IR35.
... ownership of data solutions that directly influence customer acquisition, sales and operational performance. A financial services business is seeking a Staff BI & Data Engineer with strong, hands-on Azure Databricks, Unity Catalog and Power BI experience, combined with an understanding of how data supports commercial and operational ...
We're looking for a Senior Data Engineer – Tech Lead (Databricks, PySpark) to join our team in London, UK, in a hybrid working mode. In this role, you will lead the design, development and optimization of scalable cloud-native data architectures, focusing on Azure Databricks, PySpark and Lakehouse principles. You will work ...
... Science, Information Systems, Data Engineering, Software Engineering, or a related field - Databricks Data Engineer Associate certification or higher preferred - Databricks Generative AI Engineer Associate certification preferred Responsibilities Design, build, and support scalable data, analytics, and artificial intelligence ...
... run and maintain production data pipelines on Databricks and AWS. - Youll keep scheduled data processing reliable, resolve incidents, apply fixes, and improve data service performance. - Youll provide a combination of L2/L3 production support and data engineering. - Youll support and maintain production data pipelines, including ...
... using Databricks and Azure Data Factory - Develop cloud-based data solutions across Azure and AWS - Ensure the quality, integrity and reliability of complex datasets - Work closely with FP&A, technology teams and senior business stakeholders - Collaborate with developers, infrastructure engineers and reporting specialists ...
... similar programming language - Data engineering or data integration experience - Understanding of data modelling and ETL/ELT concepts - Experience implementing data validation and testing processes - Strong communication and stakeholder engagement skills - Familiarity with Azure Data Factory, Databricks, Synapse Analytics, ...
... experience as a Senior or Lead Data Engineer, with strong hands-on data modelling expertise - Proficiency in SQL and Python - Proficiency with a modern cloud data platform such as Microsoft Fabric, Azure, Databricks or Snowflake - Experience setting architecture and standards for pipeline engineering and data modelling ...
Salary: £? - ? per year Requirements: - Previous experience in a data engineering role - Proficiency in Python, SQL, and .NET/C# - Strong understanding of database design for transactional (OLTP) and analytical (OLAP) systems - Proficiency with Azure Databricks and PySpark is desirable - Previous experience building and ...
... initiatives migrating legacy data processes to cloud-native solutions Self-Service Data Platform - Help prepare curated datasets for use in data lakes, enterprise data hubs, and data warehouses - Work with senior engineers to support scalable, performant data storage and compute solutions using Databricks and cloud data services ...
... Senior Data Engineer to lead and drive forward complex and high-impact data initiatives. Summary of the Role Howden Group Services is expanding its internal data engineering capability and is looking for a highly experienced Senior Data Engineer with deepexpertisein Databricks and Azure data services. The ideal candidate ...