Databricks Data Engineer – Insurance Domain

• Manchester or London based on candidate preference, United Kingdom
• Permanent | FTC |
• BU/Segment: Analytics / Data Management / Insurance
• £75k – £100k + benefits and bonus

---

About the Role

We are seeking a highly skilled Azure Databricks Data Engineer to design, build and deliver cloud-based data integration and analytics solutions within our Insurance portfolio.

You’ll work across data engineering, modelling, and transformation initiatives — developing scalable pipelines, optimising performance, and ensuring best-in-class data quality and governance. This is a hands-on technical role requiring strong Azure and Databricks expertise combined with solid Insurance domain knowledge.

You will join high-impact Insurance transformation programmes, collaborating with experienced data professionals in an innovative, forward-thinking environment. Flexible engagement options include Permanent, Fixed-Term Contract 

---

Key Responsibilities

• Design, build, and deploy scalable data pipelines using Azure Databricks, Azure Data Factory, and Azure SQL Database.

• Optimise Databricks environments for performance, cost efficiency, and security.

• Develop and maintain ETL/ELT processes, integration frameworks, and data quality checks.

• Translate business requirements into robust data models and maintain consistency across data layers.

• Partner with stakeholders to deliver effective data and analytics solutions.

• Produce technical documentation: data flows, architecture designs, test plans.

• Stay current with emerging Azure and data engineering technologies to drive continual improvement.

---

 Essential Skills & Experience

• Insurance industry experience (policy, claims, regulatory data) is essential.

• 5+ years’ management/leadership experience supporting technical delivery or project teams.

• 8–10 years’ experience in data engineering and integration within enterprise environments.

• Deep expertise with Azure Databricks, ADF, Azure Synapse, and Azure Data Lake.

• Strong hands-on experience with Spark (PySpark/SparkSQL) and data orchestration.

• Solid understanding of data modelling (Dimensional, ODS, Data Vault) and data warehousing.

• Experience handling large-scale, complex datasets in distributed environments.

• Proficiency in SQL, Git-based version control, and CI/CD pipelines.

• Familiarity with Agile and DevOps tools (Azure DevOps, JIRA).

---

Preferred Skills

• Knowledge of Enterprise Data Management, governance, metadata, and lineage.

• Exposure to multi-cloud environments (AWS/GCP).

• Understanding of modern data architectural patterns and real-time cloud data capabilities.

---

 What You Can Expect

As part of a leading global analytics and digital solutions organisation, you’ll benefit from:

• Competitive salary + bonus

• Private healthcare, critical illness insurance, 4× salary life assurance, income protection

• Generous pension

• Financial well-being perks including cashback cards, top-retailer discounts, and Cycle Scheme

• Extensive professional & personal development programmes, workshops, and learning pathways

• Inclusive culture — we are an Equal Opportunity Employer

• Employee Stock Purchase Plan (ESPP)

• Flexible hybrid working model promoting wellbeing and collaboration

---

Eligibility

Applicants must already be eligible to work in the United Kingdom.