Talent.com
Sagacity
Databricks Platform EngineerSagacity • Greater London, England, GB
Databricks Platform Engineer

Databricks Platform Engineer

Sagacity • Greater London, England, GB
30+ days ago
Job type
  • Full-time
  • Permanent
  • Quick Apply
Job description

Platform Architecture & Engineering responsibilities:


  • Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements
  • Architect end-to-end data platforms including ingestion, storage (Delta Lake), processing, and consumption layers
  • Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles(DAB's))
  • Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity Catalog), and access controls
  • Define environment strategies (dev/test/prod), CI/CD pipelines, and release processes for Databricks deployments
  • Implement monitoring, logging, cost optimisation, and performance tuning across the platform
  • Design and implement data pipelines using Delta Live Tables, Auto Loader, and Databricks Workflows for both batch and streaming workloads


Client Delivery & Enablement responsibilities:


  • Work directly with clients to translate business and technical requirements into scalable platform designs
  • Lead technical workshops, architecture sessions, and whiteboarding engagements with client stakeholders
  • Support rapid prototyping and proof-of-concept builds within Databricks to demonstrate platform capabilities and accelerate client adoption
  • Provide best practice guidance on Lakehouse architecture, data modelling, workload optimisation, and cost management
  • Produce high-quality technical documentation including architecture diagrams, architecture decision records (ADRs), runbooks, and deployment guides
  • Enable client teams through structured knowledge transfer, training, and platform handover
  • Collaborate with data engineers, data scientists, and product teams to ensure successful delivery outcomes


Governance & Security:


  • Implement Unity Catalog for centralised data governance, including access control (RBAC/ABAC), data lineage, audit logging, and compliance enforcement
  • Apply security best practices across platform design: network isolation, secret management, encryption at rest and in transit, and identity federation
  • Ensure platform designs meet client regulatory and compliance requirements (e.g. GDPR, ISO 27001, sector-specific standards)


What success looks like in the role:


  • Delivery of robust, secure, and scalable Databricks platforms that meet client performance and cost expectations
  • Clear, well-architected solutions that balance flexibility, governance, and operational efficiency
  • Strong client relationships built on trust, technical credibility, and effective communication
  • Accelerated client adoption of the Lakehouse platform through well-designed enablement and documentation
  • Reduced deployment time through reusable infrastructure patterns and automation
  • Proactive identification of risks, trade-offs, and optimisation opportunities across platform design and delivery
  • Contribution to the organisation's growing body of reusable platform accelerators, reference architectures, and internal knowledge


Competencies and Behaviours:


  • 3+ years experience in data platform engineering, cloud engineering, or similar roles
  • Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows
  • Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/VPC, IAM)
  • Experience with infrastructure-as-code tools (e.g. Terraform preferred) and CI/CD pipelines (e.g. Azure DevOps, GitHub Actions)
  • Solid understanding of data architecture concepts including Lakehouse medallion architecture and dimensional modelling
  • Familiarity with security and governance frameworks (e.g. RBAC, ABAC, data masking, audit, compliance standards)
  • Excellent communication skills with the ability to explain complex technical concepts to non-technical stakeholders
  • Comfortable working in a client-facing consultancy environment with multiple concurrent engagements
  • Proactive, self-driven, and able to take ownership of end-to-end platform delivery
  • Willingness to travel within the UK as required
  • Right to work in the UK
Create a job alert for this search

Databricks Platform Engineer • Greater London, England, GB

Similar jobs

Hybrid Data Platform Engineer — AWS, Databricks, Lakehouse

HousefulGreater London, England, GB
Full-time

Houseful is looking for a Data Platform Engineer in Greater London.The role involves scaling a data lakehouse, building infrastructure for data products, and designing reusable templates.Ideal cand... Show more

 • Promoted

Data Platform Engineer

WeBuild-AIGreater London, England, GB
Full-time

We combine highly skilled experts with our.We work with enterprise organisations on a global stage, reinventing how they design, build, and operate AI powered software at scale with speed.At WeBuil... Show more

 • Promoted

Platform Lead: Data & Cloud Platform (Snowflake/Kafka)

InfosysGreater London, England, United Kingdom
Full-time

Infosys is seeking a Platform Lead/Senior Consultant to lead a modern Data & Integration Platform built on Snowflake, Confluent Kafka, Azure Cloud, Kubernetes, and CI/CD ecosystems.You will guide e... Show more

 • Promoted

Platform Engineer

Experis - ManpowerGroupGreater London, England, GB
Full-time

Location: London (Hybrid - 3 days per week on-site).Day rate: £600 - £630 inside IR35.We are seeking a highly skilled and experienced Platform Engineer to build and maintain the core infrastructure... Show more

 • Promoted

Senior Data Platform Engineer — ML Infra & Databricks

National GeographicGreater London, England, GB
Full-time

DraftKings is looking for a Senior Data Platform Engineer to enhance our data capabilities.In this role, you will own and operate the Databricks infrastructure, ensuring its performance and reliabi... Show more

 • Promoted

Platform Engineer (Data)

AcceleroGreater London, England, GB
Full-time

Technology & Innovation team within a well-established corporate finance business.This role is primarily focused on.You’ll work closely with data engineers and technical leadership to ensure system... Show more

 • Promoted

Senior Platform Engineer – Greenfield Data Platform

Baringa Partners LLPGreater London, England, GB
Full-time

Baringa Partners LLP is seeking an experienced Senior Platform Software Engineer to join their Energy Products Practice in London, UK.This role focuses on designing and supporting a greenfield Data... Show more

 • Promoted

Databricks Platform Engineer

SagacityGreater London, England, GB
Full-time

Platform Architecture & Engineering responsibilities.Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements.Architect end-to-end data platfo... Show more

 • Promoted

Senior Platform Engineer

Uniting AmbitionCity Of London, England, GB
Full-time

Senior Data Platform Engineer / Data Architect.Python AWS Terraform Kafka Event-Driven Architecture.You’ll work alongside experienced engineers to build the platform foundation that supports data p... Show more

 • Promoted

Data Platform Engineer

StarlingGreater London, England, GB
Full-time

Starling is the UK’s first and leading digital bank dedicated to fixing banking.With a focus on fast technology, fair service and honest values, we aim to make banking simpler, quicker and more tra... Show more

 • Promoted

Platform Engineer

Limelight HealthGreater London, England, GB
Full-time

You'll help build and operate the deployment platform, tooling, and developer experience that every engineering team at dunnhumby relies on to ship software to production.This role can be based fro... Show more

 • Promoted

Senior Data Platform Engineer — Blockchain Analytics

EllipticGreater London, England, United Kingdom
Full-time

Elliptic is seeking a Senior Software Engineer to join its Product-Engineering team, focusing on data engineering for blockchain analytics.You will design, build and ship the data platform, shaping... Show more

 • Promoted

Databricks Principal Data Engineer (Contract) - Remote

NasstarGreater London, England, United Kingdom
Remote
Full-time

Nasstar is seeking a Principal Data Engineer to support complex client engagements in Data & AI transformation.This role involves designing scalable data platforms and engaging with senior stakehol... Show more

 • Promoted

Data Platform Engineer

AtollsGreater London, England, GB
Full-time

At Atolls, the world’s largest community-driven shopping platform, we are seeking a Data Engineer to join our Data Products team.You’ll help build a data platform and data products used across the ... Show more

 • Promoted

Data Platform Engineer

Webuild AiGreater London, England, GB
Full-time

We combine highly skilled experts with our.We work with enterprise organisations on a global stage, reinventing how they design, build, and operate AI powered software at scale with speed.At WeBuil... Show more

 • Promoted

Data Platform Engineer - (AWS, Databricks)

AltoGreater London, England, GB
Full-time

Alto Software Group is a B2B SaaS company that powers more than half of all UK housing transactions each year.We create software solutions that connect businesses and consumers, delivering a one‑st... Show more

 • Promoted

Data Platform Engineer: AWS, Databricks & Lakehouse

Houseful LimitedGreater London, England, GB
Full-time

Houseful Limited is hiring a Data Platform Engineer in Greater London to help scale their data lakehouse and build infrastructure for data commercialization.The ideal candidate will have strong Pyt... Show more

 • Promoted

Platform Engineer — Hybrid Cloud, Kubernetes & IaC

ZilchGreater London, England, GB
Full-time

Zilch is seeking a Platform Engineer to manage our software infrastructure, ensuring efficiency and security.The ideal candidate will have over 4 years of experience supporting SQL databases, Kuber... Show more

 • Promoted

Lead Databricks Engineer

KubrickGreater London, England, GB
Full-time

Join Kubrick as Senior Manager Databricks Engineer: lead end-to-end data/ML platforms, mentor teams, and partner with clients to deliver real impact in an inclusive, collaborative setting.Kubrick i... Show more

 • Promoted

Data Platform Engineer

XcedeGreater London, England, GB
Full-time

A strong opportunity for an engineer who wants to build the data platform an entire organisation runs on, not just the pipelines on top of it.We're partnering with a well‑backed B2B SaaS business w... Show more