Talent.com
Codelitt
Senior Data Platform Engineer (Python & Databricks)Codelitt • Edinburgh, Scotland, UK
Senior Data Platform Engineer (Python & Databricks)

Senior Data Platform Engineer (Python & Databricks)

Codelitt • Edinburgh, Scotland, UK
7 days ago
Job type
  • Full-time
Job description
About Codelitt

At Codelitt we are more than a product-development company. We are creators innovators and problem solvers.

We partner with companies around the world to design and build meaningful digital products modernize complex systems and solve challenging technical problems. Our globally distributed team values technical excellence ownership proactive communication and collaboration.

About the Role

We are looking for a Senior Data Platform Engineer to join a high-impact engagement with one of our partners a global leader in wealth-management technology.

This is a hybrid position to work in our office in Edinburgh. Here youll find our office location. We expect the engineer working in this position to go to the office between 1 to 2 times per week.

You will help build and evolve a financial data platform developed on top of Databricks and used by major enterprise clients. The platform supports the ingestion transformation modeling and delivery of complex financial data.

This is primarily a backend and data-platform position. You will work across Python services APIs data pipelines and data models while collaborating closely with an established engineering team in Edinburgh.

The ideal candidate has substantial hands-on Databricks experience and can become productive in a complex data environment. You should be comfortable taking ownership of well-defined areas of work while gradually building a broader understanding of the platform.

We process our payment in US dollars however you can receive it in your local currency.

What Youll Do

Data Platform Development

  • Build and maintain components of a large-scale financial data platform.

  • Develop reliable data pipelines for ingesting transforming and delivering financial data.

  • Design data models that support enterprise reporting analytics and downstream integrations.

  • Improve the performance reliability maintainability and observability of existing data workflows.

  • Troubleshoot complex issues across data-processing and application layers.

Python and API Development

  • Design build and maintain production-grade applications and services using Python.

  • Develop well-structured APIs for accessing and managing data-platform capabilities.

  • Write clean testable maintainable and well-documented code.

  • Participate in architectural and technical-design discussions.

  • Review code and help maintain a high engineering standard across the team.

Databricks Engineering

  • Build and operate production workloads using Databricks.

  • Help improve the organization and execution of Databricks-based data workflows.

  • Work with large datasets and complex transformation requirements.

  • Apply Databricks best practices to improve scalability reliability and developer productivity.

Collaboration and Ownership

  • Work directly with engineers and technical leaders from both Codelitt and our partner.

  • Collaborate with a hybrid engineering team based in Edinburgh.

  • Break complex requirements into clear and manageable technical tasks.

  • Communicate progress risks dependencies and blockers proactively.

  • Take ownership of assigned initiatives from technical discovery through delivery.

  • Contribute to documentation and internal knowledge sharing.

Required Qualifications

  • Five or more years of professional software-engineering experience.

  • Strong professional experience developing production applications with Python.

  • Hands-on experience building production workloads with Databricks.

  • Experience designing and maintaining data pipelines.

  • Strong understanding of data modeling and data-processing concepts.

  • Experience designing or consuming APIs in distributed systems.

  • Experience working with relational databases and SQL.

  • Strong automated-testing and software-quality practices.

  • Experience working with version control code review and CI/CD workflows.

  • Ability to understand and contribute to an established complex codebase.

  • Strong written and verbal English communication skills.

  • Ability to work independently while collaborating closely with a broader engineering team.

  • Ability to attend the Edinburgh office regularly typically one to two days per week.

Preferred Qualifications

  • Experience building data platforms for financial-services or other data-intensive industries.

  • Experience with cloud-based data architectures.

  • Familiarity with infrastructure-as-code tools such as Terraform.

  • Experience improving the observability and operational reliability of data pipelines.

  • Familiarity with modern data governance access-control and data-quality practices.

  • Experience working in an enterprise environment with strict security and compliance requirements.

  • Front-end experience with React or another modern JavaScript framework.

Front-end development and infrastructure work may occasionally be required but they are not the primary focus of this position. Deep Kubernetes expertise is not required.

Who You Are

Databricks Experienced

You have used Databricks in a real production environment and understand how to build maintain and troubleshoot data workloads on the platform.

Python Focused

You can design and implement reliable Python services and APIs not simply scripts or notebooks.

Data Oriented

You understand how data moves through a platform and can reason about ingestion transformation modeling quality performance and downstream consumption.

Proactive

You communicate before a problem becomes a surprise. When blocked you raise the issue explain its impact and help identify a path forward.

Comfortable with Complexity

You can navigate a mature platform with significant internal context. You know how to ask effective questions document what you learn and gradually expand your ownership.

Collaborative

You enjoy working with other engineers sharing knowledge reviewing designs and contributing to a healthy engineering culture.

What We Offer

  • Generous paid-time-off policy.

  • Paid sick leave.

  • Paid parental leave.

  • Opportunities to work on challenging products with experienced international teams.

  • A collaborative environment that values technical quality and personal ownership.

  • Regular team-building activities throughout the year.

Codelitt is a close-knit global team that moves quickly communicates openly and enjoys solving difficult problems together.

If you are an experienced Python engineer with strong Databricks knowledge and an interest in building enterprise data platforms we would love to hear from you.

Please note: We are not currently interested in working with external recruiters or staffing agencies.


Required Experience:

Senior IC


Employment Type : Contract
Experience: years
Vacancy: 1
Create a job alert for this search

Senior Data Platform Engineer (Python & Databricks) • Edinburgh, Scotland, UK

Similar jobs

Hybrid Data Engineer: PySpark, Databricks & Tableau

Change Digital – Digital & Tech RecruitmentCity of Edinburgh, Scotland, GB
Full-time

Change Digital is seeking a data engineer with strong Python, SQL and Databricks skills to join a fast-growing business specialising in BI, Data Analytics & AI.The role is hybrid with offices in Lo... Show more

 • Promoted

Senior Platform Engineer

QodeaCity of Edinburgh, Scotland, GB
Full-time

Qodea Edinburgh, Scotland, United Kingdom.Join Europe\'s leading, high-growth Google Cloud consultancy.At Qodea, you\'ll be part of a team energised by innovation and passionate about delivering ex... Show more

 • Promoted

Senior Data Engineer

AttoCity of Edinburgh, Scotland, GB
Full-time

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helpin... Show more

 • Promoted

Data Engineer: Azure & Fabric Data Platform

SandersonCity of Edinburgh, Scotland, GB
Full-time

Sanderson is seeking a Data Engineer in Edinburgh with experience in data engineering and analytics.You will design, develop, and deliver solutions to optimize and transform data, working with Azur... Show more

 • Promoted

Senior Data Engineer - Remote-Ready Data Platforms

Scott LogicCity of Edinburgh, Scotland, GB
Remote
Full-time

A leading technology firm in Edinburgh is looking for a Senior Data Engineer to build data platforms and analytics solutions.The candidate will lead teams and solve engineering challenges while int... Show more

 • Promoted

Senior Data Engineer

Scott LogicCity of Edinburgh, Scotland, GB
Full-time

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice.Our clients are inc... Show more

 • Promoted

Senior Data Engineer

Wrisk LimitedCity of Edinburgh, Scotland, GB
Full-time

As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helping our customers use transactional intelligence to drive smarter financial decisions and build imp... Show more

 • Promoted

Senior Data Engineer: Build Scalable Cloud Data Pipelines

QodeaCity of Edinburgh, Scotland, GB
Full-time

Join a forward-thinking consultancy that specializes in Google Cloud solutions.As a Senior Data Engineer, you'll design and maintain robust data pipelines, ensuring data quality and governance.Coll... Show more

 • Promoted

Senior Data Engineer - Real‑Time Data Platform & Impact

Wrisk LimitedCity of Edinburgh, Scotland, GB
Full-time

A data-centric technology company in the UK is seeking a Senior Data Engineer to design scalable data solutions.You will work with cross-functional teams to implement data pipelines and ensure data... Show more

 • Promoted

Data Engineer

SandersonCity of Edinburgh, Scotland, GB
Full-time

As a Data Engineer you will be responsible for designing, developing and delivering solutions to load, optimise and transform data within our environment and the relevant infrastructure to support ... Show more

 • Promoted

Platform Engineer

Motability Operations LtdCity of Edinburgh, Scotland, GB
Full-time

Platform Engineer – Motability Operations Ltd.As a Platform Engineer in the Container Platform Team, you’ll play a key role in developing, improving, and supporting secure, scalable, and automated ... Show more

 • Promoted

Lead Data Engineer

Scott LogicCity of Edinburgh, Scotland, GB
Full-time

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice.Our clients are inc... Show more

 • Promoted

Senior Platform Engineer (Data Streams) (Remote - UK)

Yelp Inc.City of Edinburgh, Scotland, GB
Remote
Full-time

We’re looking for experienced engineers to join our team and build elegant, scalable platforms that bring the potential of data streams to Yelp’s features teams.From transporting events reliably be... Show more

 • Promoted

Hybrid Remote Senior Cloud & AI Platform Engineer

CreateFutureCity of Edinburgh, Scotland, GB
Remote
Full-time

CreateFuture in the United Kingdom is seeking a Senior Cloud Engineer to drive architecture and delivery across client projects.The role blends infrastructure mastery with software development, dat... Show more

 • Promoted

Senior Real-Time Data Streams Platform Engineer

Yelp Inc.City of Edinburgh, Scotland, GB
Full-time

The role involves building scalable platforms that utilize data streams to enhance user experiences and drive optimizations for advertising businesses.Candidates will be responsible for architectin... Show more

 • Promoted

Senior Data Engineer

WriskCity of Edinburgh, Scotland, GB
Full-time

As a Senior Data Engineer with Atto, you will be part of our Data Science & Engineering team, helping our customers use transactional intelligence to drive smarter financial decisions and build imp... Show more

 • Promoted

Lead AI-Driven Cloud Platform Engineer

CreateFutureCity of Edinburgh, Scotland, GB
Full-time

CreateFuture in the UK is seeking a Lead Engineer - Cloud to guide cloud engineers, engage with clients, and deliver complex projects.You will shape architecture, advise on best practices, and driv... Show more

 • Promoted

Senior Data Engineer — Real-Time Data Platform

AttoCity of Edinburgh, Scotland, GB
Full-time

A data analytics company based in Edinburgh is seeking a Senior Data Engineer to design, build, and maintain data ingestion and ETL pipelines.This role will focus on developing scalable data platfo... Show more

 • Promoted

Senior AI Platform & Infrastructure Engineer

LenovoCity of Edinburgh, Scotland, GB
Full-time

A leading technology company in Edinburgh is looking for a highly skilled AI Infrastructure Engineer to design, build, and maintain infrastructure for AI model development.This role requires deep e... Show more

 • Promoted

Lead Python Engineer: Architecture & API Design

PartnerizeCity of Edinburgh, Scotland, GB
Full-time

Partnerize is looking for a Lead Python Engineer situated in Edinburgh, Scotland.The ideal candidate will produce clean and maintainable designs, lead software development teams, and have extensive... Show more