Talent.com
Databricks
Senior Staff Software Engineer - DeltaDatabricks • London, United Kingdom
Senior Staff Software Engineer - Delta

Senior Staff Software Engineer - Delta

Databricks • London, United Kingdom
30+ days ago
Job type
  • Full-time
Job description

P-1127

At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions.

Our engineering teams build highly technical products that fulfill real, important needs in the world. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above.

The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission is to deliver industry-leading performance and a seamless user experience at massive scale, with most data written in Databricks flowing through our platform. We drive performance innovations like Low Shuffle Merge and Deletion Vectors and actively contribute to open source efforts to unify Delta and Iceberg formats.

We are seeking a highly skilled and experienced Senior Staff Software Engineer to join our backend team. In this role, you will be instrumental in designing, developing, and maintaining robust backend systems that power Databricks workspaces. You will build the next-generation platform for serving workspace assets, ensuring high QPS, low latency, reliable, and performant systems, proactively addressing the future growth challenges. Additionally, as a senior member of the team, you will provide technical leadership, mentorship, and guidance to junior engineers, contributing to the overall improvement of team coding practices and system designs.

The Impact you will have:

  • Solve real business needs at large scale by applying your software engineering.
  • Low level systems debugging, performance measurement, and optimization on large production clusters.
  • Build architecture design, influence product roadmap, and take ownership and responsibility over new projects.
  • Introduce tools to allow greater automation and operability of services.
  • Use your deep experience to help prevent and investigate production issues.
  • Plan and lead complicated technical projects that work with several teams within the company.
  • Contribute as a technical team lead by mentoring others, lead sprint planning, delegating work and assignments to team members and participate in project planning.

What we look for:

  • 15+ years industry experience building and supporting large-scale distributed systems.
  • Comfortable working towards a multi-year vision with incremental deliverables.
  • Motivated by delivering customer value and impact.
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Experience driving company initiatives towards customer satisfaction.
  • BS/MS/PhD in Computer Science or related majors, or equivalent experience.
Create a job alert for this search

Senior Staff Software Engineer - Delta • London, United Kingdom

Similar jobs

Senior Staff Software Engineer

Formula RecruitmentGreater London, England, GB
Full-time

An innovative and industry leading technology company is building a brand-new incubated team to pioneer a brand new project, focused on creating a greenfield solution oriented around Workload Ident... Show more

 • Promoted

Staff Software Engineer

CoMind Technologies Limited.Greater London, England, GB
Full-time

At CoMind, we are developing a non-invasive neuromonitoring technology that will result in a new era of clinical brain monitoring.In joining us, you will be helping to create cutting-edge technolog... Show more

 • Promoted

Staff Software Engineer (Scala)

The Walt Disney CompanyGreater London, England, GB
Full-time

As a Staff Software Engineer within the Identity Engineering organisation, you will be responsible for: identifying, or introducing best practices within the organisation; setting technical, and ar... Show more

 • Promoted

Staff Software Engineer

StepStone GroupGreater London, England, GB
Full-time

At The Stepstone Group, we have a simple yet very important mission: The right job for everyone.Using our data, platform, and technology, we create opportunities for jobseekers and companies around... Show more

 • Promoted

Senior Staff Software Engineer - Delta

DatabricksGreater London, England, GB
Full-time

At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development.We do this by building and running the worl... Show more

 • Promoted

Staff/Senior Software Engineer

LedgyGreater London, England, United Kingdom
Full-time

At Ledgy, we’re on a mission to make Europe a powerhouse of entrepreneurship by building a modern, tech-driven equity management and financial reporting platform for private and public companies.In... Show more

 • Promoted

Senior/Staff Software Engineer, Backend

United States Digital Space LLCGreater London, England, United Kingdom
Full-time

Design, animate, and code in one place.What you build in the editor is what ships in your app, game, or website.No mockups, no prototypes, no handoff.With the company, designers and developers work... Show more

 • Promoted

Senior/Staff Software Engineer

FonoaGreater London, England, GB
Full-time

Engineering plays a very central part in the business.As a company with ambitions to be a world-class API solution for all things tax, we value quality over quantity when building, and we care abou... Show more

 • Promoted

Staff Software Engineer

CerebrasGreater London, England, GB
Full-time

About our Marketplace Enablement Org and User Dialogue Team.Within Marketplace Enablement, we build the technology that helps candidates and recruiters find the right match.Our teams deliver data p... Show more

 • Promoted

Staff Software engineer

Generative GroupGreater London, England, GB
Full-time

Our client is building an AI workspace for document-heavy industries.The platform automates complex workflows, extracts high-value insights from unstructured documents, and enables enterprise teams... Show more

 • Promoted

Staff Software Engineer

LunarGreater London, England, GB
Full-time

Lunar is a stealth technology company building a new type of software platform for health systems.We are on a mission to revolutionize healthcare with cutting-edge, AI-powered software designed to ... Show more

 • Promoted

Staff Software Engineer

Elyos AIGreater London, England, GB
Full-time

We’re building the next generation of customer service with AI Agents.Our agents answer calls, reply to emails and WhatsApp messages, make bookings, take payments, and operate the CRM in the same w... Show more

 • Promoted

Senior Staff Software Engineer - Delta

Menlo VenturesGreater London, England, GB
Full-time

At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development.We do this by building and running the worl... Show more

 • Promoted

Staff Software Engineer

CoMindGreater London, England, GB
Full-time

At CoMind, we are developing a non-invasive neuromonitoring technology that will result in a new era of clinical brain monitoring.In joining us, you will be helping to create cutting-edge technolog... Show more

 • Promoted

Lead Staff Software Engineer

Software CareersGreater London, England, United Kingdom
Full-time

Lead Staff Software Engineerat The Trade Desk • LondonBack to jobs1.Lead Staff Software Engineer1h agoT## Lead Staff Software EngineerThe Trade Desk00Software EngineeringFull-timeLondon✓ Visa Reloc... Show more

 • Promoted

Staff Software Engineer

UnlikelyAIGreater London, England, GB
Full-time

At UnlikelyAI, we are building the future of AI: one that is reliable, accurate, and transparent.Our neurosymbolic technology harnesses the power of LLMs and generative AI, and combines it with Uni... Show more

 • Promoted

Staff Software Engineer

FanvueGreater London, England, GB
Full-time

Fanvue is one of the fastest-growing creator monetisation platforms globally.We're an AI-powered, creator-first platform helping creators connect, engage, and earn directly from their audiences at ... Show more

 • Promoted

Senior Staff Software Engineer, Perception, Autonomy

RivianCity Of London, England, GB
Full-time

Senior Staff Software Engineer, Perception, Autonomy.Rivian is on a mission to keep the world adventurous forever.This goes for the emissions-free Electric Adventure Vehicles we build, and the curi... Show more

 • Promoted

Senior Software Engineer

UiPath Inc.Greater London, England, United Kingdom
Full-time

As part of the Communications Mining team, you'll be responsible for building and maintaining our backend and ML serving services.This includes a highly available public API, data-aggregation servi... Show more

 • Promoted

Staff Software Engineer

KiGreater London, England, GB
Full-time

Look at the latest headlines and you will see something Ki insures.Think space shuttles, world tours, wind farms, and even footballers' legs.Digitally disrupt and revolutionise a 335-year-old marke... Show more