Talent.com
OpenAI
Software Engineer, Compute InfrastructureOpenAI • San Francisco; London, UK; New York City; Seattle
Software Engineer, Compute Infrastructure

Software Engineer, Compute Infrastructure

OpenAI • San Francisco; London, UK; New York City; Seattle
30+ days ago
Job type
  • Full-time
Job description

About the Team:

Compute Infrastructure builds the platform that turns enormous amounts of compute into a reliable engine for frontier AI. We design, provision, schedule, operate, and optimize the systems that connect accelerators, CPUs, networks, storage, data centers, orchestration software, agent infrastructure, developer tools, and observability into one coherent experience for researchers and product teams.

Our work spans the entire stack: capacity planning and cluster lifecycle, bare-metal automation, distributed systems, Kubernetes and scheduling, deep system optimization, high-performance networking, storage, fleet health, reliability, workload profiling, benchmarking, and the developer experience that lets teams use enormous compute systems with confidence. At this scale, small improvements to communication, scheduling, hardware efficiency, or debugging workflows can compound into meaningful research velocity. We are hiring across Compute Infrastructure rather than for a single narrow team, and we use this opening to match strong engineers to the problems where they can have the most leverage.

About the Role

We are looking for engineers who want to build the compute platform behind OpenAI's research and products. You may be strongest in low-level systems, high-performance computing, distributed infrastructure, reliability, CaaS, agent infrastructure, developer platforms, tooling, or the user experience around infrastructure. What matters is that you can reason carefully about complex systems, write durable software, and raise the quality and velocity of the people around you.

Depending on your background and interests, you might work close to hardware, close to users, on CaaS and agent infrastructure, or on the control planes and data planes in between. You could help bring new supercomputing capacity online, optimize training workloads from profiler traces and benchmarks, improve NCCL and collective communication behavior, reason about GPUs, NICs, topology, firmware, thermals, and failure modes, or design abstractions that make heterogeneous clusters feel like one coherent platform.

We do not expect every candidate to have worked at every layer. Some engineers will go deep on systems performance, kernel or runtime behavior, large-scale networking protocols, RDMA, NCCL, GPU hardware behavior, benchmarking, scheduling, or hardware reliability; others will make the platform more usable through APIs, tools, workflows, and developer experience. The common thread is strong engineering judgment and excitement about making enormous compute systems faster, more reliable, and easier to use.

This is a general opening for Compute Infrastructure. We will consider candidates for teams across Compute Infrastructure and match you based on your strengths, the problems that motivate you, and where the infrastructure needs are highest.

Where you might work

  • Compute Foundations: Build the low-level platform primitives that make heterogeneous hardware, providers, and data centers repeatable, automatable, and operable at scale.

  • Fleet / Orchestration: Turn raw capacity into reliable, efficient clusters and scheduling systems that researchers and product teams can use with minimal friction and great experience.

  • Core Network Engineering: Build and operate the high-performance networking fabrics, protocols, and observability needed for the largest training and serving workloads.

  • Hardware Health and Observability: Detect, diagnose, remediate, and prevent hardware and fleet-health issues so usable compute stays high across providers and accelerator generations.

  • Storage: Build scalable, performant, durable storage abstractions that keep data movement and storage access from becoming a bottleneck to research or products.

  • Agent Infrastructure: Build sandboxed execution infrastructure for agentic workloads across research and production, with strong isolation, reliability, and scale.

In this role, you will:

  • Build and deeply optimize reliable system software for large-scale compute systems that run some of the world's most demanding AI workloads

  • Design and operate infrastructure across accelerators, CPUs, NICs, switches, networking protocols, storage, data centers, cluster orchestration, scheduling, and fleet health

  • Profile, benchmark, and optimize training workloads across compute, memory, storage, networking, NCCL and collective communication, and cluster scheduling bottlenecks

  • Create hardware-aware automation that makes provisioning, firmware and driver upgrades, incident response, and day-to-day operations faster and less error-prone

  • Build CaaS, agent infrastructure, profiling, observability, benchmarking, and platform tools that help researchers, product engineers, and operators launch, debug, and optimize workloads with less friction

  • Turn operational lessons into better systems, stronger abstractions, and clearer ownership boundaries across teams

  • Collaborate across research, engineering, security, networking, hardware, and data center teams to make compute capacity more capable and easier to use

You might thrive in this role if you:

  • Have built or operated distributed systems, infrastructure platforms, high-performance computing environments, large-scale networking systems, Kubernetes clusters, developer tools, or production systems with demanding reliability requirements

  • Enjoy working across layers of the stack and are comfortable moving between software, hardware, networking, systems performance, reliability, and user needs

  • Care about making complex infrastructure understandable, observable, and usable for the people depending on it

  • Can diagnose hard problems under real operational pressure while still investing in long-term engineering quality

  • Like building leverage for others, whether through APIs, automation, debugging tools, CaaS and agent infrastructure primitives, workflow improvements, or better platform abstractions

  • Are motivated by scale, efficiency, reliability, and disciplined measurement through benchmarks, profiles, and production evidence

  • Communicate clearly, take ownership, and work well with teams whose constraints and goals differ from your own

Qualifications

  • Strong software engineering skills and experience building, operating, or improving production infrastructure systems

  • Experience in one or more relevant areas such as distributed systems, operating systems, networking protocols, RDMA, NCCL or collective communication, storage, Kubernetes, scheduling, observability, reliability engineering, high-performance computing, GPU infrastructure, CaaS, agent infrastructure, hardware-aware performance optimization, benchmarking, developer experience, or infrastructure tooling

  • Ability to debug complex system behavior across software, hardware, networking, and workload layers, then turn findings into robust improvements

  • Comfort with ambiguity, strong ownership, and a bias toward practical, durable solutions

  • Interest in working on infrastructure that directly enables frontier AI research and product impact

Create a job alert for this search

Software Engineer, Compute Infrastructure • San Francisco; London, UK; New York City; Seattle

Similar jobs

Infrastructure & Cloud Engineer

TRM-InternationalCity Of London, England, GB
Full-time

A fast-growing digital asset investment and technology business is seeking a Senior Infrastructure & Linux Engineer to join its expanding technology team.Operating at the forefront of cryptocurrenc... Show more

 • Promoted

Infrastructure Engineer

Extech 2000 Limited.Croydon, England, GB
Full-time

Looking for two infrastructure engineers to join the newly formed infrastructure engineering team.Production use of either AWS or configuration management tools - can be either/or because of the tw... Show more

 • Promoted

Cloud Infrastructure Engineer

Infinity QuestGreater London, England, GB
Full-time

Proven experience in AZURE Terraform code.Demonstrable experience in GitHub Actions.Experience of working in a controlled environment with strict change control.Good understanding and practical imp... Show more

 • Promoted

Senior Software Infrastructure Engineer

EngineersOfAIGreater London, England, GB
Full-time

Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure.You will develop essential tools and services that empower our broader software team... Show more

 • Promoted

Lead Software Engineer - Public Cloud Engineering

JPMorganChaseGreater London, England, United Kingdom
Full-time

As a Lead Software Engineer at JPMorgan Chase within Public Cloud Engineering – Infrastructure Platforms, you are an integral part of an agile team that works to enhance, build, and deliver trusted... Show more

 • Promoted

Cloud Infrastructure Engineer

PerlegoGreater London, England, GB
Full-time

At Perlego, we are working hard to make education accessible to all.In this digital age, we believe that anyone should be able to learn anything at any time.Knowledge should be more accessible, not... Show more

 • Promoted

Cloud Infrastructure Engineer

Savant RecruitmentGreater London, England, GB
Full-time

Savant is looking for a Cloud Infrastructure Engineer for one of our clients.You will be engaged in various missions and assignments that will regularly test your ability to use Cloud technology an... Show more

 • Promoted

Cloud Infrastructure Engineer

Copper.coGreater London, England, GB
Full-time

Since being founded in 2018, Copper has been building the standard for institutional digital asset infrastructure with a focus on custody, collateral management, and prime services.Lead by Amar Kuc... Show more

 • Promoted

Senior Software Engineer, Infrastructure

AxonGreater London, England, GB
Full-time

Join Axon and be a Force for Good.At Axon, we’re on a mission to Protect Life.We’re explorers, pursuing society’s most critical safety and justice issues with our ecosystem of devices and cloud sof... Show more

 • Promoted

Cloud and Infrastructure Engineer

COMX PS LTDGreater London, England, GB
Full-time

Predominantly remote – London presence 1–2 days per month.Senior Cloud & Platform Engineer.This role focuses on enabling modern, cloud-first solutions across hybrid and public cloud environments, w... Show more

 • Promoted

Senior Software Engineer, Infrastructure

EncordGreater London, England, GB
Full-time

Encord is the universal data layer for AI that helps 300+ AI teams train and run models on the right data.Our platform indexes, curates, annotates, and evaluates data across the full AI lifecycle, ... Show more

 • Promoted

Software Engineer, Compute Infrastructure

OpenAIGreater London, England, GB
Full-time

Compute Infrastructure builds the platform that turns enormous amounts of compute into a reliable engine for frontier AI.We design, provision, schedule, operate, and optimize the systems that conne... Show more

 • Promoted

Cloud Infrastructure Engineer

SLAMcoreGreater London, England, GB
Full-time

Since being founded in 2018, Copper has been building the standard for institutional digital asset infrastructure with a focus on custody, collateral management, and prime services.Led by Amar Kuch... Show more

 • Promoted

Backend Software Engineer - Infrastructure

PalantirGreater London, England, GB
Full-time

Palantir builds the world’s leading software for data-driven decisions and operations.By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving ... Show more

 • Promoted

Principal Infrastructure Engineer

Pulse RecruitGreater London, England, United Kingdom
Full-time

London, Bristol or Glasgow - 1 day a week.We’re hiring a Principal CloudOps & Infrastructure leader to shape the future of a large, GCP-first enterprise environment undergoing significant transform... Show more

 • Promoted

Senior Software Engineer - Infrastructure

Noon-The Social Learning PlatformGreater London, England, GB
Permanent

Noon's mission is to radically change the way people learn, with a primary focus on the Middle East, where the company has its roots and where the need and urgency to improve education are highest.... Show more

 • Promoted

Cloud Infrastructure Engineer

Perlego Ltd.Greater London, England, GB
Full-time

At Perlego, we are working hard to make education accessible to all.In this digital age, we believe that anyone should be able to learn anything at any time.Knowledge should be more accessible, not... Show more

 • Promoted

Infrastructure Software Engineer

Coram AIGreater London, England, GB
Full-time

The Infrastructure Software Engineer will be responsible for a large part of our edge and cloud stack underpinning our portfolio of IoT products - not just in terms of infrastructure, but also to b... Show more

 • Promoted

Software Engineer, Infrastructure

MetaGreater London, England, GB
Full-time

Meta is seeking talented engineers to join our teams in building cutting‑edge products that connect billions of people around the world.As a member of our team, you will have the opportunity to wor... Show more

 • Promoted

Software Engineer, Infrastructure

HarmonicGreater London, England, GB
Full-time

At Harmonic, we are building a mathematical reasoning engine that operates with absolute precision.While most AI makes maximum‑likelihood guesses, Harmonic’s Aristotle uses Lean4 and reinforcement ... Show more