Talent.com
Spotify
Remote Senior Data Engineer - Platform EngineeringSpotify • Barnsley, England
Remote Senior Data Engineer - Platform Engineering

Remote Senior Data Engineer - Platform Engineering

Spotify • Barnsley, England
30+ days ago
Job type
  • Full-time
  • Remote
Job description
As a Senior Data Engineer in our new Central Data Engineering team in the Platform Mission, you will be leading work that is mission-wide in terms of scope.
Our new Central Data Engineering team will inform data quality standards, access standards, create templatised solutions, assist in managing mission-level datasets/dashboards, and prepare our mission’s data for the AI Future that expected to impact every squad and product area.
As the Senior engineer on the team, you will deal with bringing structure to ambiguity and be the bridge between business goals and translating them to technical deliverables.

What you'll do

    • Build large-scale data pipelines using frameworks like Google Cloud Platform and Apache Beam.
    • Work on projects powering new generative AI experiences and helping to build models.
    • Learn and contribute to the team's best practices and techniques for building data pipelines for large-scale models, including cleaning, filtering, classifying, and labeling.
    • Collaborate with other engineers, researchers, product managers, and stakeholders, taking on learning and leadership opportunities that arise.
    • Deliver scalable, testable, maintainable, and high-quality code.
    • Share knowledge, promote standard methodologies, and improve the team through mentorship and constructive accountability.

Who you are

    • You have Data Engineering experience and know how to work with high-volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS.
    • You have experience building clean, high-quality datasets for training large-scale models.
    • You have experience with one or more higher-level Python or Java-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, etc.
    • You have strong Python programming abilities. You might have worked with Docker as well as Luigi, Airflow, or similar tools.
    • You care about quality and know what it means to ship high-quality code.
    • You have experience managing data retention policies.
    • You care about agile software processes, data-driven development, reliability, and responsible experimentation.
    • You understand the value of collaboration and partnership within teams.

Where you’ll be

    • This role is based in London
    • We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.
Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we're here to support you in any way we can.
Spotify transformed music listening forever when we launched in 2008. Our mission is to unlock the potential of human creativity by giving a million creative artists the opportunity to live off their art and billions of fans the chance to enjoy and be passionate about these creators. Everything we do is driven by our love for music and podcasting. Today, we are the world’s most popular audio streaming subscription service.
Create a job alert for this search

Remote Senior Data Engineer - Platform Engineering • Barnsley, England

Similar jobs

Senior GenAI Platform Engineer: Backend & AI Solutions

Grant Thornton UKSheffield, England, GB
Full-time

Grant Thornton UK in the North of England seeks a Senior Engineer for the Generative AI Platform.This hands-on individual contributor role builds and operates production-grade GenAI solutions that ... Show more

 • Promoted

Senior Data Engineer in Normanton - Network IT

Network ITAltofts, England, GB
Full-time

We are looking for a Data Engineer with a strong background in data engineering, ideally at a senior or lead level.You must have extensive experience with.A solid understanding of serverless AWS cl... Show more

 • Promoted

Senior DevOps Engineer - Cloud Reliability & Automation

The National CollegeSheffield, England, GB
Full-time

A leading educational technology company in Sheffield is seeking a Lead DevOps Engineer to ensure the reliability and performance of their cloud infrastructure.This hands-on role involves collabora... Show more

 • Promoted

Senior AI Platform Delivery Lead — Global Scale

HSBCSheffield, England, GB
Full-time

HSBC in Sheffield is seeking an AI Platform Delivery Manager to lead the successful delivery of an enterprise AI platform.In this role, you will oversee all phases of project delivery, coordinate w... Show more

 • Promoted

Data Engineer

Boost Talent ltdSheffield, England, GB
Full-time

Data Engineer – Sheffield (3 days a week onsite) - Up to £60K.We’re working with a forward‑thinking organisation where data powers every decision and innovation.They’re looking for a Data Engineer ... Show more

 • Promoted

Principal Database Platform Engineer

N Consulting LimitedSheffield, England, GB
Full-time

Principal Database Platform Engineer at N Consulting Ltd**Role: Principal Database Platform Engineer****Location: Sheffield, UK (3 days weekly from office)****Duration: 6-12 Month (Extendable)****W... Show more

 • Promoted

Senior Engineer

HSBCSheffield, England, GB
Full-time

Some Careers Shine Brighter Than Others.If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential.Whether you want a career that could take you to the top, or... Show more

 • Promoted

Senior Data Platform Architect – Azure Databricks

Rebel RecruitersSheffield, England, GB
Full-time

A leading recruitment firm is seeking a Lead Data Engineer to own and architect a modern data platform using Azure and Databricks.The successful candidate will lead the design of efficient data flo... Show more

 • Promoted

Data Engineer – Build Scalable Pipelines & Impact

Boost Talent ltdSheffield, England, GB
Full-time

A forward-thinking organization in Sheffield is seeking a passionate Data Engineer to design scalable data pipelines and shape the future of data.In this mid-senior level role, you will own end-to-... Show more

 • Promoted

Senior Software Engineer

Hollybank Trustees LtdTadcaster, England, GB
Full-time +1

To design, implement, document, and commission control software for bespoke automation machinery.The Senior Software Engineer is responsible for writing Software Design Specifications (SDS) documen... Show more

 • Promoted

Senior Engineer/Engineer

Grant Thornton UKSheffield, England, GB
Full-time

Senior Engineer – Generative AI Platform.Based in the North of England, this hands‑on individual contributor role focuses on building and operating solutions within Grant Thornton's GenAI platform ... Show more

 • Promoted

Data Engineer

FareshareSheffield, England, GB
Full-time

At FareShare we build relationships with thousands of charities and community groups, and support them with surplus food.When there’s an opportunity to do more, the Information Centre lends a hand ... Show more

 • Promoted

GenAI Platform Lead

HSBCSheffield, England, GB
Full-time

Define and deliver the GenAI Agent platform end-to-end, partnering with cross-functional stakeholders from discovery through production rollout for priority banking services.Architect core platform... Show more

 • Promoted

Principal Engineer -Database Platform

PURVIEWSheffield, England, GB
Full-time

Location: Sheffield, UK (3 Days from office).Job Type: Contract - Inside IR35.This is a senior leadership role responsible for driving technical strategy, architectural decisions, and engineering e... Show more

 • Promoted

Senior AI Engineering Lead—Platform & DevSecOps

RWS GruppeSheffield, England, GB
Full-time

RWS Gruppe is seeking a Senior Engineering Manager to lead a new engineering team within 'RWS Protect'.This role focuses on modern software development, embracing AI tools, and fostering a DevSecOp... Show more

 • Promoted

Senior Data Engineer – AWS ETL & Data Platform (Hybrid)

InaraSheffield, England, GB
Full-time

Inara Talent is searching for a Senior Data Engineer in Sheffield.You will be the data SME across engineering and BI, building ETL pipelines in AWS, ensuring data is well-structured and fit for pur... Show more

 • Promoted

AI‑Driven Tech Lead: Platform Modernization & DevSecOps

RWS GroupSheffield, England, GB
Full-time

RWS Group in Sheffield is seeking a Senior Engineering Manager to lead a new engineering team within Protect.The role involves establishing modern ways of working while remaining hands-on in archit... Show more

 • Promoted

Platform Engineer: Kubernetes, Automation & Hybrid Cloud

UndisclosedSheffield, England, GB
Full-time

A leading technology firm in the UK is seeking an engineer to operate and enhance a large-scale hybrid server estate.The role requires experience in Kubernetes, automation using tools like Ansible ... Show more

 • Promoted

Platform access engineer

QUINTESSENTIAL BRANDS UK GROUP LTDPontefract, England, GB
Full-time

We’re looking for an experienced and hands-on Access Platform Engineer to join our growing team.This role is primarily focused on major repairs, diagnostics, refurbishment and fault finding on vehi... Show more

 • Promoted

Celigo Integration Engineer - Hybrid, Impactful Data Flows

MICHELIN Connected FleetAberford, England, GB
Full-time

A leading mobility technology company is seeking a professional to enhance its enterprise tool set, primarily focusing on Celigo implementation.The ideal candidate will have solid experience in tem... Show more