Data Engineer

Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models.

The role

We're looking for a Data Engineer to build and optimise scalable data pipelines, ensuring our teams have access to high quality, reliable data. You will work closely with data scientists, analysts and engineers to enhance data workflows and drive impact insights across the business.

What you’ll bring to the role

• Technical Expertise : 2+ years of hands on experience deploying production quality code with proficiency in Python for data processing and related packages.
• Data Infrastructure Knowledge : Deep understanding of SQL and analytical data warehouses (Snowflake, Redshift preferred) with proven experience implementing ETL / ELT best practices at scale.
• Pipeline Management : Hands on experience with data pipeline tools (Airflow, dbt) and strong ability to optimise for performance and reliability.
• API Development Experience : Ability to design and develop robust data APIs and services that expose data to applications, bridging analytical and operational systems.
• Data Modelling : Strong data modelling skills and familiarity with the Kimball methodology to create efficient, scalable data structures.
• Quality Focus : Commitment to continuously improving product quality, security, and performance through rigorous testing and code reviews.
• Documentation : Meticulous approach to creating and maintaining architecture and systems documentation.
• Collaborative Mindset : Ability to work across teams to understand and address diverse data needs while maintaining data integrity.
• Growth Orientation : Desire to continually keep up with advancements in data engineering practices and technologies.
• Problem-Solving : Exceptional analytical skills to troubleshoot complex data issues and implement effective solutions.
• Independence : Capability to ship medium features independently while contributing to the team's overall objectives.

What you’ll be doing in the role

Why Prolific is a great place to work

We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioral data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.

We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviors into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation – one that reflects the breadth and the best of humanity.

Working for us will place you at the forefront of AI innovation, providing access to our unique human data platform and opportunities for groundbreaking research. Join us to enjoy a competitive salary, benefits, and remote working within our impactful, mission-driven culture.

J-18808-Ljbffr