Data Engineer

Data Engineer
Remote (Occasional Travel to Letchworth office)
£50,000 - £55,000 per annum + benefits
Permanent

Do you want to build a data platform from the ground up rather than inherit someone else's? This Data Engineer role puts you at the start of a new Azure data platform for a well-established UK group with several businesses under one roof.

You'll join a small team of data engineers and own work end to end: talking to stakeholders, designing models, building and testing pipelines in Python and PySpark, and supporting BI. It's essentially remote, and the platform will grow from one business to the whole group, so there's plenty to get your hands on.

What You'll Be Doing

• Gathering requirements with data, product and senior stakeholders, and helping them with data-related technical issues
• Designing conceptual, logical and physical data models for the new platform
• Building metadata-driven pipelines across Azure Synapse, Data Factory and PostgreSQL using Python and PySpark
• Migrating data from legacy reporting solutions onto the platform while protecting data integrity
• Releasing code through Azure DevOps and Git, and keeping documentation and data mapping up to date
• Monitoring and tuning data loads, supporting BI users, and joining an out-of-hours rota for business-critical issues

What ...