Talent.com
Reconomy
Data Pipeline ManagerReconomy • Warwickshire, England, UK
Data Pipeline Manager

Data Pipeline Manager

Reconomy • Warwickshire, England, UK
26 days ago
Job type
  • Full-time
Job description
As the UKs leading provider of environmental compliance Valpak strives to work together towards a profitable sustainable waste-free world. To date our teams work in partnership with more than 400 customers in nearly every corner of the globe. Valpak contributes to achieving the mission of Reconomys complete global compliance offering Comply Loop. Solving increasingly complex environmental regulatory challenges using data expert local knowledge and through leadership to drive business accountability across the globe. Our core values drive everything we do. We believe in promoting a supportive environment for our colleagues delivering exceptional service to our customers contributing to the community and working towards a more sustainable environment. If you share these values and are passionate about making a positive impact wed love to have you on our team.

About the role


As the Data Pipeline Manager you will lead a team responsible for building and maintaining scalable reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data workflows ensuring high data quality and availability across systems such as Qlik and our central databases. Collaborating with data stewards analysts and support teams you will guide the implementation of best practices in data integration transformation and validation. This role is critical in ensuring the stability and performance of data operations that underpin business insights and application functionality.

The Valpak Data Insights (VDI) department regularly receive data files from their customers systems with regards to Product and transactional data. This data is transformed and loaded into our database using an inhouse built application. VDI will be migrating to the Qlik Talend ETL software on the customer files to load data into our databases.

Responsibilities: Liaise with VDI and IT to allow the smooth transition of data through Qlik Talend
  • Put a structure in place to create an environment for Qlik Talend and GitHub to allow easy development of pipelines
  • Ensure that Qlik Talend Developers are allocated suitable well-defined requirements.
  • Act as a point of escalation for any Qlik Talend questions.
  • Make sure that the Qlik environment is running and that automated pipelines can be ran.
Generate and consistently improve Qlik Talend pipelines
  • Create and maintain pipelines for each customers data.
  • Create a reusable toolkit of code for validation and transformations that can be used by other customers
  • Generate automated validation checks on the received data so that it can be handled more efficiently before loading into the database.
  • Become an expert in using the Qlik Talend Studio software so that any data transformations requested by the business can be performed.
  • Use Java code to perform advanced manipulation of the data
  • Integrate Apis into the Talend Studio
  • Keep up to date with improvements in the Qlik Talend Studio to improve data handling.
Ensure standards are maintained
  • Make sure that data is handled correctly by Qlik Talend and that poor data is not loaded into the Database.
  • Use GitHub to allow source control of the created pipelines.
  • Implement Qlik Talend with Data Streams
Liaise with Account Managers to make sure that pipelines can process the data received from Customers
  • Liaise with business to understand customer requirements and to keep the business informed of pipeline progress.
  • Provide feedback to users about the quality of the customers data.
  • Establish and maintain a data stewardship model that works for the operational team

What we need from you


  • Management experience
  • Excellent written and verbal communication skills
  • Great attention to detail
  • Excellent organisational skills.
  • Strong analytical and problem-solving abilities
  • Experience using Microsoft packages including Excel
  • Knowledge of ETL tools and data pipelines SQL Java and GitHub is required
  • Applicants should be educated to degree level or possess solid work experience in related field.

What we offer


  • Dual Location / Hybrid worker Status
  • Participation in our annual Incentive Plan (VIP)
  • 25 days annual leave plus bank holidays volunteering day and your birthday off!
  • Option to buy and sell up to 9 days annual leave
  • Access to voluntary benefits including private medical insurance cycle to work scheme and subsidised gym membership
  • Automatic inclusion in Life Assurance Critical Illness and Disability Income protection schemes
  • Pension scheme up to 8% employer contribution
  • Access to reward & discount platform
  • Wellbeing initiatives






Required Experience:

Manager


Employment Type : Full-Time
Experience: years
Vacancy: 1
Create a job alert for this search

Data Pipeline Manager • Warwickshire, England, UK

Similar jobs

Senior Data Engineer — Cloud Pipelines & Data Quality

Solirius ReplyEngland, GB
Full-time

A dynamic consultancy in the United Kingdom is looking for a Senior Talent Acquisition Specialist to enhance their data engineering efforts.In this role, you will design and implement data pipeline... Show more

 • Promoted

Data Platform Architect — Lakes, Pipelines & Fabric Migration

Stanton HouseEngland, GB
Full-time

Stanton House is seeking a Data Engineer to take ownership of data architecture for a global distributor of safety products.You will design and build robust data foundations, aligning with plans to... Show more

 • Promoted

Manager - Reference Data

Attribution SearchEngland, GB
Full-time

Senior Consultant - Private Markets Search Lead.Attribution Search are supporting a leading Multi Strat Hedge Fund in their search for a Reference Data Manager to lead a small team in London with a... Show more

 • Promoted

Geospatial Data Delivery Manager - Hybrid & QA Leader

Tailored Talent LtdEngland, GB
Full-time

Tailored Talent Ltd in the West Midlands is recruiting a Data Delivery Manager to oversee the geospatial and CAD data outputs for major infrastructure projects.You will lead a small survey team, en... Show more

 • Promoted

Senior Data Engineer: Build Scalable Pipelines & Insights

Norton BlakeEngland, GB
Full-time

A leading data services provider in the United Kingdom is seeking a Senior Data Engineer to design and build data infrastructure that enhances decision-making.The role requires strong Python skills... Show more

 • Promoted

Delivery Lead, Tech & Data Programs (Hybrid)

Morson Human Resources LimitedEngland, GB
Temporary

Morson Human Resources Limited is recruiting a Lead Delivery Manager on a six-month contract based in London.The role leads end-to-end delivery of large technology and data programmes, coordinating... Show more

 • Promoted

Data Engineer: ETL & Analytics Pipelines

Electronic Arts (EA)Southam CP, England, GB
Full-time

A leading gaming company in Southam is seeking an experienced Data Engineer.The role involves developing scalable data pipelines, improving ETL processes, and working closely with product analytics... Show more

 • Promoted

Remote Data Engineer – Analytics & ELT Pipelines

OTA RecruitmentEngland, GB
Remote
Full-time

A specialized sports analytics firm is seeking a Data Engineer to design and optimize analytics workflows.This role requires proficiency in SQL and Python for data modeling and transformation, alon... Show more

 • Promoted

Senior Data Engineer — Investment Operations & Analytics

Synchronicity GroupEngland, GB
Full-time

A UK investment management firm is seeking a Senior Data Engineer to enhance its data function and deliver high-quality insights for institutional clients.This mid-senior role involves developing d... Show more

 • Promoted

Data-Driven Space & Range Analytics Specialist

Pets at HomeEngland, GB
Full-time

Pets at Home is seeking a data analyst to support space optimization and range analysis, analysing large data sets, building dashboards, and translating insights into recommendations for stores.The... Show more

 • Promoted

Data Pipeline Engineer - Azure Databricks & SQL Spark

MicrosoftWitherley, England, GB
Full-time

Microsoft is seeking a Data Engineer based in Witherley, England, to build and improve data pipelines using SQL, Python, Spark, and Azure tools.This contract position focuses on creating high-quali... Show more

 • Promoted

Senior Data Engineer: Design & Scale Data Pipelines

CFP EnergyEngland, GB
Full-time

An innovative energy firm in the UK is seeking a Senior Data Engineer to design, build, and scale their data infrastructure.In this mid-senior level role, you'll work closely with developers and an... Show more

 • Promoted

Data Engineer for Quant Trading Data Pipelines

Paragon Alpha - Hedge Fund Talent BusinessEngland, GB
Full-time

A global quantitative hedge fund is seeking a Data Engineer to support their systematic trading efforts in the United Kingdom.This role involves developing and managing ETL pipelines, integrating v... Show more

 • Promoted

Senior Data Engineer — Azure Data Platform & Pipelines

ASOSEngland, GB
Full-time

ASOS is looking for a Senior Data Engineer to design and implement scalable data pipelines and platform components in a cloud-based environment.You will collaborate with various product teams to en... Show more

 • Promoted

Data Business Partner

StonewaterEngland, GB
Full-time

At Stonewater, we believe in the power of data to shape decisions, drive performance, and deliver better outcomes for our customers and communities.We’re investing in our data capability—and we’re ... Show more

 • Promoted

AWS Data Migration Program Manager – Banking Analytics

Savant RecruitmentEngland, GB
Full-time

A leading recruitment agency is seeking a Programme Manager with experience in large scale data migration projects from legacy systems to AWS Data Platform.The ideal candidate should have managed s... Show more

 • Promoted

Impact Data & Analytics Engineer – Hybrid London

KDR Talent SolutionsEngland, GB
Full-time

A pioneering organization in data analytics is seeking a Data & Analytics Engineer to lead in shaping their data function.This mid-senior level role focuses on building analytic data platforms and ... Show more

 • Promoted

Data Engineer - Scalable Pipelines on Fabric & Databricks

EquinitiEngland, GB
Full-time

A leading international technology provider in the UK is seeking a skilled Talent Acquisition Manager to design and maintain large-scale data pipelines.The ideal candidate will have strong expertis... Show more

 • Promoted

Remote Snowflake Data Engineer – Python, ETL & SQL

AkkodisEngland, GB
Remote
Full-time

A leading tech company in the UK seeks a Snowflake Data Engineer to work on their AI-driven SaaS platform.The role involves designing ETL processes, managing data models, and ensuring high standard... Show more

 • Promoted

Data Operations & Annotation Lead (ML Training Data)

Boston DynamicsEngland, GB
Full-time

Boston Dynamics is seeking an Annotation Manager to own data quality and annotation operations for Atlas, leading the team and managing vendor relationships that supply training data for Atlas AI s... Show more