Talent.com
Reconomy
Data Pipeline ManagerReconomy • Warwickshire, England, UK
Data Pipeline Manager

Data Pipeline Manager

Reconomy • Warwickshire, England, UK
27 days ago
Job type
  • Full-time
Job description
As the UKs leading provider of environmental compliance Valpak strives to work together towards a profitable sustainable waste-free world. To date our teams work in partnership with more than 400 customers in nearly every corner of the globe. Valpak contributes to achieving the mission of Reconomys complete global compliance offering Comply Loop. Solving increasingly complex environmental regulatory challenges using data expert local knowledge and through leadership to drive business accountability across the globe. Our core values drive everything we do. We believe in promoting a supportive environment for our colleagues delivering exceptional service to our customers contributing to the community and working towards a more sustainable environment. If you share these values and are passionate about making a positive impact wed love to have you on our team.

About the role


As the Data Pipeline Manager you will lead a team responsible for building and maintaining scalable reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data workflows ensuring high data quality and availability across systems such as Qlik and our central databases. Collaborating with data stewards analysts and support teams you will guide the implementation of best practices in data integration transformation and validation. This role is critical in ensuring the stability and performance of data operations that underpin business insights and application functionality.

The Valpak Data Insights (VDI) department regularly receive data files from their customers systems with regards to Product and transactional data. This data is transformed and loaded into our database using an inhouse built application. VDI will be migrating to the Qlik Talend ETL software on the customer files to load data into our databases.

Responsibilities: Liaise with VDI and IT to allow the smooth transition of data through Qlik Talend
  • Put a structure in place to create an environment for Qlik Talend and GitHub to allow easy development of pipelines
  • Ensure that Qlik Talend Developers are allocated suitable well-defined requirements.
  • Act as a point of escalation for any Qlik Talend questions.
  • Make sure that the Qlik environment is running and that automated pipelines can be ran.
Generate and consistently improve Qlik Talend pipelines
  • Create and maintain pipelines for each customers data.
  • Create a reusable toolkit of code for validation and transformations that can be used by other customers
  • Generate automated validation checks on the received data so that it can be handled more efficiently before loading into the database.
  • Become an expert in using the Qlik Talend Studio software so that any data transformations requested by the business can be performed.
  • Use Java code to perform advanced manipulation of the data
  • Integrate Apis into the Talend Studio
  • Keep up to date with improvements in the Qlik Talend Studio to improve data handling.
Ensure standards are maintained
  • Make sure that data is handled correctly by Qlik Talend and that poor data is not loaded into the Database.
  • Use GitHub to allow source control of the created pipelines.
  • Implement Qlik Talend with Data Streams
Liaise with Account Managers to make sure that pipelines can process the data received from Customers
  • Liaise with business to understand customer requirements and to keep the business informed of pipeline progress.
  • Provide feedback to users about the quality of the customers data.
  • Establish and maintain a data stewardship model that works for the operational team

What we need from you


  • Management experience
  • Excellent written and verbal communication skills
  • Great attention to detail
  • Excellent organisational skills.
  • Strong analytical and problem-solving abilities
  • Experience using Microsoft packages including Excel
  • Knowledge of ETL tools and data pipelines SQL Java and GitHub is required
  • Applicants should be educated to degree level or possess solid work experience in related field.

What we offer


  • Dual Location / Hybrid worker Status
  • Participation in our annual Incentive Plan (VIP)
  • 25 days annual leave plus bank holidays volunteering day and your birthday off!
  • Option to buy and sell up to 9 days annual leave
  • Access to voluntary benefits including private medical insurance cycle to work scheme and subsidised gym membership
  • Automatic inclusion in Life Assurance Critical Illness and Disability Income protection schemes
  • Pension scheme up to 8% employer contribution
  • Access to reward & discount platform
  • Wellbeing initiatives






Required Experience:

Manager


Employment Type : Full-Time
Experience: years
Vacancy: 1
Create a job alert for this search

Data Pipeline Manager • Warwickshire, England, UK

Similar jobs

Data Platform Architect — Lakes, Pipelines & Fabric Migration

Stanton HouseEngland, GB
Full-time

Stanton House is seeking a Data Engineer to take ownership of data architecture for a global distributor of safety products.You will design and build robust data foundations, aligning with plans to... Show more

 • Promoted

Geospatial Data Delivery Manager - Hybrid & QA Leader

Tailored Talent LtdEngland, GB
Full-time

Tailored Talent Ltd in the West Midlands is recruiting a Data Delivery Manager to oversee the geospatial and CAD data outputs for major infrastructure projects.You will lead a small survey team, en... Show more

 • Promoted

Senior Data Engineer: Build Scalable Pipelines & Insights

Norton BlakeEngland, GB
Full-time

A leading data services provider in the United Kingdom is seeking a Senior Data Engineer to design and build data infrastructure that enhances decision-making.The role requires strong Python skills... Show more

 • Promoted

Delivery Lead, Tech & Data Programs (Hybrid)

Morson Human Resources LimitedEngland, GB
Temporary

Morson Human Resources Limited is recruiting a Lead Delivery Manager on a six-month contract based in London.The role leads end-to-end delivery of large technology and data programmes, coordinating... Show more

 • Promoted

Remote Data Engineer – Analytics & ELT Pipelines

OTA RecruitmentEngland, GB
Remote
Full-time

A specialized sports analytics firm is seeking a Data Engineer to design and optimize analytics workflows.This role requires proficiency in SQL and Python for data modeling and transformation, alon... Show more

 • Promoted

Senior Data Engineer — Investment Operations & Analytics

Synchronicity GroupEngland, GB
Full-time

A UK investment management firm is seeking a Senior Data Engineer to enhance its data function and deliver high-quality insights for institutional clients.This mid-senior role involves developing d... Show more

 • Promoted

Data-Driven Space & Range Analytics Specialist

Pets at HomeEngland, GB
Full-time

Pets at Home is seeking a data analyst to support space optimization and range analysis, analysing large data sets, building dashboards, and translating insights into recommendations for stores.The... Show more

 • Promoted

Data Pipeline Engineer - Azure Databricks & SQL Spark

MicrosoftWitherley, England, GB
Full-time

Microsoft is seeking a Data Engineer based in Witherley, England, to build and improve data pipelines using SQL, Python, Spark, and Azure tools.This contract position focuses on creating high-quali... Show more

 • Promoted

Senior Data Engineer: Design & Scale Data Pipelines

CFP EnergyEngland, GB
Full-time

An innovative energy firm in the UK is seeking a Senior Data Engineer to design, build, and scale their data infrastructure.In this mid-senior level role, you'll work closely with developers and an... Show more

 • Promoted

Data Engineer for Quant Trading Data Pipelines

Paragon Alpha - Hedge Fund Talent BusinessEngland, GB
Full-time

A global quantitative hedge fund is seeking a Data Engineer to support their systematic trading efforts in the United Kingdom.This role involves developing and managing ETL pipelines, integrating v... Show more

 • Promoted

Senior Manager, Workforce Planning & Data Analytics

AvantorLeicester Forest East, ENG, GB
Full-time

Avantor is a leading global provider of mission-critical products and services to the life sciences and advanced technology industries, working side-by-side with customers at every step of the scie... Show more

 • Promoted • New!

Data Workstream Lead: ERP & Analytics Transformation

La FosseEngland, GB
Full-time

A well-established charity organization in England seeks a Data Workstream Lead to oversee data delivery in a large-scale ERP transformation.This role involves managing data migration, establishing... Show more

 • Promoted

Customer Data & Analytics Leader — Hybrid, Strategic Impact

Agora TalentEngland, GB
Full-time

Agora Talent is seeking an experienced Head of Customer Data & Analytics for a successful multi-brand consumer business with a strong eCommerce presence.You will lead the data platform, customer in... Show more

 • Promoted

Senior Data Engineer — Azure Data Platform & Pipelines

ASOSEngland, GB
Full-time

ASOS is looking for a Senior Data Engineer to design and implement scalable data pipelines and platform components in a cloud-based environment.You will collaborate with various product teams to en... Show more

 • Promoted

Data Business Partner

StonewaterEngland, GB
Full-time

At Stonewater, we believe in the power of data to shape decisions, drive performance, and deliver better outcomes for our customers and communities.We’re investing in our data capability—and we’re ... Show more

 • Promoted

Senior Tech Sales Director - Data, AI & Cloud Growth

Carter MurrayEngland, United Kingdom
Full-time

Carter Murray is partnered with a leading data, AI and cloud consultancy to recruit a high-calibre Sales Director.Reporting to the Partner, this role will drive revenue growth by expanding both new... Show more

 • Promoted

AWS Data Migration Program Manager – Banking Analytics

Savant RecruitmentEngland, GB
Full-time

A leading recruitment agency is seeking a Programme Manager with experience in large scale data migration projects from legacy systems to AWS Data Platform.The ideal candidate should have managed s... Show more

 • Promoted

Impact Data & Analytics Engineer – Hybrid London

KDR Talent SolutionsEngland, GB
Full-time

A pioneering organization in data analytics is seeking a Data & Analytics Engineer to lead in shaping their data function.This mid-senior level role focuses on building analytic data platforms and ... Show more

 • Promoted

Remote Snowflake Data Engineer – Python, ETL & SQL

AkkodisEngland, GB
Remote
Full-time

A leading tech company in the UK seeks a Snowflake Data Engineer to work on their AI-driven SaaS platform.The role involves designing ETL processes, managing data models, and ensuring high standard... Show more

 • Promoted

Strategic Network Design Lead: Data-Driven Growth

EvriRugby, England, GB
Full-time

Evri Group in the UK is seeking an analytical Network Design Manager to shape the hub and depot network, leading capacity planning and cost optimisation.This role focuses on turning data into actio... Show more