Talent.com
Tech Mahindra
Senior AWS Data EngineerTech Mahindra • London Area, United Kingdom, United Kingdom
No longer accepting applications
Senior AWS Data Engineer

Senior AWS Data Engineer

Tech Mahindra • London Area, United Kingdom, United Kingdom
27 days ago
Job type
  • Full-time
Job description

About Us:

Tech Mahindra offers technology consulting and digital solutions to global enterprises across industries, enabling transformative scale at unparalleled speed. With 149k+ professionals across 90+ countries helping 1100+ clients, TechM provides a full spectrum of services including consulting, information technology, enterprise applications, business process services, engineering services, network services, customer experience & design services, AI & analytics, and cloud & infrastructure services. It is the first Indian company in the world to have been awarded the Sustainable Markets Initiative’s Terra Carta Seal, in recognition of actively leading the charge to create a climate and nature-positive future. Tech Mahindra (NSE: TECHM) is part of the Mahindra Group, founded in 1945, one of the largest and most admired multinational federations of companies.


Job Details

  • Should be able to Develop and write telecom network performance data parsers in for multiple file formats (XML, ASN.1) & convert into an acceptable Parquet columnar output. Knowledge & experience of Iceberg Table format is preferred.
  • Implement Lambda functions triggered by S3 event notifications via SQS queues for high‑throughput parsing.
  • Build & implement code for robust error handling with retries, DLQ, and SNS notifications
  • Build a schema management in line with vendor mapping files & write code for updating the schema dynamically with addition of new counters to an extent of automating it.
  • Support schema deployment, upgrades, and rollback processes not including user configurations for ignoring counters, grouping overrides, dimension preservation, and counter name mappings.
  • Handle schema upserts and merges to simultaneously insert new records and update existing ones.
  • Own the end‑to‑end lifecycle of schemas including versioning, updates, and retirement.
  • Thorough knowledge of writing building audit logging and metadata in DynamoDB & forwarding the details via CloudWatch
  • Should be able to understand the 15 / 60 PM counter granularity and able to write codes for aggregation
  • Build and optimize distributed data processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse
  • Work with Amazon MSK (Kafka) for real‑time data ingestion and streaming.
  • Automate pipeline orchestration with AWS Step Functions.
  • Ensure schemas are aligned with vendor (OEM) specifications and business requirements.



How To Apply:

It's easy to apply online; you just need a copy of your up-to-date CV and to follow the step-by step process. Don't worry if you need to make changes - you'll have the opportunity to review and edit your work on the final page, or you can also share resume directly to provided email address. We look forward to receiving your application!


Tech Mahindra is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions.

Create a job alert for this search

Senior AWS Data Engineer • London Area, United Kingdom, United Kingdom

Similar jobs

Cloud Data Engineer: Serverless Pipelines on GCP/AWS

Marketing Management Analytics, Inc.Greater London, England, GB
Full-time

Ipsos is recruiting a Data Engineer to evolve our Audience Measurement data platforms using cloud-native, serverless patterns.You will join a team focused on managed cloud services, cost-conscious ... Show more

 • Promoted

Senior DevOps Engineer - AWS, Terraform & Kubernetes

Stanford Black LimitedGreater London, England, GB
Temporary

A global-leading investment management firm is seeking a DevOps Engineer for a 12-month contract in London.The role includes responsibilities such as building AWS infrastructure, managing Terraform... Show more

 • Promoted

AWS Data Engineer

Technopride LtdGreater London, England, GB
Full-time

London, United Kingdom | Posted on 24/11/2025.We provide end-to-end IT solutions and services including Applications services, Data & Analytics services, AI/ML Technologies and Professional service... Show more

 • Promoted

Senior AWS Platform Engineer: Lead Cloud Foundations & CI/CD

Prism DigitalGreater London, England, United Kingdom
Full-time

A growing cloud consultancy in the UK is hiring Senior and Principal AWS Platform Engineers to design and build innovative AWS platforms for enterprise clients.This hands-on consulting role offers ... Show more

 • Promoted

Senior Data Engineer (Hybrid) - AWS, Snowflake, Python

Falcon Smart IT (FalconSmartIT)Greater London, England, GB
Full-time

Falcon Smart IT (FalconSmartIT) is seeking a skilled professional for a hybrid position in London focused on architecting and developing data systems.The role demands 12+ years of Python experience... Show more

 • Promoted

Senior Platform Engineer — AWS, Kubernetes & Terraform

developGreater London, England, GB
Full-time

A fast-growing Fintech company in Central London is seeking a talented Platform Engineer to design and maintain their AWS infrastructure, driving Infrastructure as Code with Terraform.This role dem... Show more

 • Promoted

Data Platform Engineer – AWS Databricks (Hybrid)

AltoGreater London, England, GB
Full-time

Alto Software Group, a UK-based B2B SaaS company powering housing transactions, is seeking a Data Platform Engineer to scale its data lakehouse, build data-driven products, and create reusable buil... Show more

 • Promoted

Senior Data Engineer - Agents Systems

KrakenGreater London, England, GB
Full-time

Building the Future of Open Finance Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the ... Show more

 • Promoted

Senior Data Engineer: Data Warehousing & Pipelines (AWS)

Jobs for LebanonGreater London, England, GB
Full-time

A digital asset service provider in the UK is seeking an experienced Data Engineer to design, build, and maintain their data infrastructure.The ideal candidate should have a strong background in da... Show more

 • Promoted

Senior Cloud Engineer (Remote) — AWS Platform Lead

Space ExecutiveLondon, England, GB
Remote
Full-time

A leading technology startup in London is looking for a Senior Cloud/AWS Engineer to own the cloud platform strategy.You will architect and secure AWS infrastructure, drive automation, and collabor... Show more

 • Promoted

Senior DevOps AWS Engineer

AEVIGreater London, England, GB
Full-time

At Aevi, we're not just a team; we're a vibrant, global community, committed to shaking up the payments industry.Our culture is all about innovation, creativity, and a passion for pushing boundarie... Show more

 • Promoted

Senior MLOps Engineer: AWS AI Platform (On-site London)

Talenzon groupGreater London, England, United Kingdom
Temporary

Talenzon group is seeking a Senior MLOps Engineer to join our London-based on-site team for a 6-month contract.You will design and implement an enterprise MLOps platform on AWS, deploy production-r... Show more

 • Promoted

AWS Senior Platform Engineer

Appvia Ltd.Greater London, England, GB
Full-time +1

London, UK (Hybrid – typically ~1 day per week in office/on-site).Appvia is a specialist cloud and platform engineering consultancy and product house helping organisations build, secure, and scale ... Show more

 • Promoted

Senior Data Engineer

RJC GroupGreater London, England, GB
Full-time

RJC is looking for a Data Engineer to join an Energy Trading client of ours based in London.This is a great opportunity to join a team responsible for large volume data and making a direct impact o... Show more

 • Promoted

Senior Data Engineer - AWS

CapcoGreater London, England, GB
Permanent

Engineer future-ready data platforms that power financial transformation.We’re looking for a Senior Data Engineer with AWS to join our growing team of engineering experts driving next-gen transform... Show more

 • Promoted • New!

Senior AWS Platform Engineer

CACI LtdGreater London, England, GB
Full-time

Due to the industries we work in, we require the successful candidate to be able to obtain high level security clearance.To qualify for this, you must be a British citizen and have lived permanentl... Show more

 • Promoted

Senior Cloud Platform Engineer (AWS/GCP)

EnsonoGreater London, England, GB
Full-time

About the role and what you will be doing:.This is an exciting opportunity to join a small , friendly, Agile-based, team working on some of the hottest public cloud technologies.The Public Cloud Pr... Show more

 • Promoted

AWS Data Engineer

UBDS DigitalGreater London, England, GB
Full-time

Rayo, part of the UBDS Group, is seeking highly skilled, security‑cleared AWS Data Engineers at all levels to design, build, and maintain scalable data pipelines and infrastructure using AWS‑native... Show more

 • Promoted

Senior Data Platform Engineer | Azure, Databricks, PySpark

ASOS.comGreater London, England, GB
Full-time

Senior Data Engineer to design and implement scalable data pipelines within their Azure ecosystem.The role involves working with Data Scientists and Engineers to optimize data workflows while mento... Show more

 • Promoted

Senior Data Engineer

Harrington StarrGreater London, England, GB
Full-time

Join a fast-growing, global investment firm and play a pivotal role in shaping its next-generation data platform.This is a hands-on, high impact role where your work will directly influence investm... Show more