Talent.com
Kerridge Commercial Systems
Applied AI Engineer – Prompting & EvaluationKerridge Commercial Systems • Nottingham, Nottingham, England, GB
Applied AI Engineer – Prompting & Evaluation

Applied AI Engineer – Prompting & Evaluation

Kerridge Commercial Systems • Nottingham, Nottingham, England, GB
30+ days ago
Job type
  • Full-time
  • Permanent
Job description

"At Klipboard we've introduced a flexible hybrid work policy, where employees spend three days in the office and two days working from home. This approach promotes a balanced work environment that combines office collaboration with the comfort and convenience of remote work."

Klipboard provides specialist software, services and support to deliver fully integrated trading and business management solutions to companies in the distributive trade – wherever they are in the world. With a unique depth of knowledge and experience in ERP/SaaS solutions, Klipboard has a wide range of clients includes wholesalers, distributors, merchants and retailers from small traders to multinational enterprises. Klipboard has offices in the UK, Ireland, The Netherlands, South Africa, Kenya and North America. Our mission is simple: to design and deliver high performance, integrated ERP solutions that enable our distributive trade customers to source effectively, stock efficiently, sell profitably and service competitively.

Klipboard is a global, growing business that embraces AI and emerging technologies to enhance customer outcomes, collaboration, and continuous improvement. We’re looking for people who are curious about or fluid with AI, open to change, and excited to learn how technology can improve the way we work and help our customers which is always supported by strong human insight and communication.

A hands-on building role: taking AI features from idea to shipped, working software quickly, inside real products that real businesses depend on. You design prompts, manage context, integrate models, build evaluations and handle the plumbing and the polish – all of it.

Crucially, most of this work happens in established C# .NET codebases, not greenfield projects. Klipboard's products have been earning their keep for years, and the job is landing modern AI capability inside them cleanly, without breaking what already works. Fast matters here, but fast with evidence – every AI feature needs evaluation behind it before customers see it. We would rather you shipped something measured and honest this sprint than something perfect next quarter.

Key Responsibilities:

Role Accountabilities

  • Build AI features quickly and properly – from prompts and context design through to full LLM integration in established C# .NET codebases.
  • Make them production-grade – error handling, fallbacks, latency management, logging, monitoring and solid evaluation before anything reaches a customer.
  • Stay sharp and share as you go – keeping up with a fast-moving space and spreading knowledge through code, examples and conversation.

Key Activities and Contributions

  • Design and build prompts, context strategies and LLM integrations for product features, in domains where a confidently wrong price, part match or stock answer is worse than no answer.
  • Work primarily in C# .NET, integrating AI capability into established codebases through clean service boundaries, sensible abstractions and respect for the code that is already there.
  • Move fast on real deadlines – prototype in days, harden in weeks, and know the difference between a corner that can be cut and one that cannot.
  • Build evaluation alongside the feature, not after it – test against real business cases, measure quality honestly, and let the numbers settle arguments.
  • Handle the unglamorous parts well: error handling, fallbacks when a model misbehaves, latency, token cost, logging and monitoring.
  • Work with the engineers who own each codebase, fitting in with their patterns and pipelines rather than parachuting in something nobody else can maintain.
  • Keep up as models, tools and providers change, and choose pragmatically on quality, cost and latency rather than habit.
  • Share what you learn with engineers around you through code, examples and conversation.
  • Work with product managers, product owners and subject matter experts to understand the business problem properly, because the best prompt cannot rescue a misunderstood requirement.

Systems, Tools and Technology

  • C# .NET (primary development language)
  • Large language model APIs across multiple providers
  • AI coding tools: GitHub Copilot, Cursor or equivalents
  • Prompt engineering and context design patterns
  • Retrieval-augmented generation (RAG), vector search, embeddings (desirable)
  • Evaluation frameworks and automated quality pipelines for AI outputs

Technical and Professional Expertise

  • Solid production experience with C# .NET, including working in established codebases you did not write, and shipping changes into them safely.
  • Hands-on experience building with large language models: prompt design, context engineering and structured outputs, in real work rather than tutorials.
  • A track record of shipping quickly, with examples of taking something from idea to working software in weeks rather than quarters.
  • Experience testing or evaluating LLM outputs in some structured way, and using the results to improve quality.
  • Daily fluency with AI coding tools such as GitHub Copilot, Cursor or equivalents.

Core Responsibilities and Contributions

  • Deliver AI features end-to-end: from requirement understanding through to shipped, evaluated product capability.
  • Maintain production-grade quality: error handling, fallbacks, latency management, logging and monitoring – an AI feature is production software, with extra ways to fail.
  • Care about accuracy, safety and data handling – customers run their businesses on the answers our software gives them.
  • Leave things better documented than you found them, so the next engineer can pick up your work without an archaeology project.
  • Prototype fast, harden properly, and know the difference between a corner that can be cut and one that cannot.

Customer Experience

  • Ensure AI features deliver accurate, trustworthy answers – a confidently wrong price, part match or stock answer is worse than no answer at all.
  • Understand the business problem behind each feature, not just the technical solution.
  • Work with product managers and subject matter experts to ensure AI capability genuinely serves customer needs.

Key Outcomes and Activities

  • AI capability shipped into at least one established product with evaluation behind it within the first six months.
  • Something built has gone from idea to customers in weeks, and held up in production.
  • Evaluation results have changed at least one decision, including, ideally, killing something that was not good enough to ship.
  • Engineers around you have picked up techniques from your work, even though teaching is not your primary job.
  • You can explain the business problem behind each feature you have built, not just the technical solution.

People, Collaboration & Culture

  • Bias to action – would rather build the small version today and learn from it than plan the big version for a month.
  • Honest about quality – measures, shows working, and does not ship something they would not stand behind.
  • Respectful of existing code and the engineers who maintain it – established systems are established for a reason, and working well within them is a skill you are proud of.
  • Curious about the trades Klipboard's customers work in, because domain detail is where the good prompts come from.
  • Comfortable with change – the tools will look different in six months, and that suits you fine.

Additional Responsibilities (as aligned to company job architecture)

  • Leave documentation in better shape than you found it so the next engineer can pick up your work without needing to ask.
  • Contribute to shared knowledge and engineering standards as the team's AI practice matures.

Key Relationships (Internal and external)

Internal

  • Product managers and product owners (requirement understanding and feature scoping)
  • Engineering teams who own the established codebases you build into
  • Subject matter experts in Klipboard's product verticals (distributive trades, rental, automotive)
  • Senior Applied AI Engineer and R&D engineering leadership

External

  • LLM platform and tooling providers (as needed)

Required Qualifications and Experience

  • Solid production experience with C# .NET, including working in established codebases you did not write, and shipping changes into them safely.
  • Hands-on experience building with large language models: prompt design, context engineering and structured outputs, in real work rather than tutorials.
  • A track record of shipping quickly, with examples of taking something from idea to working software in weeks rather than quarters.
  • Experience testing or evaluating LLM outputs in some structured way, and using the results to improve quality.
  • Daily fluency with AI coding tools such as GitHub Copilot, Cursor or equivalents.

Preferred Qualifications and Experience

  • Retrieval-augmented generation, agentic workflows, tool use, vector search or embeddings in production settings.
  • Experience with LLM APIs across more than one provider, with a feel for their trade-offs.
  • Exposure to any of Klipboard's sectors: distributive trades, rental, retail, automotive aftermarket parts or garage management.
  • Experience modernising or extending long-lived systems, in .NET or elsewhere.
  • Familiarity with evaluation frameworks, test datasets or automated quality pipelines for AI outputs.
  • Klipboard is embracing AI at pace across our products and ways of working. We’re looking for people who are curious about how AI can enhance productivity, decision-making and customer outcomes, and who are open to learning and adapting as this space evolves.

What Success in This Role Looks Like

  • AI capability shipped into at least one established product, with evaluation behind it, and the team that owns that codebase is happy to have you back.
  • Something you built has gone from idea to customers in weeks, and held up in production.
  • Your evaluation results have changed at least one decision, including, ideally, killing something that was not good enough to ship.
  • Engineers around you have picked up techniques from your work, even though teaching is not your primary job.
  • You can explain the business problem behind each feature you have built, not just the technical solution.

Company Info

You may also have seen from our recent posts that we are excited to begin sharing our new company name – Klipboard. Kerridge Commercial Systems (KCS) is becoming Klipboard and our new brand is designed to bring together our expertise across distribution, automotive, retail, rental, transport management, manufacturing, and field service management. We have offices based across the world and we are looking for talented individuals to join our growing teams. Due to our growth over the last few years it is an exciting time to join us as we enter our next chapter! At Klipboard we've introduced a flexible hybrid work policy, where employees spend three days in the office and two days working from home. This approach promotes a balanced work environment that combines office collaboration with the comfort and convenience of remote work."

Equal Opportunities

As a global company, we value and respect the diversity of our workforce, aiming to empower everyone to embrace each other's differences. We are committed to creating an inclusive workplace where diversity, equity, and inclusion are integral to our company and culture. We recognize the benefits of a diverse workforce, where creativity and valuing differences enable us all to thrive and sparks innovation.

If you require any help, adjustments and/or support during the interview and offer process then please advise our TA or HR team.

Research shows that women and other underrepresented groups are less likely to apply for a role unless they meet every listed requirement. However, we recognise that skills and experience come in many forms, and we encourage you to apply even if you don’t meet every criterion. If you are passionate about this role and believe you have the right mindset and transferrable skills, we would love to hear from you!

To all recruitment agencies: Klipboard does not accept agency speculative resumes. At present we only accept CV’s from Agencies on our PSL who have been assigned specific position/s. Please do not forward resumes to our careers site or direct to Klipboard employee as this does not constitute an introduction and Klipboard retrospectively will not be liable for any candidate ownership or fees related to unsolicited resumes.

#LI-Hybrid

Create a job alert for this search

Applied AI Engineer – Prompting & Evaluation • Nottingham, Nottingham, England, GB

Similar jobs

Full Stack Engineer (Ai Startup) - €100.000 - €160.000 A Year - Remote

Oliver BernardOadby, United Kingdom Of Great Britain And Northern Ireland, UK
Remote
Full-time

Full Stack Engineer to build end-to-end features for an AI/cybersecurity startup.Requires 6+ years experience with Python, React, and TypeScript. Show more

 • Promoted

Machine Learning Engineer - £50,000 A Year

ArrowsWigston Magna, United Kingdom Of Great Britain And Northern Ireland, UK
Full-time

Building AI models for document understanding, knowledge graphs, and data extraction.Develop generative AI systems for research. Show more

 • Promoted

Machine Learning / MLOps Engineer

United States Digital Space LLCNottingham, England, United Kingdom
Full-time

Location: Chattanooga, TN ( onsite ).Company: the company is the modern marketplace & intelligence platform for trading cards.Note: The provided text contains multiple postings and generic placehol... Show more

 • Promoted

Forward Deployed Engineer - €130.000 - €200.000 A Year - Remote

ImmersumWigston Magna, United Kingdom Of Great Britain And Northern Ireland, UK
Remote
Full-time

Senior Software Engineer to build AI solutions, lead client engagements, and mentor teams. Show more

 • Promoted

Remote AI Quality Analyst: Personalization & Evaluation

TuringNottingham, England, GB
Remote
Full-time

Turing is seeking an AI Quality Analyst to evaluate a new personalization feature for Gemini.In this role, you will assess how well the AI utilizes personal data from various Google services to gen... Show more

 • Promoted

AI & Data Lead - #3487557

Dynamic Search SolutionsNottingham, England, GB
Full-time

North West (Onsite 4 days a week).We are seeking a highly skilled AI & Data Lead to spearhead our transformation into a truly data-driven organisation.This individual will define our AI and analyti... Show more

 • Promoted

Engineering Manager - Ai Agents & Platform - £120,000 - £140,000 A Year - Remote

HowrecruitOadby, United Kingdom Of Great Britain And Northern Ireland, UK
Remote
Full-time

Engineering Manager to lead the development and deployment of AI agents in production, focusing on customer outcomes and platform improvements. Show more

 • Promoted

Machine Learning Engineer - Up To £100,000 A Year - Remote

Mekion ConsultingOadby And Wigston, United Kingdom Of Great Britain And Northern Ireland, UK
Remote
Full-time

Machine Learning Engineer specializing in NLP to build and refine AI-powered design platform.Develops NLP algorithms, works with unstructured data, and collaborates with cross-functional teams. Show more

 • Promoted

AI Engineering Lead

IdeagenNottingham, England, GB
Full-time

Salary – To be discussed at next stage.Mazlan is Ideagen’s intelligent workspace – a unified AI layer that enhances how professionals in regulated industries operate day to day.AI Engineering Lead ... Show more

 • Promoted

Solutions Consultant – Rental Systems & AI Demos

KlipboardNottingham, England, GB
Full-time

Klipboard in Nottingham is seeking a Solutions Consultant to join their Rental Sector team.This role involves building and presenting software demonstrations and working closely with sales and cons... Show more

 • Promoted

Senior Product Engineer - Ai, Data, Cloud (Innovation Labs) - £70,000 - £80,000 A Year - Remote

Serve LegalWigston Magna, United Kingdom Of Great Britain And Northern Ireland, UK
Remote
Full-time

The Senior Product Engineer will be developing digital products and AI Agents with a focus on AI tooling and cloud-native environments. Show more

 • Promoted

Machine Learning Engineer - Up To £90,000 A Year - Remote

HarnhamOadby And Wigston, United Kingdom Of Great Britain And Northern Ireland, UK
Remote
Full-time

Develop, deploy, and maintain machine learning models for a remote gaming and entertainment business.Collaborate with data scientists and engineers to optimize ML systems. Show more

 • Promoted

Senior System Engineer (Ai/Ml) - Up To £82,500 A Year

ComputappointOadby And Wigston, United Kingdom Of Great Britain And Northern Ireland, UK
Full-time

Experienced System Engineer needed to deploy and maintain an AI/ML platform.Responsibilities include platform support and documentation. Show more

 • Promoted

Principal AI Engineer

VenturEd SolutionsLeicester, England, GB
Full-time

This hybrid role blends 80% hands-on technical leadership—building, deploying, and optimising AI systems across our product suite—with 20% evangelism and enablement, partnering with Marketing, Sale... Show more

 • Promoted

Senior Data Engineer — AI-Ready Data Pipelines

MicroliseNottingham, England, GB
Temporary

Microlise seeks a Senior Data Engineer for a 12-month fixed-term contract in Nottingham, UK.You will design and manage data pipelines and products, enabling analytics and AI teams to unlock value w... Show more

 • Promoted

AI-Enabled Digital Transformation Leader

University of LeicesterLeicester, England, GB
Full-time

The University of Leicester is seeking a Chief Digital and Information Officer to drive the transformation of digital services across a complex, research‑led university.You will lead a multi-discip... Show more

 • Promoted

AI Transformation Director — Data Sciences

Quotient SciencesNottingham, England, GB
Full-time

Quotient Sciences is looking for a Director of AI Transformation to drive AI-enabled solutions across Data Sciences in Nottingham.This pivotal role requires shaping a clear AI product strategy and ... Show more

 • Promoted

AI Consultant

NLP PEOPLELeicester, England, GB
Full-time

AI Consultant – Up to £110,000 + bonus + package An exciting opportunity has arisen for an AI Consultant to join a growing technology consultancy business delivering next-generation AI solutions in... Show more

 • Promoted

Machine Learning Engineer - £650 - £750 A Day - Remote

Edison SmartOadby, United Kingdom Of Great Britain And Northern Ireland, UK
Remote
Temporary

Machine Learning Engineer sought for a 6-month contract to build and deploy ML models in a Financial Services environment. Show more

 • Promoted

Shift Engineer

OrionLeicester, ENG, GB
Full-time +1

Full-time, Permanent (4 on 4 off shift pattern Days & Nights).A motivated and skilled Engineer is required to support the maintenance and continuous improvement of site equipment and operations... Show more