Machine Learning

Job Title: Machine Learning Developer
Location: Sheffield
Salary/Rate: £500-£550 a day
Start Date: 25th May
Job Type: Contract - 8 months

Our client, a leader in AI-driven IT solutions, is seeking an AI Knowledge Engineer to develop the knowledge, retrieval, and evaluation layer that enables their AI helpdesk to provide accurate, safe, and reliable answers.

Role Overview:
In this role, you will be responsible for designing and maintaining the pipelines, indexing, and evaluation systems that allow AI models to efficiently access and utilize IT knowledge. Your work will directly impact answer quality, task completion, and overall system reliability.

Key Responsibilities:

• Build and maintain data pipelines for IT knowledge articles, SOPs, ticket history, and troubleshooting content.
• Develop RAG pipelines, embeddings, and retrieval optimization.
• Improve response quality using chunking, ranking, filtering, and grounding techniques.
• Create evaluation datasets and automated quality tests to measure accuracy, hallucinations, and task completion.
• Support model selection, tuning, and performance benchmarking.
• Collaborate with engineering teams to enhance response quality and reduce failure rates.

Required Skills & Experience:

• Strong Python and data engineering expertise.
• Experience in data quality testing and validating LLM outputs.
• Knowledge of vector databases, embeddings, and retrieval systems.
• Experience building ETL/data pipelines for structured and unstructured data.
• Understanding of LLM evaluation, experimentation, and performance metrics.
• Familiarity with SQL, APIs, and cloud platforms (AWS preferred; GCP exposure a plus).

Preferred:

• Experience with enterprise knowledge systems and IT ticket datasets.

Why This Role:
This is a unique opportunity to work at the forefront of AI-driven IT support, shaping the systems that power intelligent, efficient, and reliable helpdesk solutions.

Disclaimer
Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.
Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.