AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

413 open roles · showing 351–400

All jobs RSS feed

Search

Senior, AI & Data Science
Artefact · Montréal, Quebec, Canada
Posted 2mo agoOn-siteSeniorHugging Face RAG Embeddings LLM-as-judge
AI & Agentic Engineer, Senior
Artefact · Montréal, Quebec, Canada
Posted 2mo agoOn-siteSeniorLangChain RAG Embeddings Tool use
AI LLMOps Engineering Technical Leader
Cisco · San Jose, California, US
$216k–281k/yr
Posted 2mo agoOn-siteLangChain Multi-agent Orchestration LangSmith
Member of Technical Staff, North Modelling (Evals)
Cohere · London
CAD 250k–535k/yr
Posted 2mo agoHybridStaffTool use Eval harnesses Go
Forward Deployed Engineer (Training)
Baseten · San Francisco
$200k–400k/yr
Posted 2mo agoHybridvLLM Eval harnesses GPU TensorRT
Staff/Principal AI Software Engineer - Snowflake CoWork
Snowflake · US-CA-Menlo Park
$264k–380k/yr
Posted 2mo agoOn-sitePrincipalRAG Tool use Multi-agent Orchestration
Research Engineer (Reinforcement Learning)
LiveKit · North America
$135k–300k/yr
Posted 2mo agoRemotevLLM Eval harnesses GPU LoRA
Conversation Quality Analyst
Bolna AI · Bengaluru
Posted 2mo agoOn-siteEval harnesses LLM-as-judge Go
AI Quality Engineer
Xapien · Xapien London
Posted 2mo agoHybridEval harnesses LLM-as-judge CI/CD Python
Research Engineer – Benchmarking
Mercor · San Francisco
$200k–500k/yr
Posted 2mo agoOn-siteTool use Eval harnesses
Member of Technical Staff - Forward Deployed Engineer
Halluminate · San Francisco
$215k–275k/yr
Posted 2mo agoOn-siteStaffEval harnesses
Member of Technical Staff - RL Environments
Cohere · London
CAD 250k–535k/yr
Posted 2mo agoHybridStaffEval harnesses
Applied AI Architect, Industries
Anthropic · Munich, Germany
Posted 2mo agoOn-siteAnthropic API Eval harnesses Python
Member of Technical Staff, Enterprise Evals Platform
Mercor · San Francisco
$220k–425k/yr
Posted 2mo agoOn-siteStaffEval harnesses
Senior Forward Deployed Engineer (Gemini Enterprise)
Artefact · Montréal, Quebec, Canada
Posted 2mo agoOn-siteSeniorLangChain RAG Embeddings Tool use
Software Engineer, Applied AI
Clay · New York
$170k–300k/yr
Posted 2mo agoHybridRAG Tool use Orchestration Eval harnesses
Senior Software Engineer - Integrations 3P - Platform
Elastic · Spain
Posted 2mo agoOn-siteSeniorMCP Eval harnesses Go Rust
Senior Software Engineer - Integrations 3P - Platform
Elastic · Greece
Posted 2mo agoOn-siteSeniorMCP Eval harnesses Go Rust
Senior Software Engineer - Integrations 3P - Platform
Elastic · Ireland
Posted 2mo agoOn-siteSeniorMCP Eval harnesses Go Rust
Senior Software Engineer - Integrations 3P - Platform
Elastic · Portugal
Posted 2mo agoOn-siteSeniorMCP Eval harnesses Go Rust
Applied AI/ML Engineer
Confido · NYC Office
$200k–250k/yr
Posted 2mo agoOn-siteRAG Eval harnesses
Staff Software Engineer, Gustie Assist
Gusto · Denver, CO - Hybrid; New York, NY - Hybrid; San Francisco, CA - Hybrid
Posted 2mo agoHybridStaffTool use MCP Eval harnesses LLM-as-judge
Partner Engineer
LangChain · San Francisco, CA
$185k–225k/yr
Posted 2mo agoOn-siteLangChain RAG LangSmith AWS
Member of Technical Staff - Finance Researcher
Halluminate · San Francisco
$215k–275k/yr
Posted 2mo agoOn-siteStaffEval harnesses
Forward Deployed Engineer, Brainbase Embed
Brainbase Labs · San Francisco
Posted 2mo agoOn-siteEmbeddings Eval harnesses
Member of Technical Staff, Core
Brainbase Labs · San Francisco
Posted 2mo agoOn-siteStaffEval harnesses
Member of Technical Staff, Infrastructure
Brainbase Labs · San Francisco
Posted 2mo agoOn-siteStaffEval harnesses Docker AWS Azure
Senior Software Engineer, Agent Eval Platform
ServiceNow · Mountain View, CALIFORNIA, United States
$161k–274k/yr
Posted 2mo agoOn-siteSeniorOrchestration Eval harnesses Python Go
Senior Frontend Engineer, AI Observability & Evals Platform
LangChain · Remote - US
$180k–240k/yr
Posted 2mo agoRemoteSeniorLangChain LangSmith TypeScript JavaScript
Machine Learning Engineer, Evals
Nous Research · Americas (US time zones)
Posted 2mo agoRemoteRAG Orchestration Eval harnesses LLM-as-judge
Senior Software Engineer, Cortex Quality
Snowflake · US-CA-Menlo Park
$200k–270k/yr
Posted 2mo agoHybridSeniorRAG Orchestration Eval harnesses Python
Senior/Staff Applied AI Engineer
Tali AI · Toronto
Posted 2mo agoHybridStaffTool use Orchestration Eval harnesses Vertex AI
Sr. Staff Engineer, Applied AI (Customer Agent)
Klaviyo · Boston, MA
$216k–324k/yr
Posted 2mo agoOn-siteStaffOrchestration Eval harnesses Go
Frontend Engineer, AI Observability & Evals Platform
LangChain · San Francisco, CA
$160k–195k/yr
Posted 2mo agoOn-siteLangChain LangSmith TypeScript JavaScript
Software Engineer - AI Developer Productivity
Baseten · San Francisco
$165k–330k/yr
Posted 2mo agoHybridTool use Orchestration MCP Eval harnesses
Agent Engineer
Sarvam AI · Bengaluru
Posted 2mo agoOn-siteTool use Eval harnesses Python Go
Software Engineer, Integrations
Cohere · Europe
CAD 215k–270k/yr
Posted 2mo agoRemoteEval harnesses
Forward Deployed Engineer
Bunkerhill Health · SF Office
$200k–300k/yr
Posted 2mo agoHybridEval harnesses
Sr/Lead AI Harness Engineer
Fair Isaac (FICO) · Work from Home, United States
$105k–165k/yr
Posted 2mo agoRemoteLeadOrchestration LLM-as-judge
Principal/ Sr Engineer- Harness Engineering
Fair Isaac (FICO) · Bangalore, India
Posted 2mo agoOn-sitePrincipalOrchestration LLM-as-judge CI/CD
Lead Harness Engineer
Fair Isaac (FICO) · Bangalore, India
Posted 2mo agoOn-siteLeadOrchestration LLM-as-judge
Staff Frontend Software Engineer, AI Product: Observe by Snowflake
Snowflake · US-CA-Menlo Park
$236k–339k/yr
Posted 2mo agoOn-siteStaffMCP Eval harnesses TypeScript
Member of Technical Staff, Deeptune Environments
Mercor · New York City
$160k–500k/yr
Posted 2mo agoOn-siteStaffOrchestration Eval harnesses Python
Sr. Staff Software Engineer, Pinterest Assistant
Pinterest · San Francisco, CA, US; Remote, US
$209k–429k/yr
Posted 2mo agoRemoteStaffRAG Embeddings Tool use Orchestration
Staff Software Engineer, Claude Code
Anthropic · San Francisco, CA | New York City, NY | Seattle, WA
$320k–625k/yr
Posted 2mo agoOn-siteStaffOrchestration Eval harnesses Python TypeScript
Research, ML
Exa · Singapore
SGD 90k–300k/yr
Posted 2mo agoOn-siteEmbeddings Eval harnesses PyTorch
Machine Learning Intern
Epic Games · BLANK,BLANK,Multiple Locations
$139k/yr
Posted 2mo agoOn-siteInternEval harnesses Distillation Deep learning Computer vision
Machine Learning Intern
Epic Games · London,England,United Kingdom
Posted 2mo agoOn-siteInternEval harnesses Distillation Deep learning Computer vision
Machine Learning Intern
Epic Games · Montreal,Quebec,Canada
Posted 2mo agoOn-siteInternEval harnesses Distillation Deep learning Computer vision
Software Engineer - Intern
Kastle · San Francisco
Posted 2mo agoOn-siteInternTool use Eval harnesses Python TypeScript