AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

222 open roles · showing 101–150

← All jobs RSS feed

Staff AI Engineer - Conversational & Agentic AI

ServiceNow · Santa Clara, California, United States

$176k–308k/yr

Posted 5w ago Hybrid Staff LangChain LlamaIndex Multi-agent Orchestration
Agent Post-Training, Artifacts Research

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Agent Post-Training, Computer Use Research

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Agent Post-Training, Connectors Research

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Agent Post-Training, Context Research

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Agent Post-Training, Frontier Evals and Environments Research

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Agent Post-Training, Personality

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Agent Post-Training, API & Power Users

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Senior Applied AI/ML Scientist - Compass

Faire · Kitchener-Waterloo, ON; Toronto, ON

CAD 180k–248k/yr

Posted 5w ago On-site Senior RAG Tool use Eval harnesses LLM-as-judge
Senior Applied AI/ML Scientist - Compass

Faire · New York City, NY; San Francisco, CA

$211k–291k/yr

Posted 5w ago On-site Senior RAG Tool use Eval harnesses LLM-as-judge
Research Engineer, AI Models

EnCharge AI · India

Posted 5w ago On-site Senior Eval harnesses Quantization LoRA Distillation
AI Enablement Engineer

Taktile · Berlin Office

Posted 5w ago Hybrid Tool use MCP Eval harnesses AWS
Applied AI Developer (Agent Evaluation)

Autodesk · Toronto, ON, CAN

Posted 5w ago On-site Multi-agent MCP LangSmith PyTorch
GTM AI Engineer

Freshworks · San Mateo, CA, United States

$192k–238k/yr

Posted 5w ago Hybrid Mid Tool use Orchestration MCP Eval harnesses
Research Engineer/Research Scientist - Personal AGI, North Stars

OpenAI · San Francisco

$295k–555k/yr

Posted 5w ago Hybrid Eval harnesses
AI Solutions Engineer, Talent Acquisition

Anduril · Seattle, Washington, United States

Posted 5w ago On-site Mid RAG Tool use Eval harnesses Computer vision
Agent Post-Training Research

OpenAI · San Francisco

$295k–445k/yr

Posted 5w ago On-site Tool use Multi-agent Eval harnesses RLHF
Senior AI Engineer - LLM Evaluation

Autodesk · Bengaluru, IND

Posted 5w ago On-site Senior RAG Orchestration MCP Eval harnesses
AI Engineer

Adaptyv · Lausanne

Posted 5w ago On-site Tool use Orchestration MCP Eval harnesses
AI Solutions Engineer, Talent Acquisition

Anduril · Boston, Massachusetts, United States

Posted 5w ago On-site RAG Tool use Eval harnesses Computer vision
AI Solutions Engineer, Talent Acquisition

Anduril · Costa Mesa, California, United States

Posted 5w ago On-site RAG Tool use Eval harnesses Computer vision
Staff Software Engineer - AI Platform Team

Coinbase · Remote - USA

$218k–257k/yr

Posted 5w ago Remote Staff Embeddings Orchestration MCP LLM-as-judge
Senior AI Engineer - Sana

Workday · Sweden, Stockholm

Posted 5w ago On-site Senior RAG Tool use Orchestration LangSmith
Senior Software Engineer, Rejections & Denials

Commure · Mountain View, CA

$180k–230k/yr

Posted 5w ago Hybrid Senior Eval harnesses NLP Kubernetes Docker
Senior Software Engineer (AI)

Datadog · Tel Aviv, Israel

Posted 5w ago On-site Senior Eval harnesses
Senior AI Solutions Engineer

Fiserv · Berkeley Heights, New Jersey

$128k–216k/yr

Posted 5w ago On-site Senior LangChain RAG Embeddings Tool use
Machine Learning Engineer

Coinbase · Remote - India

INR 4408k–4408k/yr

Posted 5w ago Remote Mid Multi-agent Orchestration LangSmith Deep learning
Product Lead, AI/ML (Evals)

Abridge · SF Office

$250k–290k/yr

Posted 5w ago Hybrid Lead Eval harnesses Go
Forward Deployed Engineer

Arthur AI · Main (Hybrid)

$170k–220k/yr

Posted 5w ago Hybrid Eval harnesses
Senior Software Engineer Fullstack

Okta · Bengaluru, India

Posted 5w ago On-site Senior LangChain RAG Embeddings Orchestration
Applied AI Engineer, Silicon Engineering

Etched · San Jose

$150k–275k/yr

Posted 5w ago On-site RAG Tool use Multi-agent Orchestration
Software Engineer, eve

Vercel · Hybrid - San Francisco, New York City

$208k–312k/yr

Posted 5w ago Hybrid Senior Tool use Multi-agent Orchestration MCP
Research Engineer, Domain Scaling

Anthropic · San Francisco, CA | New York City, NY | Seattle, WA

$350k–850k/yr

Posted 6w ago On-site Eval harnesses
Software Engineer, Machine Learning Infrastructure - Generative AI

DoorDash · San Francisco, CA; Sunnyvale, CA; Seattle, WA

Posted 6w ago On-site Mid RAG MCP Eval harnesses LLM-as-judge
ML Solution Architect (Early Talent)

Nebius · United States

Posted 6w ago On-site Junior LangChain vLLM Orchestration LangSmith
AI research scientist

Writer · San Francisco, CA

$234k–349k/yr

Posted 6w ago Hybrid Embeddings Tool use LLM-as-judge RLHF
Forward Deployed Engineer

Elixirr · Dallas

Posted 6w ago On-site Senior RAG Embeddings Tool use MCP
AI Researcher

1X Technologies · San Carlos, CA

$250k–350k/yr

Posted 6w ago On-site Senior Eval harnesses Triton TensorRT Quantization
Staff Agentic ML Engineer - Photoshop

Adobe · San Jose

$239k–346k/yr

Posted 6w ago On-site Staff LangChain Tool use Multi-agent Orchestration
Manager, AI Engineering - Analytics

Drata · Hybrid - San Francisco

$198k–268k/yr

Posted 6w ago Hybrid Manager Tool use Eval harnesses
Senior Machine Learning Engineer, CX Intelligence

Coinbase · Remote - Brazil

BRL 456k–456k/yr

Posted 6w ago Remote Senior Multi-agent Orchestration LangSmith Deep learning
Forward Deployed AI Engineer, West

Arize AI · Remote (San Francisco)

$155k–190k/yr

Posted 6w ago Remote Senior Orchestration Arize Kubernetes Docker
(Senior) AI/LLM Engineer

Mercura · Munich

Posted 6w ago On-site Senior RAG Orchestration Eval harnesses Python
Member of Technical Staff (Software Engineer, Agent Capabilities)

Perplexity · San Francisco

$220k–405k/yr

Posted 7w ago Hybrid Staff Tool use Eval harnesses AWS Python
Principal Forward Deployed Engineer

Okta · London, United Kingdom

£114k–172k/yr

Posted 7w ago On-site Principal MCP Eval harnesses
Applied Scientist

Prolific · London

Posted 7w ago On-site Mid RAG Multi-agent LLM-as-judge RLHF
Full Stack (Back-End Leaning)

Solve Intelligence · London

$100k–250k/yr

Posted 7w ago On-site Eval harnesses Python TypeScript Go
Research Engineer, Code RL (Reinforcement Learning)

Anthropic · San Francisco, CA | New York City, NY

$500k–850k/yr

Posted 7w ago On-site Senior Eval harnesses GPU RLHF PyTorch
Software Engineering Manager, AI Observability & Evals Platform (New York, NY)

LangChain · New York, NY

Posted 7w ago On-site Manager LangChain LangSmith Python TypeScript
AI Field Engineer - Strategic Partnerships

Fireworks AI · San Mateo

$200k–260k/yr

Posted 7w ago On-site LangChain LlamaIndex vLLM Embeddings