AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

222 open roles · showing 51–100

← All jobs RSS feed

Applied AI Engineer

OpenRouter · Remote (US)

$215k–280k/yr

Posted 2w ago Remote Eval harnesses Go
Senior Software Engineer: Assistant

Roblox · San Mateo, CA, United States

$197k–243k/yr

Posted 2w ago On-site Senior Tool use Orchestration Eval harnesses C++
Security Engineer, AI Platform Engineering

Saronic · Austin, TX

Posted 2w ago On-site Tool use MCP Eval harnesses CI/CD
Member of Engineering (Compute)

Poolside · Remote (EMEA)

Posted 2w ago Remote Eval harnesses GPU Kubernetes Go
Principal Forward Deployed Engineer

Okta · Singapore

Posted 2w ago On-site Principal LangChain MCP Eval harnesses Python
Senior Software Engineer, Agent Oversight

Scale AI · San Francisco, CA; New York, NY

Posted 2w ago On-site Senior Tool use Multi-agent Orchestration Eval harnesses
Staff Full-Stack Software Engineer, AI & App Experience

Chime · New York, NY, USA; San Francisco, CA, USA

$223k–308k/yr

Posted 2w ago On-site Staff Orchestration Eval harnesses Python
Software Engineer, AI Platform

Notion · San Francisco, California

$180k–201k/yr

Posted 2w ago Hybrid Eval harnesses Ray
Software Engineer, AI Platform

Mixpanel · San Francisco, US (Hybrid)

$188k–254k/yr

Posted 2w ago Hybrid Mid Orchestration MCP Eval harnesses
Lead AI Engineer

AT&T · CZE:642:Brno / Palachovo Namesti 726/4 Block A&b - Adm:2 Palachovo Namesti

CZK 132k–198k/month

Posted 2w ago On-site Lead RAG Embeddings Reranking MCP
Medior AI Engineer

AT&T · CZE:642:Brno / Palachovo Namesti 726/4 Block A&b - Adm:2 Palachovo Namesti

CZK 95k–142k/month

Posted 2w ago On-site Mid RAG Embeddings Reranking MCP
Senior AI Engineer

AT&T · CZE:642:Brno / Palachovo Namesti 726/4 Block A&b - Adm:2 Palachovo Namesti

CZK 113k–170k/month

Posted 2w ago On-site Senior RAG Embeddings Reranking MCP
Research Engineer, Synthetic Data

HUD · San Francisco

Posted 2w ago On-site Eval harnesses Docker Python
Research Engineer, Benchmarks

HUD · San Francisco

Posted 2w ago On-site Eval harnesses Docker Python
Research Engineer, QC Automation

HUD · San Francisco

Posted 2w ago On-site Eval harnesses Docker Python
Forward Deployed Research Engineer

HUD · San Francisco

Posted 2w ago On-site Senior Eval harnesses Docker Python
Director, Research - AI Evals

Figma · San Francisco, CA • New York, NY • United States

$258k–348k/yr

Posted 2w ago On-site Manager Eval harnesses LLM-as-judge LangSmith Go
Forward Deployed Engineer, Korea

Normal Computing · Seoul

Posted 2w ago Hybrid RAG Eval harnesses Python Go
Staff Support Tooling Engineer

Docker · Canada

CAD 243k–348k/yr

Posted 3w ago Remote Staff Tool use Orchestration MCP Eval harnesses
Staff Software Engineer, AI Developer Tooling

Sentry · San Francisco, California

$240k–400k/yr

Posted 3w ago Hybrid Staff Eval harnesses CI/CD
Senior AI Engineer

Hadean · London, GB

Posted 3w ago On-site Senior RAG Orchestration Eval harnesses Python
Senior Applied Research Scientist

ServiceNow · Toronto, Ontario, Canada

Posted 3w ago Hybrid Senior LangChain LlamaIndex Multi-agent Orchestration
Software Engineer, Evals

Glean · Bangalore, India

Posted 3w ago On-site Mid Orchestration Eval harnesses Python Go
Software Engineer, Agents

Glean · Bangalore, India

Posted 3w ago On-site Senior Eval harnesses Python TypeScript Go
Member of Technical Staff (Software Engineer, Enterprise Adoption)

Perplexity · San Francisco

$220k–405k/yr

Posted 3w ago On-site Staff MCP Eval harnesses Python TypeScript
Agent Engineer [IC4]

Sourcegraph · Remote

Posted 3w ago Remote Senior Embeddings MCP Eval harnesses Docker
Engineer III , Backend Gen AI

Anaplan · Gurugram

Posted 3w ago On-site LangChain LlamaIndex vLLM RAG
Staff Engineer - Machine Learning

Freshworks · San Mateo, CA, United States

$211k–261k/yr

Posted 3w ago Hybrid Staff LangChain RAG Pinecone Weaviate
Forward Deployed Engineer

Sarvam AI · Bengaluru

Posted 3w ago On-site Mid LlamaIndex RAG Tool use MCP
Research Scientist (ICML)

AfterQuery · San Francisco

$250k–450k/yr

Posted 3w ago On-site Senior Eval harnesses
Senior ML Ops Engineer

Confido · NYC Office

$210k–300k/yr

Posted 3w ago On-site Senior vLLM Orchestration Eval harnesses GPU
Software Engineer, Early Career (AI)

Notion · San Francisco, California

$130k–150k/yr

Posted 3w ago Hybrid Junior Embeddings Orchestration Eval harnesses TypeScript
Forward-Deployed Engineer

Prox · San Francisco, CA

$160k–190k/yr

Posted 3w ago On-site MCP Eval harnesses
Senior AI Engineer - Patient Team (x/f/m)

Doctolib · Paris, Paris, France

Posted 4w ago On-site Senior RAG Embeddings Reranking Eval harnesses
Staff Backend AI Platform Engineer

Freshworks · San Mateo, CA, United States

$225k–278k/yr

Posted 4w ago Hybrid Staff LangChain RAG Pinecone Weaviate
Senior Software Engineer, Machine Learning Infrastructure - Generative AI

DoorDash · San Francisco, CA; Sunnyvale, CA; Seattle, WA

Posted 4w ago On-site Senior vLLM RAG Embeddings MCP
Staff+ Software Engineer, Developer Acceleration

Anthropic · San Francisco, CA | Seattle, WA

$405k–485k/yr

Posted 4w ago On-site Staff Orchestration Eval harnesses CI/CD
Staff+ Software Engineer, Vertical AI Products (Multiple Roles)

Anthropic · San Francisco, CA | New York City, NY

$405k–485k/yr

Posted 4w ago On-site Staff Eval harnesses Go
Sr Data Scientist

Gartner · Stamford, CT

Posted 4w ago On-site Senior LangChain LlamaIndex Hugging Face RAG
AI Research Scientist, Agentic Systems (Remote)

CrowdStrike · USA - Remote

Posted 4w ago Remote Senior vLLM Hugging Face Tool use Eval harnesses
Lead Data Scientist

Snorkel AI · New York City, NY (Hybrid); San Francisco, CA (Hybrid)

$130k–200k/yr

Posted 4w ago Hybrid Lead Eval harnesses Python
Principal Research Engineer, Model Training & Post-Training

Inflection AI · Palo Alto, California, United States

$400k–550k/yr

Posted 4w ago On-site Principal Tool use Eval harnesses GPU RLHF
Research Engineer, AI Models

EnCharge AI · Germany

€116k–154k/yr

Posted 4w ago On-site Senior Eval harnesses Quantization LoRA Distillation
Principal Engineer, Agentic AI Systems

Inflection AI · Palo Alto, California, United States

$400k–550k/yr

Posted 4w ago On-site Principal LlamaIndex vLLM Hugging Face RAG
Member of Technical Staff (Data Scientist, Evals)

Perplexity · San Francisco

$200k–300k/yr

Posted 4w ago Hybrid Staff Eval harnesses AWS Python
Senior Software Engineer, Agents (Agentic Search)

Nebius · Israel

Posted 4w ago On-site Senior LangChain RAG Tool use Orchestration
Senior Backend Engineer - AI Framework (Python)

Gong · Tel Aviv

Posted 4w ago On-site Senior LangChain Orchestration LangSmith Python
Research Engineer, Post-Training

Harvey · San Francisco

$231k–340k/yr

Posted 5w ago Hybrid Senior Eval harnesses GPU RLHF Distillation
Senior AI Engineer

Amplitude · San Francisco, CA

Posted 5w ago On-site Senior Tool use Orchestration Eval harnesses Go
Software Engineer, Agent Platform

Anduril · Washington, District of Columbia, United States

$220k–292k/yr

Posted 5w ago On-site Senior LangChain Tool use Multi-agent Orchestration