AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

413 open roles · showing 301–350

All jobs RSS feed

Search

Lead Generative AI Engineer
Motorway · London
Posted 8w agoHybridLeadOrchestration Eval harnesses AWS GCP
Member of Technical Staff (Search Quality Analyst)
Perplexity · Belgrade
Posted 8w agoHybridStaffEval harnesses Python
Cyber Evaluations Engineer
Anthropic · Remote-Friendly, United States; San Francisco, CA | Washington, DC
$300k–405k/yr
Posted 8w agoRemoteEval harnesses Python
ML Researcher - Posttraining
Krea · San Francisco
Posted 8w agoOn-sitevLLM Eval harnesses DPO Distillation
Senior AI Engineer
Gradient Labs · London Office
Posted 8w agoHybridSeniorTool use Orchestration Eval harnesses NLP
Member of Technical Staff, Agentic Systems
Mercor · San Francisco
$160k–500k/yr
Posted 8w agoOn-siteStaffTool use Orchestration Eval harnesses
Senior Software Engineer, ML Infrastructure
Apptronik · Austin, TX
Posted 8w agoOn-siteSeniorEval harnesses GPU TensorRT Kubernetes
Distinguished AI Engineer
Capital One · Bangalore, In
Posted 2mo agoOn-siteLangChain Hugging Face Eval harnesses PyTorch
Senior Data Scientist/ML
Rho · Belgrade
Posted 2mo agoHybridSeniorRAG Eval harnesses Kubernetes SageMaker
Applied AI Architect, Startups
Anthropic · San Francisco, CA | New York City, NY
$240k–315k/yr
Posted 2mo agoOn-siteEval harnesses Python
Sr. Software Engineer, AI
Navan · New York, NY
$113k–252k/yr
Posted 2mo agoOn-siteSeniorRAG Tool use Orchestration Eval harnesses
Research, Coding Agents
Thinking Machines Lab · San Francisco
$350k–475k/yr
Posted 2mo agoHybridEval harnesses PyTorch TensorFlow Deep learning
Research Scientist, APEX Benchmarks
Mercor · San Francisco
$200k–500k/yr
Posted 2mo agoOn-siteEval harnesses NLP Go
Deployed Engineer, Professional Services
LangChain · Atlanta, GA
$150k–270k/yr
Posted 2mo agoRemoteLangChain Hugging Face Embeddings Multi-agent
Deployed Engineer, Professional Services (NYC)
LangChain · New York, NY
$150k–300k/yr
Posted 2mo agoHybridLangChain Hugging Face Embeddings Multi-agent
Deployed Engineer, Professional Services (San Francisco)
LangChain · San Francisco, CA
$150k–300k/yr
Posted 2mo agoHybridLangChain Hugging Face Embeddings Multi-agent
Education Engineer
Arize AI · Remote (San Francisco)
$100k–175k/yr
Posted 2mo agoRemoteOrchestration Arize Python
Applied AI Engineer
Arize AI · Remote (San Francisco)
$100k–175k/yr
Posted 2mo agoRemoteOrchestration Arize Python
Applied AI Engineer
Monte Carlo · Remote, Americas
$200k–260k/yr
Posted 2mo agoRemoteRAG MCP Eval harnesses Python
GTM Systems Engineer
Rogo · New York City
$170k–200k/yr
Posted 2mo agoOn-siteOrchestration MCP Eval harnesses Python
Software Engineer, Agents
Mercor · New York City
$160k–500k/yr
Posted 2mo agoOn-siteLangChain Orchestration Eval harnesses LangSmith
Senior/Staff FDE - Synthetic Data Generation
Snorkel AI · New York City, NY (Hybrid); San Francisco, CA (Hybrid)
$180k–320k/yr
Posted 2mo agoHybridStaffEval harnesses Docker AWS Azure
Senior/Staff FDE - CUA
Snorkel AI · New York City, NY (Hybrid); San Francisco, CA (Hybrid)
$180k–320k/yr
Posted 2mo agoHybridStaffTool use Eval harnesses Python
Senior Machine Learning Engineer, Agent Eval Platform
ServiceNow · Santa Clara, CALIFORNIA, United States
Posted 2mo agoOn-siteSeniorLLM-as-judge RLHF Distillation Python
Tech Lead, Agent Eval Platform
ServiceNow · Mountain View, CALIFORNIA, United States
Posted 2mo agoOn-siteLeadOrchestration Eval harnesses Python Go
Staff Machine Learning Engineer, Agent Eval Platform
ServiceNow · Mountain View, CALIFORNIA, United States
Posted 2mo agoOn-siteStaffLLM-as-judge RLHF Distillation Python
Principal Engineer (backed by Y Combinator, $5M+ ARR, $23M+ raised)
Legion Health · San Francisco
$250k–400k/yr
Posted 2mo agoOn-sitePrincipalTool use Orchestration Eval harnesses Deep learning
Staff Software Engineer, Agent Eval Platform
ServiceNow · Mountain View, CALIFORNIA, United States
Posted 2mo agoOn-siteStaffOrchestration Eval harnesses Python Go
Member of Product Staff, Foundation Models & Post-Training
Abridge · SF Office
$250k–290k/yr
Posted 2mo agoHybridStaffEval harnesses Distillation
Senior Data Scientist, Agentic AI Systems
Axle · Remote
$130k–150k/yr
Posted 2mo agoRemoteSeniorvLLM Embeddings Tool use MCP
LLM Engineer (Data Generation)
42dot · Pangyo (Software Dream Center), South Korea
Posted 2mo agoHybridTool use Eval harnesses RLHF DPO
Software Engineer, Agent Harness
Sim · San Francisco
$190k–250k/yr
Posted 2mo agoOn-siteTool use Eval harnesses
Staff Software Engineer, GTM AI Engineering
Anthropic · Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA
$320k–405k/yr
Posted 2mo agoRemoteStaffTool use MCP Eval harnesses Python
Forward Deployed Engineer
Figma · San Francisco, CA • New York, NY • United States
$153k–376k/yr
Posted 2mo agoOn-siteOrchestration MCP Eval harnesses Python
AI Engineer
Cambio · Waterloo
Posted 2mo agoHybridRAG Eval harnesses Python
Applied Research Scientist, AI Research
Descript · San Francisco, CA or Remote, US
$197k–263k/yr
Posted 2mo agoRemoteEval harnesses PyTorch Deep learning Computer vision
Deployed Engineer (Federal)
LangChain · Washington DC
$185k–300k/yr
Posted 2mo agoRemoteLangChain Orchestration LangSmith Kubernetes
Senior Agent Platform Engineer
Proxima Fusion · Munich
Posted 2mo agoOn-siteSeniorMulti-agent Orchestration MCP Eval harnesses
Senior AI Engineer
PA Consulting · Belfast, Northern Ireland, United Kingdom
Posted 2mo agoHybridSeniorLangChain LlamaIndex Hugging Face RAG
Senior AI Engineer
PA Consulting · London, England, United Kingdom
Posted 2mo agoHybridSeniorLangChain LlamaIndex Hugging Face RAG
Research Engineer
Greptile · San Francisco
$180k–280k/yr
Posted 2mo agoOn-siteMulti-agent Eval harnesses
Director of Research, Text to Speech
Deepgram · USA - Remote
$234k–361k/yr
Posted 2mo agoRemoteManagerEval harnesses
AI-Native Engineer, New Grad (Ingeniero/a de Software AI-Native — Inicio de Carrera) - Mexico City (Hybrid)
Clara · Mexico City / CDMX / Mexico
Posted 2mo agoOn-siteJuniorRAG Eval harnesses AWS Python
Research Engineer / Research Scientist, Health
OpenAI · San Francisco
$380k–500k/yr
Posted 2mo agoOn-siteEval harnesses
Member of Technical Staff, Mercor Enterprise Platform
Mercor · San Francisco
$160k–500k/yr
Posted 2mo agoOn-siteStaffOrchestration Eval harnesses Kubernetes TypeScript
Senior Software Engineer, Enterprise Build
Robinhood · Menlo Park, CA
$196k–230k/yr
Posted 2mo agoOn-siteSeniorMCP Eval harnesses CI/CD GCP
Security Engineer
Legora · Stockholm HQ
Posted 2mo agoOn-siteEval harnesses CI/CD Azure Python
Forward Deployed Engineer
Hatch · United States
Posted 2mo agoRemoteTool use Orchestration Eval harnesses Python
Staff Software Engineer, Agent Eval Platform
ServiceNow · Santa Clara, CALIFORNIA, United States
Posted 2mo agoOn-siteStaffOrchestration Eval harnesses Python Go
Staff+ Software Engineer, Claude Managed Agents
Anthropic · San Francisco, CA | New York City, NY
$405k–485k/yr
Posted 2mo agoOn-siteStaffMulti-agent Orchestration Eval harnesses Go