AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

413 open roles · showing 251–300

All jobs RSS feed

Search

Cybersecurity Engineer
Workday · USA.VA.Reston
$124k–186k/yr
Posted 6w agoOn-siteLangChain Orchestration Eval harnesses LLM-as-judge
Staff AI Product Engineer
Nscale · Houston; New York; San Francisco; Seattle
$220k–330k/yr
Posted 6w agoOn-siteStaffvLLM Orchestration Eval harnesses GPU
Mercor AI Safety Fund Grants
Mercor · San Francisco
Posted 6w agoOn-siteEval harnesses
Deployed Engineer, Professional Services (APAC)
LangChain · Remote - Singapore
SGD 185k–260k/yr
Posted 6w agoRemoteLangChain Hugging Face Embeddings Multi-agent
Agentic AI Engineering Lead — Enterprise Agent Orchestration - SVP
Citi · Tampa Florida United States
$141k–212k/yr
Posted 6w agoOn-siteLeadLangChain LlamaIndex RAG Embeddings
Sr Full Stack Engineer, Creator Services
Adobe · San Jose
$159k–302k/yr
Posted 6w agoOn-siteSeniorMulti-agent Eval harnesses AWS Azure
Senior AI Software Engineer, Risk - Insurance Claims Management
Lyft · Seattle, WA
$136k–170k/yr
Posted 6w agoOn-siteSeniorRAG Orchestration Eval harnesses NLP
Senior AI Software Engineer, Risk - Insurance Claims Management
Lyft · San Francisco, CA
$148k–185k/yr
Posted 6w agoOn-siteSeniorRAG Orchestration Eval harnesses NLP
Chief Technology Officer - US-Based
Toptal · United States
Posted 6w agoRemoteOrchestration MCP Eval harnesses Go
Chief Technology Officer
Toptal · Canada, Europe, Central America, South America
Posted 6w agoRemoteOrchestration MCP Eval harnesses Go
Senior AI Engineer - Search & Recommendation - Patient Team (x/f/m)
Doctolib · Paris, Paris, France
Posted 6w agoOn-siteSeniorRAG Embeddings Reranking Eval harnesses
Principal Forward-Deployed Engineer
Thoughtworks · Barcelona, Spain; Madrid, Spain
Posted 6w agoOn-sitePrincipalLangChain LlamaIndex RAG Pinecone
Senior Applied AI Engineer – Agent Runtime (Alwin by DataSnipper)
DataSnipper · Amsterdam
Posted 6w agoOn-siteSeniorRAG Multi-agent Orchestration MCP
Senior Fullstack Engineer, AI Observability & Evals Platform
LangChain · Boston, MA
$175k–240k/yr
Posted 6w agoOn-siteSeniorLangChain LangSmith Python TypeScript
Senior Backend Software Engineer, AI Observability & Evals Platform (LangSmith)
LangChain · Boston, MA
$170k–235k/yr
Posted 6w agoOn-siteSeniorLangChain Eval harnesses LangSmith AWS
Senior Software Engineer I
CoreWeave · Bellevue, WA / Sunnyvale, CA / San Francisco, CA / Livingston, NJ / Manhattan, NY / Philadelphia, PA / Dallas, TX
$153k–204k/yr
Posted 6w agoOn-siteSeniorEval harnesses Kubernetes Docker CI/CD
Staff Engineer, Applied AI (Customer Agent)
Klaviyo · Boston, MA
$176k–264k/yr
Posted 6w agoOn-siteStaffOrchestration Eval harnesses Go
Senior / Staff Software Engineer, AI Tooling
Waabi · Toronto, ON
Posted 6w agoHybridStaffTool use Eval harnesses CI/CD Python
Software Engineering Manager, AI Observability & Evals Platform (Boston)
LangChain · Boston, MA
$220k–270k/yr
Posted 6w agoOn-siteManagerLangChain LangSmith Python TypeScript
Principal Software Engineer, Platform Services (PMTS)
Salesforce · California - San Francisco
$197k–314k/yr
Posted 7w agoOn-sitePrincipalRAG Embeddings Reranking Tool use
Machine Learning Engineering Technical Leader
Cisco · Seattle, Washington, US
$234k–297k/yr
Posted 7w agoOn-siteTool use Eval harnesses Quantization LoRA
Applied AI Engineer
Arena · SF Bay Area
$150k–250k/yr
Posted 7w agoOn-siteEval harnesses CI/CD TypeScript Go
Senior/Staff Software Engineer, Agent
OpenArt · San Carlos, California, USA
$500k–600k/yr
Posted 7w agoHybridStaffTool use Orchestration MCP Eval harnesses
Forward Deployed Engineer, EMEA
Brainbase Labs · Remote (EMEA)
Posted 7w agoRemoteEmbeddings Eval harnesses
ML & Agentic Systems Engineer [IC4]
Sourcegraph · Remote
Posted 7w agoRemoteEmbeddings MCP Eval harnesses Distillation
Staff/Sr. Staff Software Engineer, Product Engineering
Harvey · New York
$231k–340k/yr
Posted 7w agoHybridStaffTool use Eval harnesses Python TypeScript
Staff/Sr. Staff Software Engineer, Product Engineering
Harvey · San Francisco
$231k–340k/yr
Posted 7w agoHybridStaffTool use Eval harnesses Python TypeScript
OB - Lead AI Engineer
Empirical Health · LATAM
Posted 7w agoRemoteLeadEval harnesses CI/CD Azure
Forward Deployed Engineer
Moneybox · London Office
Posted 7w agoHybridRAG Orchestration Eval harnesses Python
Senior / Staff Software Engineer — AI Platform
Snorkel AI · New York City, NY (Hybrid); San Francisco, CA (Hybrid)
Posted 7w agoHybridStaffMulti-agent Orchestration Eval harnesses Kubernetes
Lead GenAI Engineer
Fractal Analytics · California
Posted 7w agoOn-siteLeadLangChain LlamaIndex RAG Tool use
Lead AI & Data Engineer – APD Platform
AstraZeneca · Spain - Barcelona
Posted 7w agoOn-siteLeadLangChain RAG LangSmith Kubernetes
Member Technical Staff - Applied AI Engineer (US Timing)
Composio · Bangalore
Posted 7w agoOn-siteStaffTool use Eval harnesses Python TypeScript
Software Engineer: Factory Team
Rogo · New York City
$200k–275k/yr
Posted 7w agoOn-siteTool use Eval harnesses GCP Python
Software Engineer, AI Automation
Coalition · Any location, Canada
Posted 7w agoOn-siteTool use MCP Eval harnesses Python
Software Engineer, AI Automation
Coalition · Any location, United States
Posted 7w agoOn-siteTool use MCP Eval harnesses Python
Senior AI/ML Engineer
Metriport · San Francisco
$200k–260k/yr
Posted 7w agoHybridSeniorEval harnesses Deep learning SageMaker AWS
Applied AI, Research Engineer
Anthropic · San Francisco, CA | New York City, NY
$300k–400k/yr
Posted 7w agoOn-siteEval harnesses Go
Research Engineer, Forge
Mistral AI · Paris
Posted 7w agoHybridOrchestration Eval harnesses Distillation PyTorch
Backend Software Engineer
Navan · Berlin, Germany
Posted 7w agoOn-siteRAG Tool use Multi-agent Orchestration
Forward Deployed Engineer (Audit experience required)
DataSnipper · Amsterdam
Posted 7w agoHybridEval harnesses
Staff+ Software Engineer, Claude Science
Anthropic · San Francisco, CA | New York City, NY
$405k–485k/yr
Posted 7w agoOn-siteStaffMulti-agent Eval harnesses
AI Engineer
9fin · London
Posted 8w agoOn-siteEmbeddings Eval harnesses Computer vision AWS
AI Product Senior Director
FanDuel · New York City
$230k–302k/yr
Posted 8w agoOn-siteManagerTool use Orchestration MCP Eval harnesses
Forward Deployed Engineer
DevRev · Delhi, NCR
Posted 8w agoOn-siteRAG Tool use MCP Eval harnesses
Sr. Director, Engineering, Adobe Intelligence Platform
Adobe · San Jose
$209k–429k/yr
Posted 8w agoOn-siteManagerOrchestration Eval harnesses
Forward Deployed Engineer, Enterprise AI
Handshake AI · San Francisco, CA
$155k–170k/yr
Posted 8w agoOn-siteMulti-agent Eval harnesses
Staff Software Engineer, RL Environments
Scale AI · San Francisco, CA; New York, NY
$252k–315k/yr
Posted 8w agoOn-siteStaffvLLM Tool use Orchestration MCP
Senior Software Engineer - Integrations 3P - Platform
Elastic · United Kingdom
Posted 8w agoOn-siteSeniorMCP Eval harnesses Go Rust
Senior Generative AI Engineer
Motorway · London
Posted 8w agoHybridSeniorTool use Orchestration Eval harnesses CI/CD