AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

413 open roles · showing 201–250

All jobs RSS feed

Search

Member of Technical Staff, Evals
Handshake AI · San Francisco, CA
$200k–350k/yr
Posted 4w agoOn-siteStaffEval harnesses Python
Senior Software Engineer - Integrations 3P - Platform
Elastic · Poland
Posted 4w agoOn-siteSeniorMCP Eval harnesses Go Rust
Engineering Manager, AI Platform & Agentic Apps
Robinhood · Menlo Park, CA
$255k–300k/yr
Posted 4w agoOn-siteManagerTool use Orchestration Eval harnesses
Research Engineer, Robotics Data
HUD · San Francisco
$100k–230k/yr
Posted 4w agoOn-siteEval harnesses Python
Senior Applied AI Engineer – Agent Runtime (Alwin by DataSnipper)
DataSnipper · New York
$230k–300k/yr
Posted 4w agoHybridSeniorRAG Multi-agent Orchestration MCP
Senior Data Scientist
Grab · Bangalore, India
Posted 4w agoOn-siteSeniorLangChain Orchestration LangSmith LoRA
AI Specialist II
Coursera · India
Posted 4w agoOn-siteAnthropic API LangChain LlamaIndex Hugging Face
Software Engineer 3 - Enterprise Architecture
MongoDB · Gurugram
Posted 4w agoOn-siteRAG Tool use Orchestration Eval harnesses
Senior Engineer - Enterprise Architecture
MongoDB · Gurugram
Posted 4w agoOn-siteSeniorRAG Tool use Orchestration Eval harnesses
Engineering Manager, Provider Ecosystem
OpenRouter · Remote (US)
$275k–325k/yr
Posted 4w agoRemoteManagerEmbeddings Tool use Eval harnesses GPU
Senior Research Manager
HUD · San Francisco
$120k–295k/yr
Posted 4w agoOn-siteManagerEval harnesses
Senior Software Engineer II - Agentic Intelligence
Honeycomb · Remote - Canada
CAD 250k–280k/yr
Posted 4w agoRemoteSeniorRAG MCP Eval harnesses Kubernetes
Senior | Staff Software Engineer - AI / ML
Snorkel AI · San Francisco, CA (Hybrid)
$208k–315k/yr
Posted 4w agoHybridStaffEval harnesses LLM-as-judge LoRA Python
Research Scientist - Human-AI Systems
Snorkel AI · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
$200k–375k/yr
Posted 4w agoHybridEval harnesses NLP
Enterprise Data Scientist
London Stock Exchange Group · SGP-Singapore-1 Raffles Quay
Posted 5w agoOn-siteHugging Face RAG Pinecone Weaviate
Forward Deployed Engineer
Sim · San Francisco
$190k–250k/yr
Posted 5w agoOn-siteEval harnesses
Applied AI Engineer
Warp · New York
Posted 5w agoOn-siteTool use Eval harnesses
Senior Frontend Engineer, AI Observabilty Platform
LangChain · Boston, MA
$170k–235k/yr
Posted 5w agoOn-siteSeniorLangChain LangSmith TypeScript JavaScript
Staff Software Engineer, Agent Quality
Databricks · New York City, New York
$200k–265k/yr
Posted 5w agoOn-siteStaffMulti-agent Eval harnesses CI/CD Python
Software Engineer - Platform
Arena · SF Bay Area
Posted 5w agoOn-siteLangChain vLLM Eval harnesses Kubernetes
Sr. Principal Architect - Observability
Workday · USA, CA, Pleasanton
Posted 5w agoOn-sitePrincipalLangChain Orchestration MCP Eval harnesses
Applied AI Architect, Startups
Anthropic · London, UK
£165k–190k/yr
Posted 5w agoOn-siteEval harnesses Python
Sr Specialist AI Engineer
Nasdaq · India - Bangalore - Karnataka
Posted 5w agoOn-siteSeniorLangChain LlamaIndex RAG Embeddings
AI research scientist
Writer · San Francisco, CA
$199k–325k/yr
Posted 5w agoHybridEmbeddings Tool use LLM-as-judge RLHF
Senior Applied AI/ML Scientist - Listing Quality
Faire · San Francisco, CA
$211k–291k/yr
Posted 5w agoOn-siteSeniorLLM-as-judge Deep learning Computer vision Go
Senior AI Enablement Engineer, People
Justworks · New York, New York
Posted 5w agoOn-siteSeniorRAG Embeddings LangSmith
Manager, Applied AI Architect
Anthropic · Seoul, South Korea
Posted 5w agoOn-siteManagerAnthropic API Eval harnesses
Research, Mid Training
Thinking Machines Lab · San Francisco
$350k–475k/yr
Posted 5w agoOn-siteEval harnesses PyTorch TensorFlow Deep learning
Growth Engineer
ClickHouse · United States
$147k–238k/yr
Posted 5w agoRemoteTool use Eval harnesses TypeScript Go
Staff Machine Learning Engineer, AI Platform & Agentic Apps
Robinhood · Menlo Park, CA
$255k–300k/yr
Posted 5w agoOn-siteStaffTool use Orchestration Eval harnesses LLM-as-judge
AI Operations Engineer
Cisco · RTP, North Carolina, US
$170k–215k/yr
Posted 5w agoOn-siteLangChain RAG Reranking Tool use
Member of Technical Staff, AI Products (Early Career - Industry)
Perplexity · San Francisco
$180k–270k/yr
Posted 5w agoOn-siteStaffRAG Tool use Orchestration Eval harnesses
Senior Platform Engineer, Human Data
Anyone AI · Fully Remote
Posted 5w agoRemoteSeniorOrchestration Eval harnesses RLHF
Manager I, Engineering - Code Intelligence
Datadog · New York, New York, USA
$192k–240k/yr
Posted 5w agoOn-siteManagerLLM-as-judge
Principal AI Engineer - Hybrid in Bangalore
Smartsheet · Bangalore, INDIA
Posted 5w agoOn-sitePrincipalOrchestration MCP Eval harnesses AWS
Senior Software Development Engineer - GenAI
Expedia Group · USA - Illinois - Chicago
Posted 6w agoOn-siteSeniorLangChain LlamaIndex RAG Embeddings
Software Engineer GEN AI, Assistant Vice President
Citi · Irving Texas United States
$107k–161k/yr
Posted 6w agoOn-siteManagerLangChain RAG Pinecone pgvector
Director, Text-to-Speech Synthesis Research
Deepgram · London, UK
Posted 6w agoRemoteManagerEval harnesses
Forward Deployed Architect { Noida}
DevRev · Delhi, NCR
Posted 6w agoOn-siteRAG Tool use Eval harnesses CI/CD
Forward Deployed Architect { Mumbai}
DevRev · Mumbai, India
Posted 6w agoOn-siteRAG Tool use Eval harnesses CI/CD
Forward Deployed Engineer {Chennai}
DevRev · Chennai, India
Posted 6w agoOn-siteRAG Tool use MCP Eval harnesses
Forward Deployed Engineer {Mumbai}
DevRev · Mumbai, India
Posted 6w agoOn-siteRAG Tool use MCP Eval harnesses
Software Engineer, Internal Audit (All Levels)
Fieldguide · San Francisco, CA or Remote (USA)
$160k–280k/yr
Posted 6w agoRemoteOrchestration Eval harnesses Python TypeScript
【AstraZeneca】【CET】Agentic AI Lead,Cutomer Experience & IT
AstraZeneca · Japan - Osaka
Posted 6w agoOn-siteLeadRAG Tool use MCP LangSmith
AI Software Engineer, Agent Harness
EnCharge AI · India
Posted 6w agoOn-siteRAG Tool use Orchestration MCP
Sr. Software Engineer - Ingestion Core team
Databricks · San Francisco, California
$166k–225k/yr
Posted 6w agoOn-siteSeniorRAG Eval harnesses Python Go
Senior Forward Deployed Engineer, Enterprise AI
Handshake AI · San Francisco, CA
$220k–300k/yr
Posted 6w agoOn-siteSeniorMulti-agent Eval harnesses
Product Director, Localisation & AI Evals
OKX · Hong Kong, Hong Kong SAR; Singapore, Singapore
Posted 6w agoOn-siteManagerMulti-agent Orchestration Eval harnesses
Software Engineer, Agents (Foundation Agents)
Fieldguide · San Francisco, CA
$190k–220k/yr
Posted 6w agoHybridEval harnesses
Senior Software Engineer, Agents (Foundation Agents)
Fieldguide · San Francisco, CA
$225k–250k/yr
Posted 6w agoHybridSeniorEval harnesses