AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

413 open roles · showing 151–200

All jobs RSS feed

Search

Senior Fullstack Software Engineer, AI Observability & Evals Platform (NY)
LangChain · San Francisco, CA
$175k–240k/yr
Posted 3w agoOn-siteSeniorLangChain Eval harnesses LangSmith Python
Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)
LangChain · New York, NY
$180k–240k/yr
Posted 3w agoOn-siteSeniorLangChain Eval harnesses LangSmith AWS
Senior Software Engineer II
RELX · Oklahoma City, OK
$95k–159k/yr
Posted 3w agoOn-siteSeniorRAG Embeddings Reranking Tool use
Post-Training Applied Researcher
Baseten · San Francisco
$200k–275k/yr
Posted 3w agoHybridTool use Eval harnesses DPO Distillation
Senior Data Scientist AI Evaluation
Alpaca · Remote - Americas
Posted 3w agoRemoteSeniorEval harnesses LLM-as-judge Python
Principal ML Researcher
Toloka · European Union
Posted 3w agoOn-sitePrincipalvLLM Eval harnesses TensorRT Quantization
Senior AI Product Ops
Mastercard · Pune, India
Posted 3w agoOn-siteSeniorEval harnesses Go
Research Fellow
Snorkel AI · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
$72–165/hour
Posted 3w agoHybridEval harnesses
ML Engineer, LLM's
Knowtex · San Francisco
Posted 3w agoHybridvLLM Tool use LLM-as-judge GPU
Senior Staff AI Security Lead
IonQ · Remote, US
$180k–225k/yr
Posted 3w agoRemoteStaffEmbeddings Tool use Orchestration MCP
Applied AI Engineer, Beneficial Deployments (Clinical Development, Rare and Neglected Diseases)
Anthropic · London, UK
£225k–255k/yr
Posted 3w agoOn-siteMCP Eval harnesses Go
[Job-32145] AI Engineer (Enabling Team), Brasil
CI&T · Brazil
Posted 3w agoRemoteLangChain LlamaIndex RAG Embeddings
Senior Data Scientist
Payoneer · Herzliya, Tel Aviv District, Israel
Posted 3w agoOn-siteSeniorRAG LLM-as-judge PyTorch TensorFlow
Staff Applied AI Engineer - Enterprise AI Solutions
Snorkel AI · New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote)
$230k–360k/yr
Posted 3w agoHybridStaffLlamaIndex Hugging Face RAG Weaviate
Lead AI Ops Engineer
Mastercard · Gurgaon, India
Posted 3w agoOn-siteLeadEval harnesses Go
2027 Summer Intern, MS/PhD, Software Engineer, Eval Data Infra
Waymo · Mountain View, CA, USA
Posted 3w agoOn-siteInternEval harnesses Deep learning Python C++
AI Product Engineer - ClickStack
ClickHouse · United Kingdom
£90k–135k/yr
Posted 3w agoOn-siteTool use MCP Eval harnesses LLM-as-judge
Founding Machine Learning Engineer
Arcade AI · San Francisco, CA
$230k/yr
Posted 3w agoOn-siteLangChain LlamaIndex vLLM Embeddings
AI Enablement Lead
Firecrawl · San Francisco, CA
$235k–236k/yr
Posted 3w agoHybridLeadMCP Eval harnesses Go
Head of AI Native Operations
Supabase · Remote, Global
Posted 3w agoRemoteManagerOrchestration Eval harnesses Python TypeScript
Senior Software Engineer - Integrations 3P - Platform
Elastic · Romania
Posted 3w agoOn-siteSeniorMCP Eval harnesses Go Rust
Software Engineer, Agentic AI Systems
Rescale · Remote (United States)
$115k–159k/yr
Posted 3w agoRemoteRAG Eval harnesses Kubernetes AWS
Associate Director, AI for Oncology Clinical Development
AstraZeneca · US - Cambridge Kendall SQ - MA
$144k–216k/yr
Posted 3w agoOn-siteManagerEval harnesses
Senior Software Development Engineer, Agentic Memory & Evals Team
Zillow Group · Mexico City
Posted 3w agoOn-siteSeniorLangChain Orchestration MCP Eval harnesses
AI-Native Engineer, New Grad (Hybrid)
Clara · Monterrey / NLE / Mexico
Posted 3w agoOn-siteJuniorRAG Eval harnesses AWS Python
Staff Software Engineer, Cloud Infrastructure
Beacon AI · San Carlos - Hybrid
$224k–260k/yr
Posted 3w agoHybridStaffLangChain RAG Pinecone pgvector
Senior Software Engineer, Cloud Infrastructure
Beacon AI · San Carlos - Hybrid
$173k–225k/yr
Posted 3w agoHybridSeniorLangChain RAG Pinecone pgvector
Research Engineer, Robotics Evals
HUD · San Francisco
$100k–230k/yr
Posted 3w agoOn-siteEval harnesses Python
Applied AI Engineer, Video Agent
HeyGen · San Francisco, Palo Alto, Los Angeles, Toronto
$180k–240k/yr
Posted 3w agoOn-siteEval harnesses Python TypeScript Go
Principal Applied AI Engineer - Entity Agents
ZoomInfo · Remote
$172k–270k/yr
Posted 3w agoRemotePrincipalTool use Orchestration Eval harnesses Python
ML Engineering Lead (LLM Ops)
Neko Health · Stockholm
Posted 3w agoHybridLeadLangChain RAG Embeddings Orchestration
Senior AI Engineer, Agentic Governance
Adobe · Bucharest
Posted 4w agoOn-siteSeniorTool use MCP Eval harnesses AWS
Staff Engineer, Agentic Governance
Adobe · Bucharest
Posted 4w agoOn-siteStaffMCP Eval harnesses Kubernetes AWS
Mid or Senior Applied AI Engineer
Aviva · Poland - Warsaw - ASEC
Posted 4w agoOn-siteSeniorDSPy Hugging Face Embeddings Orchestration
Security Engineer, Business Continuity & Risk
Block · Bay Area, CA, United States of America
Posted 4w agoOn-siteTool use Eval harnesses Kubernetes CI/CD
AI Security Engineer, 2027 New Grad
Brain Co. · San Francisco Bay Area
Posted 4w agoHybridJuniorEval harnesses Kubernetes Docker CI/CD
AI Resident UK/EMEA
Ema · United Kingdom (Remote)
Posted 4w agoRemoteEval harnesses PyTorch Kubernetes CI/CD
Lead Data Scientist - AML Handling
Wise · London, United Kingdom
Posted 4w agoOn-siteLeadEval harnesses Python Go
Principal Engineer - Machine Learning
Freshworks · Hyderabad, TS, India
Posted 4w agoHybridPrincipalLangChain RAG Pinecone Weaviate
Principal Engineer - Machine Learning
Freshworks · Chennai, TN, India
Posted 4w agoHybridPrincipalLangChain RAG Pinecone Weaviate
Machine Learning Engineer, Applied AI
Brain Co. · New York City, NY
Posted 4w agoOn-siteTool use Eval harnesses Go
Software Engineer, Evaluation Infrastructure
xAI · Palo Alto, CA
$180k–440k/yr
Posted 4w agoOn-siteOrchestration Eval harnesses GPU PyTorch
Research Scientist/Research Engineer, Midtraining
Periodic Labs · Menlo Park, CA
$250k–350k/yr
Posted 4w agoOn-siteEval harnesses Distillation
Principal AI Architect
Rubrik · Palo Alto, CA
$254k–356k/yr
Posted 4w agoOn-sitePrincipalLlamaIndex RAG Pinecone Weaviate
Principal AI Product Engineer
Nscale · Houston; New York; San Francisco; Seattle
$290k–520k/yr
Posted 4w agoOn-sitePrincipalvLLM Orchestration Eval harnesses GPU
Staff Product Engineer
Parloa · Berlin Office; London Office; Munich Office; Remotely in Germany; Remotely in the UK
Posted 4w agoOn-siteStaffRAG Multi-agent Orchestration MCP
Senior Staff Machine Learning Engineer
Netradyne · Bengaluru, Karnataka, India
Posted 4w agoOn-siteStaffAnthropic API Hugging Face RAG Tool use
Staff Software Engineer-FullStack
Okta · Bengaluru, India
Posted 4w agoOn-siteStaffLangChain RAG MCP LangSmith
Senior Principal AI Solutions Engineer
SambaNova Systems · San Jose, California, United States
$234k–286k/yr
Posted 4w agoOn-sitePrincipalDSPy vLLM RAG Tool use
Research Engineer - Benchmarks
Firecrawl · San Francisco HQ; Toronto Hub
$250k–290k/yr
Posted 4w agoHybridEval harnesses LLM-as-judge Python Go