AI eval & model-quality engineer jobs

Model-quality roles — eval harnesses, LLM-as-judge, observability (LangSmith, Arize).

222 open roles · showing 151–200

← All jobs RSS feed

Staff AI Engineer - Agent Team

FurtherAI · San Francisco

$300k–400k/yr

Posted 7w ago On-site Staff Multi-agent Orchestration MCP Eval harnesses
Applied AI Engineer, Sarvam Agents

Sarvam AI · Bengaluru

Posted 7w ago On-site Mid RAG Embeddings Reranking Tool use
Senior Machine Learning Engineer

Coinbase · Remote - India

INR 6613k–6613k/yr

Posted 7w ago Remote Senior Multi-agent Orchestration LangSmith Deep learning
Staff+ Software Engineer, Safeguards Evals

Anthropic · San Francisco, CA | New York City, NY

$320k–485k/yr

Posted 7w ago On-site Staff Tool use Eval harnesses
Applied AI Engineer

Artos · San Francisco

$171k–242k/yr

Posted 7w ago Hybrid Mid RAG LangSmith CI/CD AWS
Forward Deployed Engineer

Normal Computing · New York City

$180k–325k/yr

Posted 7w ago Hybrid RAG Eval harnesses Python Go
AI Builder Intern

Scale AI · San Francisco, CA; New York, NY

$74k–93k/yr

Posted 8w ago On-site Intern LangChain RAG Multi-agent Eval harnesses
Staff Software Engineer, AI Developer Tools

Gusto · Denver, CO;New York, NY;Atlanta, GA;Seattle, WA;United States - Remote

$180k–245k/yr

Posted 8w ago Remote Staff RAG Multi-agent Eval harnesses CI/CD
Principal Engineer, AI

Anaplan · Pennsylvania-Remote, United States

Posted 8w ago Remote Principal vLLM RAG Pinecone Weaviate
Software Engineer, Product

Sierra · San Francisco, CA

$230k–390k/yr

Posted 8w ago On-site Eval harnesses TypeScript Go
Senior Platform Engineer, Ingestion

LangChain · Remote - Europe

Posted 8w ago Remote Senior LangChain LangSmith Kubernetes AWS
Principal Software Engineer, AI

Workday · Ireland, Dublin

€116k–174k/yr

Posted 8w ago On-site Principal LangChain LangSmith AWS Azure
Deployed Engineer (Seattle)

LangChain · Seattle, WA

$165k–380k/yr

Posted 8w ago On-site LangChain Orchestration LangSmith Kubernetes
Deployed Engineer (Boston)

LangChain · Boston, MA

$165k–380k/yr

Posted 8w ago On-site LangChain Orchestration LangSmith Kubernetes
Deployed Engineer (NYC)

LangChain · New York, NY

$165k–380k/yr

Posted 8w ago On-site LangChain Orchestration LangSmith Kubernetes
Senior Software Engineer I — Agentic Analytics

Instacart · Canada - Remote (ON, AB, BC, or NS Only)

CAD 168k–178k/yr

Posted 8w ago Remote Senior RAG Embeddings Eval harnesses Python
Forward Deployed Engineer - EMEA

Anysphere (Cursor) · London

Posted 8w ago Remote Eval harnesses Python TypeScript JavaScript
Engineering Manager, Evals

Anysphere (Cursor) · San Francisco

Posted 8w ago On-site Manager Eval harnesses
Research Scientist, Life Sciences

Anthropic · San Francisco, CA

$300k–320k/yr

Posted 8w ago On-site Senior Eval harnesses RLHF Deep learning Python
Solutions Architect (APAC)

LangChain · Remote - Singapore

Posted 8w ago Remote LangChain RAG Multi-agent LangSmith
AI Tooling Engineer

Qventus · Remote, United States

$120k–150k/yr

Posted 8w ago Remote Mid LangChain RAG Orchestration Eval harnesses
Software Engineer, RL Data

Anthropic · San Francisco, CA | New York City, NY

$320k–485k/yr

Posted 8w ago On-site Senior MCP Eval harnesses Kubernetes Docker
Principal Technical Architect

Workato · Hyderabad, India

Posted 2mo ago On-site Principal RAG Embeddings Orchestration MCP
Member of Technical Staff, Evals

Magic · San Francisco

$200k–550k/yr

Posted 2mo ago On-site Staff Eval harnesses
Principal Forward Deployed Engineer - Okta for AI Agents

Okta · Bellevue, Washington; Chicago, Illinois; San Francisco, California; Toronto, Ontario, Canada

$240k–360k/yr

Posted 2mo ago On-site Principal MCP Eval harnesses
Senior Member of Technical Staff, AI Quality

Harper · San Francisco

$176k–253k/yr

Posted 2mo ago On-site Staff Eval harnesses LLM-as-judge
Staff Engineer, Engineering Productivity & AI Quality

Harper · San Francisco

$250k–350k/yr

Posted 2mo ago On-site Staff Multi-agent Eval harnesses LLM-as-judge CI/CD
Staff Applied Scientist - Agentic Interfaces

Datadog · New York, New York, USA

$276k–345k/yr

Posted 2mo ago On-site Staff MCP Eval harnesses
MLOps Engineer

Apptronik · Onsite - Austin, TX

Posted 2mo ago On-site Eval harnesses TensorRT Kubernetes Docker
Staff Software Engineer, Agentic Platform

Docker · Seattle, WA

$170k–276k/yr

Posted 2mo ago Remote Staff Tool use Multi-agent Orchestration MCP
Member of Technical Staff- Research Engineer (Harness Engineering and Agentic Orchestration)

Tessl · London Office

Posted 2mo ago Hybrid Staff Orchestration Eval harnesses
Senior Forward Deployed Engineer - Okta for AI Agents

Okta · Bellevue, Washington; Chicago, Illinois; San Francisco, California; Toronto, Ontario, Canada

$200k–275k/yr

Posted 2mo ago On-site Senior LangChain MCP Eval harnesses Go
Principal AI Engineer

Salesforce · Mexico - Mexico City

Posted 2mo ago On-site Principal RAG Tool use Multi-agent Orchestration
Senior Software Engineer, Agent Platform

Klaviyo · Boston, MA

$148k–222k/yr

Posted 2mo ago On-site Senior LangChain vLLM Hugging Face RAG
Applied AI Engineer

HackerRank · Hybrid in Bangalore, India

Posted 2mo ago Hybrid Mid LangChain RAG Tool use Orchestration
AI Engineer - Database Engineering

Snowflake · US-CA-Menlo Park

$160k–230k/yr

Posted 2mo ago On-site RAG Tool use Orchestration Eval harnesses
Principal GenAI Data Engineer

Zscaler · Bellevue, Washington, USA; Dallas, Texas, USA; San Jose, California, USA

$182k–260k/yr

Posted 2mo ago On-site Principal RAG Embeddings LangSmith Arize
Senior AI Product Engineer 2, Audit

Drata · Hybrid - San Francisco

$192k–260k/yr

Posted 2mo ago Hybrid Senior LangChain RAG Orchestration MCP
Senior Platform Engineer 2, AI Tooling

Drata · Hybrid - San Francisco

$175k–236k/yr

Posted 2mo ago Hybrid Senior Anthropic API Tool use MCP Eval harnesses
Principal Machine Learning Engineer

Anaplan · London, United Kingdom

Posted 2mo ago On-site Principal vLLM RAG Pinecone Weaviate
Principal Engineer - AI

Anaplan · London, United Kingdom

Posted 2mo ago On-site Principal vLLM RAG Pinecone Weaviate
Software Engineer, RL Training Infra

OpenAI · San Francisco

$295k–445k/yr

Posted 2mo ago Hybrid Multi-agent Orchestration Eval harnesses Go
Agentic AI Engineer

Benchling · San Francisco, CA

$176k–265k/yr

Posted 2mo ago Hybrid LangChain RAG Pinecone pgvector
Agentic AI Engineer

Benchling · Remote, US

$176k–265k/yr

Posted 2mo ago Remote LangChain RAG Pinecone pgvector
Principal /Staff AI Engineer - Cortex Code Agentic System

Snowflake · US-CA-Menlo Park

$236k–339k/yr

Posted 2mo ago Hybrid Principal RAG Eval harnesses Python TypeScript
Staff Machine Learning Engineer, AV Core

Wayve · Sunnyvale

$336k–370k/yr

Posted 2mo ago On-site Staff Eval harnesses PyTorch Python C++
Software Engineer, Cortex AI Infrastructure

Snowflake · US-CA-Menlo Park

$160k–225k/yr

Posted 2mo ago On-site Mid RAG Orchestration Eval harnesses PyTorch
Senior Forward Deployed Engineer, Applied AI

Snowflake · US-CA-Menlo Park

$200k–270k/yr

Posted 2mo ago On-site Senior RAG Eval harnesses LangSmith Arize
Forward Deployed Engineer, Applied AI

Snowflake · US-CA-Menlo Park

$126k–182k/yr

Posted 2mo ago On-site RAG Eval harnesses LangSmith Arize
Applied AI Architect, Applied AI (Digital Natives Business)

Anthropic · Munich, Germany

Posted 2mo ago On-site Mid Anthropic API Eval harnesses Python