Inference & model-serving jobs

Serving roles — GPU, Triton, TensorRT, quantization, latency and throughput.

530 open roles

Open roles: 530
Posted this week: 65
Median salary: $243k
Remote: 12%
Top skill: GPU

Hiring most:Capital One59Nebius31Together AI16SambaNova Systems15ServiceNow14Cerebras11

By level:Intern19Junior6Senior89Staff72Principal28Lead20Manager26

Common stack:GPU452Python384PyTorch240Go203Orchestration197Kubernetes193C++191AWS144vLLM129Quantization127

All jobs RSS feed

Search

Member of Technical Staff, Infrastructure
Harvey · San Francisco
$230k–340k/yr
Posted todayHybridStaffEval harnesses GPU PyTorch Python
Member of Technical Staff, Infrastructure
Harvey · New York
$230k–340k/yr
Posted todayHybridStaffEval harnesses GPU PyTorch Python
Staff Software Engineer, Sensing Systems
Chaos Industries · El Segundo, California, United States
$211k–290k/yr
Posted todayOn-siteStaffGPU Computer vision Docker Python
Software Engineer, Sensing Systems
Chaos Industries · El Segundo, California, United States
$154k–211k/yr
Posted todayOn-siteGPU Computer vision Docker Python
Talent Partner, Technical
Modal · New York
$180k–220k/yr
Posted todayOn-siteGPU
Principal Place and Route (PnR) Engineer
SambaNova Systems · Austin, Texas, United States; San Jose, California, United States
$1000k/yr
Posted todayOn-sitePrincipalvLLM GPU PyTorch Python
Senior Principal Model Bring-up Engineer
SambaNova Systems · Austin, Texas, United States; San Jose, California, United States
$208k–312k/yr
Posted todayOn-sitePrincipalvLLM Hugging Face Multi-agent GPU
Research Engineer, Index Intelligence
Exa · Zurich
Posted todayOn-siteEmbeddings GPU
Perception Engineer
Motional · Boston, Massachusetts, United States; Remote U.S.
$165k–198k/yr
Posted todayRemoteGPU TensorRT PyTorch Computer vision
Principal Software Engineer, ML & Media Infra
Pinterest · Palo Alto, CA; US; San Francisco, CA, US
$285k–450k/yr
Posted todayOn-sitePrincipalGPU Quantization Distillation Python
Senior Software Engineer
GoDaddy · India
Posted todayOn-siteSeniorvLLM Orchestration Triton Kubernetes
Member of Technical Staff - Security Eng.
Prime Intellect · San Francisco
$150k–300k/yr
Posted todayOn-siteStaffLangChain Tool use GPU Kubernetes
Data Scientist – Text mining/NLP
Netcompany · Brussels, Brussels, Belgium
Posted todayHybridHugging Face RAG GPU PyTorch
Assistant Vice President - Applied AI Engineer
Barclays · Bengaluru, Maruthi Onyx - TESCO TSA
Posted 1d agoOn-siteManagervLLM RAG Tool use Multi-agent
Software Engineer
Cisco · Bangalore, India
Posted 1d agoOn-siteHugging Face RAG Tool use Orchestration
Forward Deployed Engineer, Inference
Cohere · United States
$240k–415k/yr
Posted 1d agoOn-sitevLLM Orchestration GPU TensorRT
Anthropic Research Resident
Anthropic · London, UK
£265k–375k/yr
Posted 1d agoOn-siteGPU NLP Kubernetes
Anthropic Research Resident
Anthropic · San Francisco, CA | New York City, NY
$350k–500k/yr
Posted 1d agoOn-siteGPU NLP Kubernetes
Senior Support Engineer
Nebius · Remote - United States
$150k–200k/yr
Posted 1d agoRemoteSeniorOrchestration GPU Kubernetes AWS
AI Operations Engineer
Robinhood · Bellevue, WA; Menlo Park, CA; New York, NY
$132k–155k/yr
Posted 1d agoOn-siteRAG Orchestration GPU Kubernetes
AI/ML Engineer
Riverlane · Delft, NL
€70k–90k/yr
Posted 1d agoOn-siteGPU PyTorch Deep learning Python
Principal AI Enablement Engineer
VeriSign · Reston,Virginia,United States
$181k–245k/yr
Posted 1d agoOn-sitePrincipalvLLM RAG Embeddings Tool use
Senior, Machine Learning Research Scientist (Azar)
Match Group · Seoul, South Korea
Posted 1d agoHybridSeniorGPU
AI Researcher Intern
HackerRank · Onsite in Bangalore
Posted 1d agoOn-siteInternGPU LoRA PEFT Distillation
Principal Software Engineer, GenAI Platform
Roblox · San Mateo, CA, United States
$329k–362k/yr
Posted 1d agoOn-sitePrincipalRAG GPU Quantization Python
AI Engineer 4 (Gen AI Platform Services: Agentic Systems)
Capital One · San Francisco, CA
$197k–225k/yr
Posted 2d agoOn-siteHugging Face Multi-agent GPU PyTorch
AI Platform Engineer II
GSK · Bengaluru Luxor North Tower
Posted 2d agoOn-siteLangChain vLLM RAG pgvector
Lead AI Platform Engineer
Mastercard · New York City, New York
Posted 2d agoOn-siteLeadRAG GPU Kubernetes Docker
Autonomous Systems Security Engineer
Anthropic · Remote-Friendly (Travel Required) | San Francisco, CA
$320k–405k/yr
Posted 2d agoRemoteGPU
Senior Software Engineer, ML API – AI Inference
Cerebras · Toronto, CAN
Posted 2d agoHybridSeniorvLLM Hugging Face Tool use Orchestration
(Senior/Junior AI Inference Reliability Engineer, Compute Infra
Together AI · San Francisco
$160k–280k/yr
Posted 2d agoOn-siteSeniorGPU LoRA Kubernetes
ML Infrastructure Engineer - New Grad
SambaNova Systems · Austin, Texas, United States; San Jose, California, United States
$131k–197k/yr
Posted 2d agoOn-siteJuniorvLLM Tool use GPU TensorRT
Compiler Engineer - New Grad
SambaNova Systems · Austin, Texas, United States; San Jose, California, United States
$131k–197k/yr
Posted 2d agoOn-siteJuniorGPU Python C++
Machine Learning Engineer, Driving Foundation Models
42dot · Sunnyvale, United States
$175k–250k/yr
Posted 2d agoOn-sitevLLM Hugging Face GPU Quantization
AI Infrastructure Engineer
Mercor · San Francisco
$200k–400k/yr
Posted 2d agoOn-sitevLLM Orchestration GPU Triton
AI Software Engineer
Second Front Systems · Remote
$150k–160k/yr
Posted 2d agoRemoteLangChain vLLM RAG Embeddings
AI Research Resident (Algorithms Codesign)
Normal Computing · New York
$150k/yr
Posted 2d agoOn-siteGPU Quantization Python Rust
Data Scientist/Senior Data Scientist - Gen AI (5 to 10 Years)
Fractal Analytics · Noida
Posted 3d agoOn-siteSeniorHugging Face GPU Quantization PEFT
AI Engineer 4 (MLX, Agentic AI, Gen AI workflows, GraphRAG)
Capital One · New York, NY
$197k–225k/yr
Posted 3d agoOn-siteHugging Face Multi-agent GPU PyTorch
Senior Engineer - AI Platform
Barclays · Bengaluru, Maruthi Onyx - TESCO TSA
Posted 3d agoOn-siteSeniorLangChain vLLM RAG MCP
Software Engineer, Networking (Agent Infra)
Baseten · San Francisco
$160k–330k/yr
Posted 3d agoHybridGPU Go Rust C++
Security Data Engineer
Anthropic · Remote-Friendly (Travel Required) | San Francisco, CA
$320k–405k/yr
Posted 3d agoRemoteGPU
Machine Learning Scientist - Molecular Force Fields
SandboxAQ · United States
$134k–252k/yr
Posted 3d agoRemoteGPU PyTorch Python
Computational Chemist - Machine Learned Force Fields, Material Discovery
SandboxAQ · United States
$134k–252k/yr
Posted 3d agoRemoteGPU PyTorch Python
Machine Learning Engineer Intern (3-month Internship)
Moloco · Seoul, Korea
Posted 3d agoOn-siteInternGPU Python Go
Model Operations Lead, AI Gateway
Cloudflare · In-Office
$230k–317k/yr
Posted 3d agoOn-siteLeadTool use Eval harnesses Quantization Python
Staff AI Application Engineer - Heterogeneous Computing
Axelera AI · Hybrid/Remote - Europe (incl. UK)
Posted 3d agoRemoteStaffMCP GPU PyTorch Python
Platform Engineer - Enterprise AI
Turing · New York, New York, United States
Posted 3d agoOn-sitevLLM Triton Kubernetes CI/CD
Senior AI Application Engineer - LLM & VLM Enablement
Axelera AI · Hybrid/Remote - Europe (incl. UK)
Posted 3d agoRemoteSeniorvLLM Tool use MCP Triton
Associate Director/Director, Inference Engineering
Lila Sciences · Cambridge, MA USA; San Francisco, CA USA
$204k–348k/yr
Posted 3d agoOn-siteManagervLLM GPU TensorRT Quantization