Inference & model-serving jobs

Serving roles — GPU, Triton, TensorRT, quantization, latency and throughput.

510 open roles

Open roles: 510
Median salary: $245k
Remote: 11%
Top skill: GPU

Hiring most:Nebius23Adobe19Cerebras16Inferact16Capital One13Together AI13

Common stack:GPU420Python370PyTorch235Kubernetes205Orchestration186Go148C++133AWS129Quantization125vLLM116

← All jobs RSS feed

Search

Principal Engineer, Product
Pika · Palo Alto HQ
Posted todayOn-sitePrincipalGPU PyTorch Kubernetes Docker
Lead Software Engineer, Advanced Pilot Assistant Software (Autonomy/Robotics)
Beacon AI · San Carlos - Hybrid
$224k–260k/yr
Posted todayHybridLeadGPU Python C++
Software Engineer, Cloud Infrastructure (Multiple Seniority Levels)
Beacon AI · San Carlos - Hybrid
$135k–260k/yr
Posted todayHybridLangChain RAG Pinecone pgvector
Software Engineer, Artificial Intelligence/LLM (Multiple Seniority Levels)
Beacon AI · San Carlos - Hybrid
$135k–260k/yr
Posted todayHybridLangChain RAG Pinecone Weaviate
Software Engineer, Computer Vision / Machine Learning
Muon Space · San Jose, CA
$212k–233k/yr
Posted todayOn-siteGPU PyTorch Computer vision CI/CD
Member of Technical Staff, Applied Research
Sieve · San Francisco
$150k–350k/yr
Posted todayOn-siteStaffGPU PyTorch Deep learning Python
AI Infrastructure Engineer, pAGI
OpenAI · San Francisco
$266k–500k/yr
Posted todayHybridOrchestration GPU
Forward Deployment Engineer
SambaNova Systems · Tokyo Prefecture, Japan
Posted todayOn-siteLangChain LlamaIndex DSPy vLLM
Applied AI Engineer
Chaos Industries · San Francisco, California, United States
$150k–170k/yr
Posted todayOn-siteGPU Computer vision CI/CD Python
Senior Machine Learning Engineer, Defensive Agent
Horizon3 AI · US, Remote
$211k–249k/yr
Posted todayRemoteSeniorvLLM Embeddings GPU Quantization
AI Data Scientist
Deciphex · Ireland
Posted 1d agoRemoteGPU Distillation PyTorch Python
Infrastructure Engineer
Simple AI · San Francisco
$250k/yr
Posted 1d agoOn-siteGPU Kubernetes CI/CD AWS
Forward Deployed Solution Engineer – Applied AI FDE
ServiceNow · Montreal, QUEBEC, Canada
Posted 3d agoHybridLangChain LlamaIndex vLLM Hugging Face
Senior Software Engineer, Machine Learning Platform
Chime · San Francisco, CA, USA
Posted 3d agoOn-siteSeniorRAG Tool use Orchestration GPU
Staff Engineer, Distributed Storage and HPC & AI Infrastructure
Together AI · Bangalore India
Posted 3d agoOn-siteStaffGPU Kubernetes Python Go
Machine Learning Engineering Technical Leader
Cisco · Seattle, Washington, US
$234k–297k/yr
Posted 4d agoOn-siteTool use Eval harnesses Quantization LoRA
Machine Learning Engineering Technical Leader - CX AI
Cisco · San Jose, California, US
$257k–333k/yr
Posted 4d agoOn-sitevLLM RAG Orchestration GPU
Senior Software Engineer — Infra Agent Systems
Together AI · San Francisco
$250k–300k/yr
Posted 4d agoOn-siteSeniorRAG Tool use Orchestration GPU
Principal Autonomy Software Engineer
Chaos Industries · El Segundo, California, United States
$240k–310k/yr
Posted 4d agoOn-sitePrincipalMulti-agent GPU Python Rust
Internship 2027 Onboard Infrastructure Engineer, ML Inference
Bedrock Robotics · San Francisco, CA
Posted 4d agoHybridInternvLLM GPU TensorRT Quantization
Staff Engineer, Machine Learning Systems & Reliability - Moveworks
ServiceNow · Mountain View, CALIFORNIA, United States
Posted 4d agoOn-siteStaffGPU Kubernetes CI/CD Python
Senior ML Researcher
Toloka · European Union
Posted 4d agoOn-siteSeniorDSPy vLLM Tool use Eval harnesses
AI Engineer
Baseten · San Francisco
$175k–190k/yr
Posted 4d agoHybridGPU Go
Inference Engineering, Co-op
Inferact · San Francisco
Posted 4d agoOn-sitevLLM Orchestration GPU Triton
Principal Machine Learning Engineer
Workday · Ireland, Dublin
Posted 5d agoOn-sitePrincipalHugging Face Orchestration LangSmith GPU
Senior Software Development Engineer
Workday · Ireland, Dublin
Posted 5d agoOn-siteSeniorHugging Face Orchestration LangSmith GPU
Senior/Staff Software Engineer – LLM Inference & Reinforcement Learning Platform
Snowflake · US-WA-Bellevue
$236k–330k/yr
Posted 5d agoHybridStaffvLLM GPU Triton TensorRT
Performance Engineer, Inference Engine
Anthropic · San Francisco, CA | New York City, NY
$350k–850k/yr
Posted 5d agoOn-siteGPU Go Rust C++
Staff GPU Inference SDET
Cerebras · Sunnyvale, CA
Posted 5d agoHybridStaffOrchestration GPU Quantization PyTorch
Engineering Manager, ChatGPT Search Infrastructure
OpenAI · San Francisco
$445k/yr
Posted 5d agoOn-siteManagerOrchestration GPU
Inference Engineer
Hyperbolic · San Francisco, CA
Posted 5d agoOn-siteOrchestration GPU Quantization Kubernetes
Quantitative Researcher
Jane Street · Hong Kong, Hong Kong
Posted 5d agoOn-siteGPU Deep learning Python
Customer Experience Automations Manager
Nebius · Amsterdam, Netherlands
Posted 5d agoOn-siteManagerOrchestration GPU Kubernetes Python
AI Architecture Lead
Barclays · Canary Wharf, 1 Churchill Place
Posted 6d agoOn-siteLeadEmbeddings Orchestration GPU Kubernetes
Data Scientist II-1
Mastercard · Gurgaon, India
Posted 6d agoOn-siteGPU PyTorch TensorFlow Deep learning
Member of Technical Staff, New Grad (BS/MS)
Fireworks AI · San Mateo
$160k–180k/yr
Posted 6d agoOn-siteStaffRAG Embeddings GPU RLHF
Senior Staff AI Security Engineer
ServiceNow · Santa Clara, California, United States
$191k–334k/yr
Posted 6d agoHybridStaffRAG Quantization PyTorch TensorFlow
Staff Software Engineer - Backend
GoDaddy · United States
$182k–273k/yr
Posted 6d agoOn-siteStaffvLLM Orchestration GPU Triton
Member of Technical Staff, Systems Infrastructure (2026 PhD New Grad)
Fireworks AI · San Mateo
$200k–230k/yr
Posted 6d agoOn-siteStaffvLLM Embeddings GPU Triton
Member of Technical Staff, Research (2026 PhD New Grad)
Fireworks AI · San Mateo
$200k–300k/yr
Posted 6d agoOn-siteStaffEmbeddings GPU PyTorch TensorFlow
Technical Lead Manager, Synthetic Data
Wayve · London
Posted 6d agoOn-siteManagerOrchestration GPU Distillation PyTorch
Research Engineer (LLM Performance), London
Isomorphic Labs · London
Posted 6d agoOn-siteGPU Triton PyTorch Deep learning
Current Master's, AI Engineering Internship Program - Summer 2027
Capital One · New York, NY
$147k/yr
Posted 7d agoOn-siteInternLangChain LlamaIndex MCP GPU
Sr. Data Scientist - Gen AI (Remote)
CrowdStrike · United Kingdom - Remote
Posted 7d agoRemoteSeniorGPU Deep learning Python
Current PhD, AI Engineering Internship Program - Summer 2027
Capital One · New York, NY
$176k/yr
Posted 7d agoOn-siteInternLangChain LlamaIndex MCP GPU
Sr. Software Engineer, AI / ML Inference Platform
Dialpad · Buenos Aires, Argentina
Posted 7d agoOn-siteSeniorvLLM GPU Triton PyTorch
Training / AI Infrastructure
Genesis AI · London
Posted 7d agoHybridGPU Triton PyTorch Python
Simulation Infrastructure
Genesis AI · London
Posted 7d agoHybridGPU
Genesis-World: Core Physics Engineer
Genesis AI · London
Posted 7d agoHybridGPU Python Go
ML Compiler & System
Genesis AI · London
Posted 7d agoHybridGPU Triton PyTorch Python