Inference & model-serving jobs
Serving roles — GPU, Triton, TensorRT, quantization, latency and throughput.
252 open roles
- Open roles
- 252
- Median salary
- $229k
- Remote
- 12%
- Top skill
- Python
48% publish a range
12% hybrid
in 71% of roles
Hiring most: Graphcore 14 · Nebius 14 · Jump Trading 11 · Anduril 9 · Luma AI 8 · ServiceNow 8
Common stack: Python 180 · GPU 178 · PyTorch 133 · C++ 87 · Quantization 75 · TensorRT 75 · Kubernetes 74 · Orchestration 72 · Deep learning 70 · Triton 68
Filter these 252 roles Filter 252
-
Tech Lead, Autonomy Systems1X Technologies · San Carlos, CA$200k–350k/yr -
Research Engineer, Robotic Learning1X Technologies · San Carlos, CA$167k–350k/yr -
Principal, AI Research EngineeringZscaler · Remote - USA; San Jose, California, USA$172k–245k/yr -
Research Engineer, Large-Scale TrainingTogether AI · San Francisco$200k–290k/yr - Sr Staff Software EngineerServiceNow · Mountain View, CALIFORNIA, United States$191k–334k/yr
-
Sr Machine Learning Engineer, Adobe Firefly ServicesAdobe · San Jose$152k–265k/yr -
Senior Systems Engineer, Test Frameworks & Validation PlatformCoreWeave · Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA$153k–204k/yr -
Senior Systems Engineer, VirtualizationCoreWeave · Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA$182k–242k/yr - Senior Manager-AI AlgorithmAstraZeneca · China
- ML Research InternModal · New York$15k/month
- Senior Backend Engineer (ML)Tennr · New York City Office$200k–230k/yr
-
Staff Software Engineer, GPU InferenceCerebras · Toronto Office -
ML Platform EngineerSynthesia · Europe -
Senior Software Engineer - Model Evaluation & AI SystemsDeepgram · USA | Remote$180k–240k/yr - Software Engineer Intern - ML SystemsApptronik · Onsite - Austin, TX
-
Senior IoT Engineer, Applied IntelligenceAnduril · Santa Ana, California, United States - Research Engineer, Generative VideoCaptions · Union Square, New York City$175k–275k/yr
- Algorithm - Serving System ResearcherFuriosaAI · Seoul HQ
- Algorithm - Serving System EngineerFuriosaAI · Seoul HQ
-
Data Scientist - Gen AI (Remote)CrowdStrike · United Kingdom - Remote - Senior AI Software Developer (Canada Remote)Autodesk · AMER - Canada - Ontario - Offsite/HomeCAD 123k–180k/yr
- Tech Lead Manager, InferenceLuma AI · Redwood City, CA
- Software Engineer, InferenceLuma AI · Redwood City, CA
- Simulation Researcher/EngineerLuma AI · Redwood City, CA
- Research Scientist / Engineer – Training InfrastructureLuma AI · Redwood City, CA
- Research Scientist / Engineer – Reinforcement Learning InfrastructureLuma AI · Redwood City, CA
- Research Scientist / Engineer – Performance OptimizationLuma AI · Redwood City, CA
- Research Scientist / Engineer – Foundation Model: Core ResearchLuma AI · Redwood City, CA
- Research Scientist / Engineer — Foundation Model (Agent)Luma AI · Redwood City, CA
-
Staff Software Engineer- Foundation Model InferenceDatabricks · San Francisco, California$190k–265k/yr -
Software Engineer, Battlespace AwarenessAnduril · Broomfield, Colorado, United States; Fort Collins, Colorado, United States$126k–167k/yr -
AI Infrastructure Engineer, Serving PlatformScale AI · London, UK -
Applied Researcher II (AI Foundations)Capital One · New York, NY -
Applied Researcher I (AI Foundations)Capital One · New York, NY - Senior Machine Learning Engineer, Agentic Systems - MoveworksServiceNow · Mountain View, CALIFORNIA, United States$161k–274k/yr
- Senior Machine Learning Engineer, Agentic Systems - MoveworksServiceNow · Mountain View, CALIFORNIA, United States$161k–274k/yr
- Senior Agentic Search Infrastructure Engineer - MoveworksServiceNow · Mountain View, CALIFORNIA, United States$143k–243k/yr
-
Software Engineer, Sensor FusionAnduril · Broomfield, Colorado, United States; Fort Collins, Colorado, United States$126k–167k/yr -
Software Engineer, C++Anduril · Broomfield, Colorado, United States; Fort Collins, Colorado, United States$126k–167k/yr -
AI Field Engineer, SingaporeFireworks AI · Singapore -
Staff Software Engineer - Python, Computer VisionWarner Bros Discovery · Bangalore - Embassy Tech Village - Senior Machine Learning Engineer, LLM Inference OptimizationNebius · Palo Alto, California, United States$195k–262k/yr
- Senior Applied Scientist, Efficient LLM Inference & Model OptimizationNebius · Palo Alto, California, United States$195k–262k/yr
- Senior Machine Learning Engineer, Model Training and Reinforcement LearningNebius · Palo Alto, California, United States$195k–262k/yr
-
AI Field Engineer, EMEAFireworks AI · London -
Scientific Software EngineerAnduril · Broomfield, Colorado, United States; Fort Collins, Colorado, United States$126k–167k/yr -
Software Engineer, Air & Missile DefenseAnduril · Huntsville, Alabama, United States$165k–218k/yr -
Senior AI Software Developer – 3D Deep Learning (m/w/d)Smiths Group · Wiesbaden, HE, Germany€82k–92k/yr -
Senior Research Scientist | Model SteeringDeepL · London -
ML Infrastructure EngineerxAI · Palo Alto, California, United States$180k–440k/yr
No roles match those filters.