All jobs

Software Development Engineer II, Generative AI

At a glance

Salary
Not published
Location
Jersey City, NJ, United States
Work type
On-site
Posted
2w ago
Verified live
today
Experience
3+ years
Education
Bachelor's
Skills
RAGEmbeddingsLoRAPEFTPython

How the pay compares

This posting doesn't publish pay. 329 of the 398 RAG / Retrieval roles in the United States on this board do: the middle half pay $185k–$262k, with a median of $225k.

Middle half of the 329 that publish payMedian10th–90th percentileAnnual, USD

Apply on company site (opens in new tab)

Job description

This is a hands-on engineering role for someone who wants to build real GenAI systems — not prototypes. You'll work across the full lifecycle, from experimentation and prompt/RAG design through production deployment, observability, and iteration, partnering closely with senior engineers, product owners, and technical leadership.

  • Build features and components for production-grade GenAI products, with a focus on quality, reliability, and performance.
  • Implement and iterate on LLM-based solutions, including retrieval-augmented generation (RAG), prompt engineering, context Engineering, Loop Engineering and agentic workflows.
  • Write clean, well-tested, maintainable Python code and contribute to the broader codebase and infrastructure.
  • Help build evaluation and monitoring pipelines to measure output quality, groundedness, and reliability of GenAI features.
  • Work with foundation models and GenAI frameworks/tooling, evaluating tradeoffs between approaches under guidance from senior engineers.
  • Collaborate with Product Owners and cross-functional stakeholders to translate requirements into working technical solutions.
  • Participate in code reviews, design discussions, and engineering best practices across the GenAI development lifecycle.
  • Debug and resolve technical issues across the stack, escalating and collaborating with senior team members on complex problems.
  • (SDE II) Take ownership of medium-complexity features end-to-end, mentor SDE I engineers, and contribute to architecture and design decisions for GenAI components.
  • 3+ years of industry experience in software engineering, data science, or machine learning.
  • 1+ years of hands-on experience building GenAI/LLM-based features or applications, ideally in a production setting.
  • Strong Python skills and experience with modern AI/ML and GenAI frameworks and tooling.
  • Working understanding of LLMs, embeddings, RAG, prompt engineering, context Engineering, and GenAI architecture patterns.
  • Experience with cloud-native architectures and deploying scalable applications to production.
  • Understanding of GenAI evaluation, testing, monitoring, and responsible AI practices.
  • Ability to work with moderate autonomy, break down ambiguous problems, and communicate technical tradeoffs clearly.
  • Genuine curiosity and enthusiasm for learning new technologies, tools, and techniques in a fast-moving field.
  • Bachelor's degree in Computer Science, Software Engineering, Machine Learning, Data Science, or a related technical field.

Additional Qualifications

  • knowledge on fine-tuning or adapting LLMs (e.g., SFT, LoRA/PEFT, instruction tuning), including preparing training datasets or evaluating fine-tuned models against baselines is a plus.
  • Experience with agentic AI patterns or multi-step LLM workflows is a plus.

#LI-MB1

#LI-Hybrid

Apply on company site (opens in new tab)