In-Demand senior product manager, ai inference dynamo Jobs in remote

Senior Product Manager, AI Inference - Dynamo
NVIDIA —Remote
- Full-time
- Remote
- Computer science
- Computer Science
- Master's degree
2d
Senior Product Manager (Australia)
League Inc. —Remote
- $150,000 - $175,000 a year
- Remote
- Analysis skills
- Product management
- Agile
Senior Product Manager
Gridsight —Remote
- Full-time
- Remote
- Research
- Product management
- APIs
Quick Apply
13d
Head of Business Operations
Glitch Productions —Remote
- Full-time
- Remote
- CRM software
- No degree
Manager, People Operations
Ampd Energy —Remote
- Full-time
- Remote
- AI
Senior Data Scientist
Cotiviti —Remote
- Full-time
- AWS
- Agile
- AI
Senior Customer Success Manager
Tanium —Remote
- Salesforce
- Education
- Bachelor's degree
SCRA I
Syneos - Clinical and Corporate - Prod —Remote
- Full-time
- Remote
- Bachelor's degree
- Patient care
- Computer skills
5d
FinCrime Risk Manager (Investigations)
Revolut —Remote
- Full-time
- Remote
- Data analysis skills
- SQL
- Presentation skills
Senior Forward Deploy Engineer
Armada —Remote
- Remote
- AI
Senior Solutions Engineer, Sydney
Wiz —Remote
- Remote
- Azure
- AWS
HR Specialist, Contracts Management - APAC
Remote —Remote
- $29,750 - $67,000 a year
- Full-time
- Remote
- Google Suite
- Conflict management
- AI
- Annual leave
- Work from home
Senior Account Manager / Executive
Vonage —Remote
- Remote
- Salesforce
- APIs
- Communication skills
Senior Solutions Engineer, Melbourne
Wiz —Remote
- Remote
- Azure
- AWS
Senior Delivery Manager (Insurance experience)
Five Sigma —Remote
- Full-time
- Remote
- PMP
- Writing skills
- Organisational skills
Quick Apply
Sr. Clinical Research Associate (Australia)
Alimentiv —Remote
- $58,000 - $96,500 a year
- Full-time
- Patient monitoring
- AI
- Communication skills
Quick Apply
10h
Senior Solution Architect, AI Compute Engineer - NVIS
NVIDIA —Remote
- Full-time
- Remote
- Management
- Doctoral degree
- Computer Science
SMB Senior Account Executive
GitHub, Inc. —Remote
- $115,000 a year
- Full-time
- Remote
- Sales
- Master's degree
- Administrative experience
Senior Product Designer
Kevel —Remote
- Full-time
- Remote
- APIs
- AI
- Annual leave
- Work from home
Quick Apply
Territory Sales Manager - SA
National Agri-Solutions —Remote
- Full-time
- Remote

I want to receive the latest job alert for senior product manager, ai inference dynamo in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

senior product manager, ai inference dynamo jobs near remote

Operations Manager jobs in Remote

Insurance Manager jobs in Remote

Senior Citizens jobs in Sydney Western Suburbs Nsw

Senior Project Manager jobs in South Australia

Senior Manager Utilities jobs in Melbourne Vic

Senior Solution Architect jobs in Melbourne Vic

Senior Solution Architect jobs in Campbelltown Nsw

Senior Solution Architect jobs in New South Wales

Senior Citizens jobs in Greater Adelaide Sa

Senior Citizens jobs in Melbourne Vic

Senior Product Designer jobs in Melbourne Vic

Senior Product Designer jobs in Sydney Nsw

Senior Product Designer jobs in Brisbane Qld

Senior Product Designer jobs in Southbank Vic

Senior Business Analyst jobs in Melbourne Vic

Operations Manager jobs in New South Wales

Office Manager jobs in Sydney Nsw

Operations Manager jobs in Narellan Vale Nsw

Event Manager jobs in Sydney Nsw

Operations Manager jobs in Epping Vic

Senior Product Manager, AI Inference - Dynamo

NVIDIA -
Remote

Apply Now

Job Details

Full-time
2 days ago

Qualifications

Computer science
Law
Computer Science
Master's degree
Bachelor's degree
Product management
AI
SDLC

Full Job Description

NVIDIA is seeking a highly technical Product Manager to own the evolution of NVIDIA Dynamo, our flagship distributed inference framework. In this role, you will define the roadmap for high-scale LLM and Generative AI serving, bridging the gap between cutting-edge hardware (Vera Rubin, LPU, and NVLink) and software optimizations, like disaggregated serving, KV aware routing, and intelligent KV cache management. We need a self-starter to continue growing the product portfolio and work with the customers to incorporate model evaluation into end-2-end LLM workflows. We're looking for the rare blend of technical and product skills and passion for groundbreaking technology. If this fits, we would love to learn more about you!

What you'll be doing:

Core Dynamo Architecture: Drive the product strategy for Dynamo’s modular components, including the KV-aware Router, KV Block Manager (KVBM), and communication planes.
Inference Orchestration: Define requirements for sophisticated routing logic that minimizes redundant prefill and optimizes Time to First Token (TTFT) across substantial GPU clusters.
Memory & KV Cache Management: Define strategy for multi-tier KV cache offloading enabling long-context windows and high-concurrency serving without compromising user experience.
Hardware-Software Co-Design: Collaborate with engineering to ensure Dynamo extracts maximum performance from NVIDIA hardware.
Agentic Inference: Develop Agent-first capabilities (e.g. priority, output length, cache pinning) to support sophisticated, multi-turn reasoning.
Ecosystem Integration: Partner with open-source communities, e.g. vLLM, SGLang, TensorRT-LLM, and internal teams (NeMo Agent Toolkit).
Product Leadership: Author product requirements documents (PRDs) and software application designs docs (SADDs). Build for ease-of-use, extensibility, modularity. Work with TPMs to align roadmaps and respond to market trends.

What we need to see:

12+ years demonstrated ability in product management at a technology company, co-founder or related technical role in a startup or equivalent experience.
Bachelors Degree in Computer Science or related field (or equivalent experience).
Proven experience in AI inference, distributed systems, and GPU-accelerated computing.
Deep understanding of the LLM inference lifecycle (Prefill vs. Decode), KV cache mechanics, and distributed serving techniques, like Disaggregated Serving.
Ability to translate low-level technical capabilities into high-level business value (reduced TCO, faster TTFT).
Teamwork and influencing skills to optimally navigate in a highly matrixed environment. At NVIDIA, your entire company is on your team!
Empathy and deep care for your customers to build products people love.
Pragmatic and data-driven project management skills to navigate software development lifecycle requirements, product release schedules, and customer desires and deliver quality software on schedule.

Ways to stand out from the crowd:

Proven track record working with Agentic frameworks (LangChain, NeMo Agents) or building multi-turn, stateful AI applications.
Knowledge of trends around LLMs and Generative AI, Responsible AI, MLOps
Technical background and hands-on experience building AI (and LLM) solutions as an engineer. We expect you to have intuition for ML models and systems evaluation and read relevant research papers to inform your product strategy and roadmap.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Apply Now

Refine Your Search

senior product manager, ai inference dynamo jobs in remote

Senior Product Manager, AI Inference - Dynamo

Senior Product Manager (Australia)

Senior Product Manager

Head of Business Operations

Manager, People Operations

Senior Data Scientist

Senior Customer Success Manager

SCRA I

FinCrime Risk Manager (Investigations)

Senior Forward Deploy Engineer

Senior Solutions Engineer, Sydney

HR Specialist, Contracts Management - APAC

Senior Account Manager / Executive

Senior Solutions Engineer, Melbourne

Senior Delivery Manager (Insurance experience)

Sr. Clinical Research Associate (Australia)

Senior Solution Architect, AI Compute Engineer - NVIS

SMB Senior Account Executive

Senior Product Designer

Territory Sales Manager - SA

I want to receive the latest job alert for senior product manager, ai inference dynamo in remote

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected