In-Demand senior product manager, ai inference dynamo Jobs in remote

Senior Product Manager, AI Inference - Dynamo
NVIDIA —Remote
- Full-time
- Remote
- Computer science
- Computer Science
- Master's degree
2d
Senior Product Manager (Australia)
League Inc. —Remote
- $150,000 - $175,000 a year
- Remote
- Analysis skills
- Product management
- Agile
Senior Product Manager
Gridsight —Remote
- Full-time
- Remote
- Research
- Product management
- APIs
Quick Apply
13d
Head of Business Operations
Glitch Productions —Remote
- Full-time
- Remote
- CRM software
- No degree
Manager, People Operations
Ampd Energy —Remote
- Full-time
- Remote
- AI
Senior Data Scientist
Cotiviti —Remote
- Full-time
- AWS
- Agile
- AI
Manager, Service Continuous Improvement APAC
Zimmer Biomet —Remote
- Weekend availability
- Remote
- Management
- PMP
- Customer service
- Wellness program
Solutions Architect (AI Native SDLC)
EPAM Systems, Inc. —Remote
- Remote
- Azure
- Master's degree
- AWS
11d
Manager, Service Tech Support & Training APAC
Zimmer Biomet —Remote
- Weekend availability
- Management
- Salesforce
- English
- Wellness program
- On-the-job training
Senior Customer Success Manager
Tanium —Remote
- Salesforce
- Education
- Bachelor's degree
FinCrime Risk Manager (Investigations)
Revolut —Remote
- Full-time
- Remote
- Data analysis skills
- SQL
- Presentation skills
SCRA I
Syneos - Clinical and Corporate - Prod —Remote
- Full-time
- Remote
- Bachelor's degree
- Patient care
- Computer skills
5d
Senior Solutions Engineer, Sydney
Wiz —Remote
- Remote
- Azure
- AWS
HR Specialist, Contracts Management - APAC
Remote —Remote
- $29,750 - $67,000 a year
- Full-time
- Remote
- Google Suite
- Conflict management
- AI
- Annual leave
- Work from home
Senior Forward Deploy Engineer
Armada —Remote
- Remote
- AI
Senior Delivery Manager (Insurance experience)
Five Sigma —Remote
- Full-time
- Remote
- PMP
- Writing skills
- Organisational skills
Quick Apply
Senior Account Manager / Executive
Vonage —Remote
- Remote
- Salesforce
- APIs
- Communication skills
Senior Solutions Engineer, Melbourne
Wiz —Remote
- Remote
- Azure
- AWS
Senior Solution Architect, AI Compute Engineer - NVIS
NVIDIA —Remote
- Full-time
- Remote
- Management
- Doctoral degree
- Computer Science
Sr. Clinical Research Associate (Australia)
Alimentiv —Remote
- $58,000 - $96,500 a year
- Full-time
- Patient monitoring
- AI
- Communication skills
Quick Apply
12h

I want to receive the latest job alert for senior product manager, ai inference dynamo in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

senior product manager, ai inference dynamo jobs near remote

Operations Manager jobs in Remote

Insurance Manager jobs in Remote

Senior Citizens jobs in Sydney Western Suburbs Nsw

Senior Project Manager jobs in South Australia

Senior Manager Utilities jobs in Melbourne Vic

Senior Solution Architect jobs in Melbourne Vic

Senior Solution Architect jobs in Campbelltown Nsw

Senior Solution Architect jobs in New South Wales

Solution Architect jobs in Sydney Nsw

Solution Architect jobs in Brisbane Qld

Solution Architect jobs in Majura Act

No Experience Architect jobs in Melbourne Vic

Solution Architect jobs in South Hobart Tas

Operations Manager jobs in New South Wales

Office Manager jobs in Sydney Nsw

Operations Manager jobs in Narellan Vale Nsw

Event Manager jobs in Sydney Nsw

Operations Manager jobs in Epping Vic

Visa Sponsorship,hotel Manager jobs in Sydney Nsw

Operations Manager jobs in Port Kembla Nsw

Senior Product Manager, AI Inference - Dynamo

NVIDIA -
Remote

Apply Now

Job Details

Full-time
2 days ago

Qualifications

Computer science
Law
Computer Science
Master's degree
Bachelor's degree
Product management
AI
SDLC

Full Job Description

NVIDIA is seeking a highly technical Product Manager to own the evolution of NVIDIA Dynamo, our flagship distributed inference framework. In this role, you will define the roadmap for high-scale LLM and Generative AI serving, bridging the gap between cutting-edge hardware (Vera Rubin, LPU, and NVLink) and software optimizations, like disaggregated serving, KV aware routing, and intelligent KV cache management. We need a self-starter to continue growing the product portfolio and work with the customers to incorporate model evaluation into end-2-end LLM workflows. We're looking for the rare blend of technical and product skills and passion for groundbreaking technology. If this fits, we would love to learn more about you!

What you'll be doing:

Core Dynamo Architecture: Drive the product strategy for Dynamo’s modular components, including the KV-aware Router, KV Block Manager (KVBM), and communication planes.
Inference Orchestration: Define requirements for sophisticated routing logic that minimizes redundant prefill and optimizes Time to First Token (TTFT) across substantial GPU clusters.
Memory & KV Cache Management: Define strategy for multi-tier KV cache offloading enabling long-context windows and high-concurrency serving without compromising user experience.
Hardware-Software Co-Design: Collaborate with engineering to ensure Dynamo extracts maximum performance from NVIDIA hardware.
Agentic Inference: Develop Agent-first capabilities (e.g. priority, output length, cache pinning) to support sophisticated, multi-turn reasoning.
Ecosystem Integration: Partner with open-source communities, e.g. vLLM, SGLang, TensorRT-LLM, and internal teams (NeMo Agent Toolkit).
Product Leadership: Author product requirements documents (PRDs) and software application designs docs (SADDs). Build for ease-of-use, extensibility, modularity. Work with TPMs to align roadmaps and respond to market trends.

What we need to see:

12+ years demonstrated ability in product management at a technology company, co-founder or related technical role in a startup or equivalent experience.
Bachelors Degree in Computer Science or related field (or equivalent experience).
Proven experience in AI inference, distributed systems, and GPU-accelerated computing.
Deep understanding of the LLM inference lifecycle (Prefill vs. Decode), KV cache mechanics, and distributed serving techniques, like Disaggregated Serving.
Ability to translate low-level technical capabilities into high-level business value (reduced TCO, faster TTFT).
Teamwork and influencing skills to optimally navigate in a highly matrixed environment. At NVIDIA, your entire company is on your team!
Empathy and deep care for your customers to build products people love.
Pragmatic and data-driven project management skills to navigate software development lifecycle requirements, product release schedules, and customer desires and deliver quality software on schedule.

Ways to stand out from the crowd:

Proven track record working with Agentic frameworks (LangChain, NeMo Agents) or building multi-turn, stateful AI applications.
Knowledge of trends around LLMs and Generative AI, Responsible AI, MLOps
Technical background and hands-on experience building AI (and LLM) solutions as an engineer. We expect you to have intuition for ML models and systems evaluation and read relevant research papers to inform your product strategy and roadmap.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Apply Now

Refine Your Search

senior product manager, ai inference dynamo jobs in remote

Senior Product Manager, AI Inference - Dynamo

Senior Product Manager (Australia)

Senior Product Manager

Head of Business Operations

Manager, People Operations

Senior Data Scientist

Manager, Service Continuous Improvement APAC

Solutions Architect (AI Native SDLC)

Manager, Service Tech Support & Training APAC

Senior Customer Success Manager

FinCrime Risk Manager (Investigations)

SCRA I

Senior Solutions Engineer, Sydney

HR Specialist, Contracts Management - APAC

Senior Forward Deploy Engineer

Senior Delivery Manager (Insurance experience)

Senior Account Manager / Executive

Senior Solutions Engineer, Melbourne

Senior Solution Architect, AI Compute Engineer - NVIS

Sr. Clinical Research Associate (Australia)

I want to receive the latest job alert for senior product manager, ai inference dynamo in remote

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected