In-Demand Senior engineer Jobs in Remote

Senior Product Manager, AI Inference - Dynamo
NVIDIA —Remote
- Full-time
- Remote
- Computer science
- Computer Science
- Master's degree
10d
Senior Product Manager
Gridsight —Remote
- Full-time
- Remote
- Research
- Product management
- APIs
Quick Apply
Manager, Service Continuous Improvement APAC
Zimmer Biomet —Remote
- Weekend availability
- Remote
- Management
- PMP
- Customer service
- Wellness program
Solutions Architect (AI Native SDLC)
EPAM Systems, Inc. —Remote
- Remote
- Azure
- Master's degree
- AWS
Solution Engineer
InEight —Remote
- Remote
- Management
- PMP
- Salesforce
Senior Software Maintenance Engineer (Technical Support, Linux, Kubernetes, Mandarin)
Red Hat, Inc. —Remote
- Contract
- Hybrid work
- Azure
- Management
- Databases
Senior Overlay Sales Executive , CIC (APJ)
Hyland Software —Remote
- Management
- Sales
- Bachelor's degree
Business Development Manager - U.S Defense
Emesent —Remote
- Full-time
- Remote
- Sales
- AI
- Communication skills
- Health insurance
- Employee assistance program
Sr. Engineer - Core Services and Libraries (Remote, AUS)
CrowdStrike —Remote
- Full-time
- Remote
- APIs
- Budgeting
- Parental leave
5h
Manager, Service Tech Support & Training APAC
Zimmer Biomet —Remote
- Weekend availability
- Management
- Salesforce
- English
- Wellness program
- On-the-job training

More jobs to discover

Find similar jobs that you might be interested in.

Senior Product Manager, AI Inference - Dynamo
NVIDIA —Remote
12+ years demonstrated ability in product management at a technology company, co-founder or related technical role in a startup or equivalent experience.
10d
Senior Product Manager
Gridsight —Remote
We’re hiring a Senior Product Manager to own the squad responsible for how Gridsight models, stores, and surfaces the electrical state of the grid.
Quick Apply

I want to receive the latest job alert for senior engineer in remote

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

senior engineer jobs near remote

Business Development Manager jobs in Remote

Sales Executive jobs in Melbourne Vic

Sales Executive jobs in Sydney Nsw

Executive Officer jobs in Canberra Act

Sales Executive jobs in South Melbourne Vic

High Ticket Sales No Experience jobs in Sydney Nsw

Ndis Support Coordinator jobs in Melbourne Vic

Technical Support Specialist jobs in Brisbane Qld

Support Worker No Experience jobs in Sunshine Coast Qld

Disability Support jobs in Wodonga Vic

Technical Support Specialist jobs in Berwick Vic

Technical Support Specialist jobs in Sydney Nsw

Disability Support Worker, Visa Sponsorship jobs in Greater Adelaide Sa

Technical Support Specialist jobs in Melbourne Northern Suburbs Vic

Solution Architect jobs in Sydney Nsw

Solution Architect jobs in Brisbane Qld

Solution Architect jobs in Majura Act

No Experience Architect jobs in Melbourne Vic

Solution Architect jobs in South Hobart Tas

Senior Product Manager jobs in Melbourne Vic

Senior Product Manager, AI Inference - Dynamo

NVIDIA -
Remote

Apply Now

Job Details

Full-time
10 days ago

Qualifications

Computer science
Law
Computer Science
Master's degree
Bachelor's degree
Product management
AI
SDLC

Full Job Description

NVIDIA is seeking a highly technical Product Manager to own the evolution of NVIDIA Dynamo, our flagship distributed inference framework. In this role, you will define the roadmap for high-scale LLM and Generative AI serving, bridging the gap between cutting-edge hardware (Vera Rubin, LPU, and NVLink) and software optimizations, like disaggregated serving, KV aware routing, and intelligent KV cache management. We need a self-starter to continue growing the product portfolio and work with the customers to incorporate model evaluation into end-2-end LLM workflows. We're looking for the rare blend of technical and product skills and passion for groundbreaking technology. If this fits, we would love to learn more about you!

What you'll be doing:

Core Dynamo Architecture: Drive the product strategy for Dynamo’s modular components, including the KV-aware Router, KV Block Manager (KVBM), and communication planes.
Inference Orchestration: Define requirements for sophisticated routing logic that minimizes redundant prefill and optimizes Time to First Token (TTFT) across substantial GPU clusters.
Memory & KV Cache Management: Define strategy for multi-tier KV cache offloading enabling long-context windows and high-concurrency serving without compromising user experience.
Hardware-Software Co-Design: Collaborate with engineering to ensure Dynamo extracts maximum performance from NVIDIA hardware.
Agentic Inference: Develop Agent-first capabilities (e.g. priority, output length, cache pinning) to support sophisticated, multi-turn reasoning.
Ecosystem Integration: Partner with open-source communities, e.g. vLLM, SGLang, TensorRT-LLM, and internal teams (NeMo Agent Toolkit).
Product Leadership: Author product requirements documents (PRDs) and software application designs docs (SADDs). Build for ease-of-use, extensibility, modularity. Work with TPMs to align roadmaps and respond to market trends.

What we need to see:

12+ years demonstrated ability in product management at a technology company, co-founder or related technical role in a startup or equivalent experience.
Bachelors Degree in Computer Science or related field (or equivalent experience).
Proven experience in AI inference, distributed systems, and GPU-accelerated computing.
Deep understanding of the LLM inference lifecycle (Prefill vs. Decode), KV cache mechanics, and distributed serving techniques, like Disaggregated Serving.
Ability to translate low-level technical capabilities into high-level business value (reduced TCO, faster TTFT).
Teamwork and influencing skills to optimally navigate in a highly matrixed environment. At NVIDIA, your entire company is on your team!
Empathy and deep care for your customers to build products people love.
Pragmatic and data-driven project management skills to navigate software development lifecycle requirements, product release schedules, and customer desires and deliver quality software on schedule.

Ways to stand out from the crowd:

Proven track record working with Agentic frameworks (LangChain, NeMo Agents) or building multi-turn, stateful AI applications.
Knowledge of trends around LLMs and Generative AI, Responsible AI, MLOps
Technical background and hands-on experience building AI (and LLM) solutions as an engineer. We expect you to have intuition for ML models and systems evaluation and read relevant research papers to inform your product strategy and roadmap.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Apply Now

Refine Your Search

senior engineer jobs in remote

Senior Product Manager, AI Inference - Dynamo

Senior Product Manager

Manager, Service Continuous Improvement APAC

Solutions Architect (AI Native SDLC)

Solution Engineer

Senior Software Maintenance Engineer (Technical Support, Linux, Kubernetes, Mandarin)

Senior Overlay Sales Executive , CIC (APJ)

Business Development Manager - U.S Defense

Sr. Engineer - Core Services and Libraries (Remote, AUS)

Manager, Service Tech Support & Training APAC

More jobs to discover

I want to receive the latest job alert for senior engineer in remote

Related Searches

Explore jobs in more locations

Job Seeker Tools

Employer Tools

Browse

Stay Connected