Let’s get started
By clicking ‘Next’, I agree to the Terms of Service
and Privacy Policy, and consent to receive emails from Rise
Jobs / Job page
Senior Technical Program Manager, AI SW and ML Products image - Rise Careers
Job details

Senior Technical Program Manager, AI SW and ML Products

The AI Platform Inference Team is looking for a Technical Program Manager to lead initiatives and programs focused on Deep Learning Inference, with the goal of supporting NVIDIA's top AI Inference researchers and engineers in driving the future of deep learning. This position requires managing engineering programs using industry-leading processes to navigate an active and evolving roadmap. The manager will work alongside senior management and coordinate efforts with partners across the company to ensure alignment and exceptional execution. They will engage closely with our software, hardware, and tooling teams to foster strong engineering collaborations. Furthermore, they will develop and standardize planning, reporting, and execution practices and metrics to achieve ambitious objectives in a rapidly changing environment.

What You'll Be Doing:

  • Engage with cross-company teams (hardware/software engineering, product) to plan and coordinate programs to meet key business objectives.

  • Guide engineering programs in all aspects of program management – planning, forecasting, documenting, scheduling, effective meetings, multi-faceted prioritization, management of dependencies, reporting, and effective handling of critical and blocking issues.

  • Guide engineering teams in the use of agile methodologies.

  • Develop and implement metrics for measuring program effectiveness and improvement areas, collect and analyze data in support of planning and data driven decisions.

  • Report on overall program status, providing insights and recommendations to senior management.

  • Drive organizational alignment and efficiency by coordinating with multi-functional leads and streamlining processes.

  • Collaborate with hardware program managers and engineering teams to implement inference libraries on existing and new hardware.

What We Need To See:

  • Postgraduate degree in Computer Science or Artificial Intelligence or equivalent experience.

  • 10+ years program management experience including proven ability managing global projects, adaptable to multiple time zones.

  • Ability to think strategically and tactically and to build consensus to make programs successful.

  • Proven experience to creatively resolve technical issues and resource conflicts.

  • Thorough working knowledge of software engineering best practices and hardware bring-up.

  • You should be detail oriented with shown ability to multitask, in a dynamic environment with shifting priorities and changing requirements.

  • We need you to have hands-on experience with a fast-paced software development environment.

  • Excellent communication and technical presentation skills.

  • Having extensive experience with At Scale Agile tools, reporting, and process in support of this role is required.

  • Demonstrated skill in engaging and moderating successful engagements with engineering and product teams.

Ways To Stand Out From The Crowd:

  • Background in Computer Science, Machine Learning, Deep Learning, open-source Software, infrastructure technologies, and GPU technology.

  • Strong background in Machine Learning, Deep Learning, and Artificial Intelligence applications.

  • Prior experience in software-hardware bring-up, production application software development, release management.

  • Prior experience in the management of hardware and software development including all stages involved.

  • Consistent track record of driving process improvements and measuring efficiency.

The base salary range is 160,000 USD - 304,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

#deeplearning
NVIDIA Glassdoor Company Review
4.6 Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon Glassdoor star icon
NVIDIA DE&I Review
No rating Glassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star iconGlassdoor star icon
CEO of NVIDIA
NVIDIA CEO photo
Jensen Huang
Approve of CEO

Average salary estimate

$232375 / YEARLY (est.)
min
max
$160000K
$304750K

If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.

Similar Jobs
Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA invites an experienced Senior Machine Learning Engineer to drive cutting-edge low-precision LLM training innovations within their pioneering AI computing platform.

Photo of the Rise User
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave

NVIDIA seeks an experienced Developer Relations Manager to lead CAE-focused collaborations and developer outreach in cutting-edge accelerated computing technology.

Photo of the Rise User
Dewberry Hybrid Owings Mills
Posted 4 days ago

Experienced Project Manager needed to lead commercial utilities and renewable energy projects at Dewberry, a prominent professional services firm.

Photo of the Rise User
Capital Factory Hybrid No location specified
Posted 11 days ago

Lead and orchestrate high-profile startup and innovation events for Capital Factory in Austin, creating impactful experiences that engage a dynamic tech community.

Photo of the Rise User

Lead new product and business activities governance as a Program Manager at Santander, driving operational risk controls and strategic program execution within Corporate and Investment Banking.

Photo of the Rise User
Posted 6 days ago

Experienced Senior Project Manager needed to lead utility-scale energy storage projects at CS Energy, a prominent renewable energy EPC company.

Photo of the Rise User
Posted 12 days ago

A remote Project Manager role at PG Forsta focusing on managing client projects from inception to completion in a dynamic, collaborative environment.

Photo of the Rise User
Sunrise Labs Hybrid Bedford, New Hampshire, United States
Posted 12 days ago

Experienced Program Manager sought to lead software and hardware teams developing advanced medical device technologies in a hybrid work environment.

Photo of the Rise User
Microsoft Hybrid Redmond, Washington, United States
Posted 7 days ago
Inclusive & Diverse
Mission Driven
Social Impact Driven
Passion for Exploration
Dare to be Different
Diversity of Opinions
Reward & Recognition
Empathetic
Feedback Forward
Work/Life Harmony
Collaboration over Competition
Growth & Learning
Transparent & Candid
Customer-Centric
Rise from Within
Friends Outside of Work
Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Resources
Life insurance
Disability Insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
Learning & Development
Work Visa Sponsorship
Employee Resource Groups
401K Matching
Paid Time-Off
Maternity Leave
Social Gatherings
Company Retreats

Lead program management efforts to enhance Microsoft's Azure Data Fabric platform supportability, delivering unified data solutions for customers.

Photo of the Rise User

Emory Healthcare is seeking a Program Manager, Strategic Ops, to lead multiple key operational projects supporting short and long-term organizational strategies.

Photo of the Rise User

Eurofins Scientific seeks a Software Implementation Project Manager & Educator to manage IT system deployments and deliver training in a hybrid role based in Lancaster, PA.

Posted 11 days ago

Lead VHIE engagement and training initiatives remotely for Kentro, empowering healthcare providers to securely share veteran patient health information.

Photo of the Rise User
Posted 12 days ago

Lead complex, high-impact clinical lab programs at Exact Sciences, advancing cancer detection solutions with Agile project management expertise.

Posted 5 days ago

Lead and execute strategic AI productivity programs as Senior Program Manager at Oura, a company focused on empowering healthier lives through innovative wearable technology.

Photo of the Rise User
UpSwell Hybrid Glen Allen, Virginia, United States
Posted 13 days ago

Dynamic Junior IT Project Manager position at UpSwell supporting diverse projects and driving critical IT initiatives in a hybrid work environment.

NVIDIA is a publicly traded, multinational technology company headquartered in Santa Clara, California. NVIDIA's invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, and ignited the era of modern AI.

130 jobs
MATCH
Calculating your matching score...
BADGES
Badge ChangemakerBadge Diversity ChampionBadge Family FriendlyBadge Global CitizenBadge Work&Life Balance
CULTURE VALUES
Customer-Centric
Mission Driven
Inclusive & Diverse
Rise from Within
Diversity of Opinions
Work/Life Harmony
Growth & Learning
Transparent & Candid
BENEFITS & PERKS
Medical Insurance
Paid Time-Off
Maternity Leave
Mental Health Resources
Equity
Child Care stipend
Paternity Leave
WFH Reimbursements
Flex-Friendly
Dental Insurance
Vision Insurance
Life insurance
Health Savings Account (HSA)
Flexible Spending Account (FSA)
401K Matching
Military leave
FUNDING
SENIORITY LEVEL REQUIREMENT
TEAM SIZE
EMPLOYMENT TYPE
Full-time, unknown
DATE POSTED
July 18, 2025
Risa star 🔮 Hi, I'm Risa! Your AI
Career Copilot
Want to see a list of jobs tailored to
you, just ask me below!