Senior Deep Learning Inference Performance Architect job opportunity at NVIDIA.

Home Jobs In United States Of America Tag: Job Senior Deep Learning Inference Performance Architect position at NVIDIA


DatePosted 30+ Days Ago bot
NVIDIA Senior Deep Learning Inference Performance Architect
Experience: 5-years
Pattern: full-time
Country:
apply Apply Now
Salary:
Status:

Job

Copy Link Report
degreePhD
loacation US, NC, Durham, United States Of America
loacation US, NC, Durham....United States Of America

We are now looking for a Senior Deep Learning Inference Performance Architect! NVIDIA is seeking a Senior Performance Architect - a creative engineer who loves to squeeze out every cycle of performance from deep learning software. The Inference Architecture team does groundbreaking hardware-software co-design work that focuses on accelerating AI Inference workloads. In this role, you will write performance optimized low level code on today’s GPUs,   evaluate and improve state-of-the-art performance techniques in production Large Language Model deployments, and he lp guide our future GPU architecture decisions.  If you are someone who enjoys digging deep into GPU architecture details, are passionate about AI, and know where every cycle goes when you write highly tuned software, this role may be a great fit for you.  What you’ll be doing: Develop innovative GPU and system architectures to extend the state of the art in AI Inference performance and efficiency Model, analyze and prototype key deep learning algorithms and applications Understand and analyze the interplay of hardware and software architectures on future algorithms and applications Write efficient software for AI Inference, including CUDA kernels, framework level code, and application level code Collaborate across the company to guide the direction of AI, working with software, research and product teams What we need to see: A MS or PhD in a relevant discipline (CS, EE, Math) or equivalent experience, with 5+ years or relevant experience Strong mathematical foundation in machine learning and deep learning Expert programming skills in C, C++, and Python Familiarity with GPU computing (CUDA or similar) and HPC (MPI, OpenMP) Strong knowledge and coursework in computer architecture Ways to stand out from the crowd: Background with systems-level performance modeling, profiling, and analysis Experience in characterizing and modeling system-level performance, executing comparison studies, and documenting and publishing results Experience in optimizing AI Inference workloads with CUDA kernel development NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard working people in the world working for us. If you're creative, autonomous, and love a challenge, consider joining our Inference Performance Architecture team and help us build the real-time, cost-effective computing platform driving our success in this exciting and quickly growing field. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits . Applications for this job will be accepted at least until January 13, 2026. This posting is for an existing vacancy.  NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Other Ai Matches

Product Management MBA Intern, Accelerated Computing GPU - Summer 2026 Applicants are expected to have a solid experience in handling Accelerated Computing GPU - Summer 2026 related tasks
Senior SWQA Test Development Engineer, SDET Applicants are expected to have a solid experience in handling SDET related tasks
remote-jobserver Remote
Senior Software Architect - Deep Learning and HPC Communications Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Senior ASIC Methodology Engineer - LPU Division Applicants are expected to have a solid experience in handling Job related tasks
Solutions Architect, HPC Systems Engineer Applicants are expected to have a solid experience in handling HPC Systems Engineer related tasks
Senior Software Integration and Debug Engineer Applicants are expected to have a solid experience in handling Job related tasks
Data Center Network Deployment Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Software Architect, GPU Networking Applicants are expected to have a solid experience in handling GPU Networking related tasks
Senior Solutions Architect, Robotics Infrastructure Applicants are expected to have a solid experience in handling Robotics Infrastructure related tasks
Senior Software Engineer, Chip Simulation Infra Applicants are expected to have a solid experience in handling Chip Simulation Infra related tasks
Senior Software Engineer, Networking Software Applicants are expected to have a solid experience in handling Networking Software related tasks
Compiler Verification Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Product Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Deep Learning Communication Architect Applicants are expected to have a solid experience in handling Job related tasks
Food and Beverage Manager Applicants are expected to have a solid experience in handling Job related tasks
Principal Software Engineer - Inference as a Service Applicants are expected to have a solid experience in handling Job related tasks
Senior System Software Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Platform Architect Applicants are expected to have a solid experience in handling Job related tasks
Senior Financial Analyst Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Senior Application Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior ASIC Design and STA Engineer Applicants are expected to have a solid experience in handling Job related tasks
Software Verification Team Manager, Networking Applicants are expected to have a solid experience in handling Networking related tasks
Principal Data and Asset Management Engineer Applicants are expected to have a solid experience in handling Job related tasks