Senior Software Architect - Deep Learning and HPC Communications job opportunity at NVIDIA.



DatePosted 30+ Days Ago bot
NVIDIA Senior Software Architect - Deep Learning and HPC Communications
Experience: 3-years
Pattern: Remote
apply Apply Now
Salary:
Status:

Job

Copy Link Report
degreeOND
loacation Germany, Remote, Germany
loacation Germany, Remot..........Germany

NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU -- our invention -- serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars. What we are seeking: Come work for the team that brought to you NCCL, NVSHMEM & GPUDirect. Our GPU communication libraries are crucial for scaling Deep Learning and HPC applications! We're seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software. DL and HPC applications have a huge compute demands and already run at scales of up to tens of thousands of GPUs. GPUs are connected with high-speed interconnects (e.g. NVLink, PCIe) within a node and with high-speed networking (e.g. InfiniBand, Ethernet) across nodes. Efficient and fast communication between GPUs directly impacts end-to-end application performance. This impact continues to grow with the increasing scale of next generation systems. This is an outstanding opportunity to advance the state-of-the-art, break performance barriers, and deliver platforms the world has never seen before. Are you ready to build the new and innovative technologies that will help realize NVIDIA's vision? What you will be doing: Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems. Design and implement new communication technologies to accelerate AI and HPC workloads. Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects. Build proofs-of-concept, conduct experiments, and perform quantitive modeling to evaluate and drive new innovations. Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs) What we need to see: M.S./Ph.D. degree in CS/CE or equivalent experience. 3+ years of relevant experience. Excellent C/C++ programming and debugging skills. Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC). Deep understanding of operating systems, computer and system architecture. Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads. Strong experience with Linux. Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment. Ways to stand out from the crowd: Expertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc. Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications. Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment. NVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High-Performance Computing, and Visualization. Our teams are composed of driven, innovative professionals dedicated to pushing the boundaries of technology. We offer highly competitive salaries, an extensive benefits package, and a work environment that promotes diversity, inclusion, and flexibility. As an equal opportunity employer, we are committed to fostering a supportive and empowering workplace for all. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 221,250 PLN - 383,500 PLN for Level 3, and 292,500 PLN - 507,000 PLN for Level 4.




Other Ai Matches

ASIC Design Engineer, BOOT, Functional Safety and Power Management Applicants are expected to have a solid experience in handling BOOT, Functional Safety and Power Management related tasks
Software Engineering Manager - Data Center Systems Applicants are expected to have a solid experience in handling Job related tasks
Senior C++ Software Engineer - Chip Design Tools Applicants are expected to have a solid experience in handling Job related tasks
Senior Math Libraries Engineer - Sparse Linear Algebra Applicants are expected to have a solid experience in handling Job related tasks
Senior RTL Analysis Methodology Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Solutions Architect, NPN Applicants are expected to have a solid experience in handling NPN related tasks
Boards Supply Planner Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Senior Supplier Quality Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Data Engineer Applicants are expected to have a solid experience in handling Job related tasks
Manufacturing Development Engineer Applicants are expected to have a solid experience in handling Job related tasks
Software Engineering Intern, Test Development - 2026 Applicants are expected to have a solid experience in handling Test Development - 2026 related tasks
Senior Counsel, Procurement and Real Estate Applicants are expected to have a solid experience in handling Procurement and Real Estate related tasks
Senior Manager, Marketing - GeForce Esports and Competitive Gaming Applicants are expected to have a solid experience in handling Marketing - GeForce Esports and Competitive Gaming related tasks
Senior Verification Engineer - Hardware Applicants are expected to have a solid experience in handling Job related tasks
Senior System Software Engineer - Firmware Applicants are expected to have a solid experience in handling Job related tasks
Deep Learning Senior Engineer, End-To-End Autonomous Driving Applicants are expected to have a solid experience in handling End-To-End Autonomous Driving related tasks
ASIC Design Engineer - New College Grad 2026 Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Senior Formal Verification Engineer Applicants are expected to have a solid experience in handling Job related tasks
Automotive Hardware Safety Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Corporate Counsel, M&A Applicants are expected to have a solid experience in handling M&A related tasks
Senior Data Center Performance Engineer - Benchmarking and Optimization Applicants are expected to have a solid experience in handling Job related tasks
Senior Software Engineer - NVIDIA Warp Applicants are expected to have a solid experience in handling Job related tasks
Senior Research Engineer, Robotics Systems Applicants are expected to have a solid experience in handling Robotics Systems related tasks