Senior Networking Solution Test Engineer – AI Cluster Debugging job opportunity at NVIDIA.



DatePosted 7 Days Ago bot
NVIDIA Senior Networking Solution Test Engineer – AI Cluster Debugging
Experience: 8-years
Pattern: Remote
apply Apply Now
Salary:
Status:

Job

Copy Link Report
degreeGeneral
loacation Germany, Remote, Germany
loacation Germany, Remot..........Germany

We are looking for a Senior Networking Test Engineer with strong system‑level debugging skills to join our End‑to‑End Verification team! You will work on pioneering NVLink, Ethernet and InfiniBand ‑ based AI clusters. Additionally, you will ow complex issues across hardware, system software and AI workloads. What you’ll be doing: Design and review test and product requirements across the NVLink, Ethernet and InfiniBand / NIC / DPU / Switch portfolio, focusing on large‑scale AI cluster behavior. Build and maintain realistic customer‑like testbeds, including heterogeneous hardware, OS / driver combinations and complex network fabrics. Own end‑to‑end cluster troubleshooting: reproduce customer scenarios, triage across the stack and drive issues to root cause and fix. Read and understand relevant source code to identify defects, validate fixes and improve logging and instrumentation. Collaborate closely with development teams to debug NCCL, RoCE/RDMA and related networking components using logs, code inspection and targeted experiments. Define tests and guide the automation team to implement robust, debuggable suites that produce actionable logs, metrics and traces. Run Regression, Performance, Functional and Scale testing, analyze results and provide clear, data‑driven reports to collaborators. Profile and benchmark deep learning training and inference workloads, correlating model‑level metrics with system and network telemetry to uncover bottlenecks. What we need to see: B.A./B.Sc. in Computer Science, Electrical Engineering, or equivalent IT/Network/Systems experience. 8+ years of hands‑on networking or system‑level testing and debugging on Linux. Strong Linux networking and debugging skills (for example perf, tcpdump, ethtool, iproute2). Proven production‑grade debugging experience: forming hypotheses, running experiments, and driving issues to root cause under pressure. Expertise in host‑side NIC validation and tuning (offloads, queues, interrupts, firmware/driver interactions). Strong knowledge of AI networking libraries (such as NCCL) and protocols (such as RoCE and RDMA), including performance and correctness debugging. Ability to read and reason about source code (C/C++/Python or similar) and collaborate closely with developers on fixes. Solid scripting and automation skills with Bash / Python / Ansible for setup, log collection, and experiment orchestration. Fast learner, familiar with modern AI tools and workflows, able to adapt quickly. Excellent analytical, problem‑solving and communication skills, with strong ownership and a collaborative approach. Ways to stand out from the crowd: Hands‑on debugging of collective communication libraries (for example NCCL) or large‑scale LLM training / inference clusters. Experience with large cluster environments (tens to thousands of GPUs or nodes), including incident response and post‑mortem analysis. Deep expertise in tuning and debugging congestion control and lossless Ethernet for AI workloads (for example DCQCN, ECN, PFC). Familiarity with NVIDIA networking technologies (for example BlueField / BF3, ConnectX NICs) and their software stack and diagnostics. Experience debugging issues that span multiple layers (L2/L3, transport, AI frameworks) or contributing to open‑source networking / AI systems. At NVIDIA, we value diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We provide reasonable accommodations to ensure all individuals can participate in the job application or interview process, perform essential job functions, and receive other benefits and privileges of employment. Join us and be part of a team that's pushing the boundaries of technology and making a real impact in the world.

Other Ai Matches

Senior ASIC Design Engineer, Memory Controller Applicants are expected to have a solid experience in handling Memory Controller related tasks
Implementation Methodology Engineer - GPU Applicants are expected to have a solid experience in handling Job related tasks
CPO Integration Engineer - LPU Packaging Applicants are expected to have a solid experience in handling Job related tasks
Principal Quantum Error Correction Research Scientist, Applied Research Applicants are expected to have a solid experience in handling Applied Research related tasks
System Software Engineer - Tegra Applicants are expected to have a solid experience in handling Job related tasks
AI Compiler Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior Software Developer Applicants are expected to have a solid experience in handling Job related tasks
System Design Engineer Applicants are expected to have a solid experience in handling Job related tasks
Senior GenAI Engagement Lead, Partner Platforms Applicants are expected to have a solid experience in handling Partner Platforms related tasks
Senior Product Quality and Reliability Engineer Applicants are expected to have a solid experience in handling Job related tasks
Manager, MCU Firmware Applicants are expected to have a solid experience in handling MCU Firmware related tasks
Formal Verification Infra Development Engineer Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Manager, Software Verification Applicants are expected to have a solid experience in handling Software Verification related tasks
Director, Technical Accounting Applicants are expected to have a solid experience in handling Technical Accounting related tasks
Senior PR Manager, AI Software Applicants are expected to have a solid experience in handling AI Software related tasks
Senior ASIC Engineer - Networking Chip Design Applicants are expected to have a solid experience in handling Job related tasks
Sales Development Specialist Applicants are expected to have a solid experience in handling Job related tasks
Senior System Software Engineer, Networking Linux Kernel - DGX Cloud Applicants are expected to have a solid experience in handling Networking Linux Kernel - DGX Cloud related tasks
Senior Technical Program Manager, Metropolis Manufacturing Applicants are expected to have a solid experience in handling Metropolis Manufacturing related tasks
Manager, Large Language Model Inference Applicants are expected to have a solid experience in handling Large Language Model Inference related tasks
Tools and Development Engineer Applicants are expected to have a solid experience in handling Job related tasks
System Architect Applicants are expected to have a solid experience in handling Job related tasks
Senior ASIC Verification Engineer Applicants are expected to have a solid experience in handling Job related tasks