AI Computing Performance Architect, Perf Analysis and Kernel Dev job opportunity at NVIDIA.

Bachelor's (B.Sc.)

China

Design, develop, and optimize major layers in LLM (e.g attention, GEMM, inter-GPU communication) for NVIDIA's new architectures. __ Implement and fine-tune kernels to achieve optimal performance on NVIDIA GPUs. __ Conduct in-depth performance analysis of GPU kernels, including Attention and other critical operations. __ Identify bottlenecks, optimize resource utilization, and improve throughput, and power efficiency __ Create and maintain workloads and micro-benchmark suites to evaluate kernel performance across various hardware and software configurations. __ Generate performance projections, comparisons, and detailed analysis reports for internal and external stakeholders. __ Collaborate with architecture, software, and product teams to guide the development of next-generation deep learning hardware and software.