Kernel Engineer

About The Role

As a Kernel Engineer on our team, you will develop high-performance software solutions at the intersection of hardware and software, developing high-performance software for cutting-edge AI and HPC workloads. Your focus will be on implementing, optimizing, and scaling deep learning operations to fully leverage our custom, massively parallel processor architecture.

You will be part of a world-class team responsible for the design, performance tuning, and validation of foundational ML and HPC kernels. This includes building a library of parallel and distributed algorithms that maximize compute utilization and push the boundaries of training efficiency for state-of-the-art AI models. Your work will be critical to unlocking the full potential of our hardware and accelerating the pace of AI innovation.

Responsibilities 

• Develop design specifications for new machine learning and linear algebra kernels and mapping to the Cerebras WSE System using various parallel programming algorithms.
• Develop and debug kernel library of highly optimized low level assembly instruction and C-like domain specific language routines to implement algorithms targeting the Cerebras hardware system.
• Develop and debug high-performance kernel routines in low-level assembly and a custom C-like (CSL) language, implementing algorithms optimized for the Cerebras hardware system.
• Using mathematical models and analysis to measure the software performance and inform design decisions.
• Develop and integrate unit and system testing methodologies to verify correct functionality and performance of kernel libraries.
• Study emerging trends in Machine Learning applications and help evolve Kernel library architecture to address computational challenges of the start-of-the-art Neural Networks.
• Interact with chip and system architects to optimize instruction sets, microarchitecture, and IO of next generation systems.

Skills & Qualifications 

• Bachelor’s, Master’s, PhD, or foreign equivalent in Computer Science, Computer Engineering, Mathematics, or a related field. 
• Proven experience leading technical teams, including mentoring engineers, setting technical direction, and driving execution. 
• Strong understanding of hardware architecture concepts and willingness to dive into new system architectures. 
• Proficiency in C++ and Python; experience with low-level systems programming. 
• Familiarity with library/API development best practices and performance optimization. 
• Excellent debugging skills across complex, layered software stacks. 

Preferred Skills & Qualifications 

• Experience leading teams in kernel development, performance optimization, or low-level systems programming. 
• Strong background in parallel algorithms and distributed memory systems. 
• Hands-on experience with accelerators such as GPUs, FPGAs, or other custom hardware. 
• Familiarity with machine learning workloads and frameworks like TensorFlow and PyTorch. 
• Understanding of HPC kernels and strategies for optimizing them on modern architectures.