Member of Technical Staff - Pre-Training

Responsibilities

• Training trillion parameter neural networks at scale, as well as a variety of smaller specialized models.
• Rapidly implementing the latest state-of-the-art methods from the deep learning literature.
• Innovating new ideas for pretraining and new scaling paradigm.

Required Qualifications

• Strong engineering skills with passion on model-hardware co-design.
• Expert in ML and large model scaling, familiar with all kinds of scaling laws.
• Familiar with distributed training, multi-GPU neural network training and experience on optimizing ML training efficiency.

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.