Job Details

The pre-training team at x. AI aims to provide an omni model that can understand the universe through text, image, video and audio. To accomplish this, we are looking for expert engineers in multi-modal pre-training. Tech Stack Python JAX and XLA Rust / C Spark Location The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation. Focus Training trillion parameter neural networks at scale, as well as a variety of smaller specialized models. Rapidly implementing the latest state-of-the-art methods from the deep learning literature. Innovating new ideas for pretraining and new scaling paradigm. Improving pretraining data quality at scale across different modalities. Ideal Experience Strong engineering skills with passion to improve different aspects of data and model. Expert in ML and large model scaling, familiar with all kinds of scaling laws. Familiar with distributed training, multi-GPU neural network t...Training, Engineer, AI, Data, Total Rewards, Technology