Job Details

Get AI-powered advice on this job and more exclusive features.

Overview

Help us build generative models of the 3D world. World models power domains such as media generation, visual reasoning, simulation, planning for embodied agents, and real-time interactive experiences. Work to build better versions of Gemini, Genie, and Veo, and explore new spatial modalities beyond images and videos.

Responsibilities

• Conduct research to build generative multimodal models of the 3D world.
• Solve essential problems to train world models at massive scale: build and train large-scale systems for data annotation, curate and annotate training datasets, build and maintain large model training infrastructure, develop scaling ladders and training recipes, develop metrics for spatial intelligence, enable real-time interactive experiences, and study the integration of spatial modalities with multimodal language models, and actually train massive-scale models.

Areas of focus

• 3D computer vision, spatial annotation systems
• Spatial representations
• Training large-scale transformers
• Generative pixel and latent models
• Infrastructure for large-scale data pipelines and annotation
• Quantitative evaluations for spatial accuracy and intelligence
• Model scaling, efficiency, distillation, training infrastructure

About You

We seek individuals who are passionate about large-scale generative models and believe spatial understanding and generation are on the path to intelligence. We strive for simple methods that scale and look for candidates excited to improve models through infrastructure, data, evals, and compute.

In order to set you up for success as a Research Scientist/Engineer at Google DeepMind, we look for the following skills and experience:

• MSc or PhD in computer science or machine learning, or equivalent industry experience
• Experience with large-scale transformer models and/or large-scale data pipelines
• Track record of releases, publications, and/or open source projects relating to video generation, world models, multimodal language models, or transformer architectures
• Exceptional engineering skills in Python and deep learning frameworks (e.g., Jax, TensorFlow, PyTorch), with a track record of building high-quality research prototypes and systems
• Demonstrated experience in large-scale training of multimodal generative models

Preferred qualifications

• Experience building training codebases for large-scale video or multimodal transformers
• Expertise optimizing efficiency of distributed training systems and/or inference systems
• Strong background in 3D representations or 3D computer vision
• Strong publication record at top-tier ML, CV, and graphics conferences
• A keen eye for visual aesthetics and detail, with a passion for creating high-quality, visually compelling generative content

Seniority level

• Associate

Employment type

• Full-time

Job function

• Other

Industries

• Research Services

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.