Job Details

Research Engineer, ML Systems (All Industry Levels)

Join to apply for the Research Engineer, ML Systems (All Industry Levels) role at Character.AI

Research Engineer, ML Systems (All Industry Levels)

Join to apply for the Research Engineer, ML Systems (All Industry Levels) role at Character.AI

Get AI-powered advice on this job and more exclusive features.

About The Role And Team

Joining us as a Research Engineer on the ML Systems team, you'll be working on cutting-edge ML training and inference systems, optimizing the performance and efficiency of our GPU clusters, and developing new technologies that fine-tune leading consumer AI models with a data flywheel, and serve 20K+ QPS in production with LLMs. Your work will directly contribute to our groundbreaking advancements in AI, helping shape an era where technology is not just a tool, but a companion in our daily lives. At Character.AI, your talent, creativity, and expertise will not just be valued—they will be the catalyst for change in an AI-driven future.

About The Role And Team

Joining us as a Research Engineer on the ML Systems team, you'll be working on cutting-edge ML training and inference systems, optimizing the performance and efficiency of our GPU clusters, and developing new technologies that fine-tune leading consumer AI models with a data flywheel, and serve 20K+ QPS in production with LLMs. Your work will directly contribute to our groundbreaking advancements in AI, helping shape an era where technology is not just a tool, but a companion in our daily lives. At Character.AI, your talent, creativity, and expertise will not just be valued—they will be the catalyst for change in an AI-driven future.

What You'll Do

The ML Systems team is responsible for the research and deployment of systems that efficiently utilize GPU for AI-enabled products.

As a research engineer, you will work across teams and our technical stack to improve our training performance and inference runtime. You will get to shape the conversational experience of millions of users per day.

Example projects:

• Write efficient Triton kernels and tune them for our specific models and hardware
• Develop prefix-aware routing algorithms to improve serving cache hit rate
• Train and distill LLMs to improve latency while preserving accuracy and engagements
• Build an efficient and scalable distributed RLHF stack powering the model innovations
• Develop systems for efficient multimodal (image gen/video gen) model training & inference
  
  

Who You Are

• "All Industry Levels": at least PhD (or equivalent) research experience
• Write clear and clean production system code
• Strong understanding of modern machine learning techniques (reinforcement learning, transformers, etc)
• Track record of exceptional research or creative ML systems projects
• Comfortable writing model development code (PyTorch) for either training or inference
  
  

Nice to Have

• Experience training large models in a distributed setting utilizing PyTorch distributed, DeepSpeed, Megatron.
• Experience working with GPUs & collectives (training, serving, debugging) and writing kernels (Triton, CUDA, CUTLASS).
• Experience with LLM inference systems and literature such as vLLM and FlashAttention.
• Familiarity with ML deployment and orchestration (Kubernetes, Docker, cloud)
• Publications in relevant academic journals or conferences in the field of machine learning and systems
  
  

About Character.AI

Character.AI empowers people to connect, learn and tell stories through interactive entertainment. Over 20 million people visit Character.AI every month, using our technology to supercharge their creativity and imagination. Our platform lets users engage with tens of millions of characters, enjoy unlimited conversations, and embark on infinite adventures.

In just two years, we achieved unicorn status and were honored as Google Play's AI App of the Year—a testament to our innovative technology and visionary approach.

Join us and be a part of establishing this new entertainment paradigm while shaping the future of Consumer AI!

At Character, we value diversity and welcome applicants from all backgrounds. As an equal opportunity employer, we firmly uphold a non-discrimination policy based on race, religion, national origin, gender, sexual orientation, age, veteran status, or disability. Your unique perspectives are vital to our success.Seniority level

• Seniority levelNot Applicable

Employment type

• Employment typeFull-time

Job function

• Job functionEngineering and Information Technology
• IndustriesSoftware Development

Referrals increase your chances of interviewing at Character.AI by 2x

Get notified about new Research Engineer jobs in San Francisco Bay Area.

Research Scientist/Engineer, Mobile Manipulation - Behaviors

Fremont, CA $70.67-$208,000.00 2 weeks ago

Process Integration Technologist, R&D Engineering

San Jose, CA $154,360.00-$218,700.00 22 hours ago

San Jose, CA $154,360.00-$218,700.00 4 days ago

Mountain View, CA $166,000.00-$244,000.00 2 weeks ago

Pleasanton, CA $85,000.00-$140,000.00 4 days ago

Menlo Park, CA $213,000.00-$293,000.00 2 weeks ago

R&D Engineer, Detector Design, Model, and AnalysisResearch Engineer / Research Scientist - Deep ResearchResearch Scientist - Computational Chemistry

Oakland, CA $150,000.00-$200,000.00 18 hours ago

Mountain View, CA $125,400.00-$188,100.00 2 weeks ago

Menlo Park, CA $177,000.00-$251,000.00 2 weeks ago

San Francisco, CA $130,000.00-$145,000.00 2 weeks ago

Mountain View, CA $141,000.00-$202,000.00 8 hours ago

Sunnyvale, CA $177,000.00-$251,000.00 2 weeks ago

Sunnyvale, CA $213,000.00-$293,000.00 2 weeks ago

Research Scientist / Engineer, World Modeling

Mountain View, CA $197,000.00-$291,000.00 16 hours ago

San Francisco, CA $250,000.00-$415,000.00 2 weeks ago

Menlo Park, CA $180,000.00-$200,000.00 1 month ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr