Job Details

Join to apply for the Machine Learning Engineer - Fine Tuning role at AI Fund.

About Baseten

Join our dynamic team at Baseten, where we're revolutionizing AI deployment with cutting-edge inference infrastructure. Backed by premier investors such as...

The Role

As a Machine Learning Engineer specializing in Fine-Tuning at Baseten, you'll create value by leveraging our infrastructure to fine-tune large language models and other modalities, working directly with customers to meet their goals. Responsibilities include building scalable pipelines, implementing parameter-efficient techniques, and ensuring seamless inference. This customer-facing role requires technical expertise and the ability to translate customer needs into solutions. You'll also help shape our product roadmap by identifying common patterns and working with product teams to develop reusable components, streamlining the fine-tuning process.

Responsibilities

1. Design fine-tuning strategies to meet customer requirements, optimizing data preparation, training, and evaluation methods.
2. Develop tools for non-ML experts to fine-tune models effectively.
3. Implement scalable fine-tuning pipelines for large models and other AI modalities.
4. Work with customers to understand requirements and guide technical implementation.
5. Serve as the technical point of contact during the fine-tuning process.
6. Utilize state-of-the-art parameter-efficient fine-tuning methods (LoRA, QLoRA).
7. Build systems for data preparation, evaluation, and deployment of fine-tuned models.
8. Research and apply techniques in instruction tuning and model customization.
9. Create frameworks to evaluate model performance against base models.
10. Implement distributed training techniques like FSDP and DDP across hardware configurations.

Requirements

1. Bachelor's degree in Computer Science, Engineering, or related field.
2. 3+ years of ML engineering experience focused on model training and fine-tuning.
3. Experience with fine-tuning frameworks such as Axolotl, Unsloth, Transformers, TRL, PyTorch Lightning, or Torch Tune.
4. Hands-on experience with fine-tuning or pre-training LLMs or foundation models.
5. Excellent communication skills for explaining complex concepts.

Nice to Have

1. Experience working with customers to deliver solutions.
2. Track record of ML projects for enterprise clients.
3. Knowledge of distributed training and optimization techniques.
4. Experience with advanced alignment methods (RLHF, DPO, etc.).
5. Knowledge of prompt engineering and domain adaptation.
6. Contributions to open-source fine-tuning tools.
7. Experience building user interfaces for fine-tuning workflows.
8. Experience with cloud platforms and containerization.

Benefits

1. Competitive compensation, flexible PTO, healthcare coverage.
2. Opportunity to be part of a rapidly growing startup in AI.
3. Inclusive culture fostering learning and growth.
4. Exposure to ML startups for learning and networking.

If you're motivated and passionate about ML, apply now to shape the future of AI! Baseten is committed to diversity and inclusion, providing equal opportunities regardless of background.

Additional Details

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Engineering and IT
• Industries: Venture Capital and Private Equity