Job Details

Get AI-powered advice on this job and access more exclusive features.

About Us

Vast.ai's cloud powers AI projects and businesses worldwide. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.

We are a small, growing, and highly motivated team with an ambitious technical vision. Operating with a flat organizational structure, everyone contributes directly to the company's mission. Leadership is earned through initiative and excellence.

We seek engineers and researchers with strong intrinsic motivation, a passion for advancing the state of the art, and a mix of excellent research, coding, and communication skills.

Location

On-site at our offices in San Francisco or Westwood, Los Angeles.

About the Role

As a systems/GPU engineer, you will develop new kernels and algorithms to improve AI inference. You will work on high-performance tensor libraries and auto-optimization tools, collaborating closely with our technical founder and team to enhance AI system performance and efficiency. Staying current with the latest research papers and advancements in AI model inference and GPU programming will be essential.

Responsibilities

• Develop or extend parallel GPU libraries and kernels
• Design and deploy resource management systems
• Research and evaluate new system architectures
• Prototype and assess novel methods/models
• Learn and implement new frameworks and tools

Tech Stack

CUDA/C++, GPGPU, Python, Linux

Ideal Experience

• Expertise in systems engineering across the tech stack
• Deep understanding of GPU architectures
• Strong background in neural network performance and tooling
• Published research at top AI conferences

Interview Process

After application, our team reviews your credentials. If selected, the process includes:

• Initial virtual screening (15 min)
• Technical interview on Vast.ai's systems and architecture (30 min)
• LLM-assisted coding assessment (1 hr)
• On-site coding assessment and meet-and-greet (2 hrs)

We aim to complete the process within two weeks.

Salary and Benefits

Annual salary range: $160,000 – $320,000 + equity + benefits. We hire across all experience levels, with compensation based on background and potential.

Additional Details

• Seniority Level: Not Applicable
• Employment Type: Full-time
• Job Function: Research and Engineering

#J-18808-Ljbffr