Job Details

We're building the AI platform for underserved industries.

LLM usage has seen a meteoric rise in the past year, but there is still a significant gap between agentic innovation and its use in the real world. This is especially true for underserved industries like automotive and healthcare, where outdated systems persist due to barriers to entry, legacy software, and high-stakes consequences of hallucinations and failure.

Here at Toma (YC W24), we are bridging this gap by providing a customer-centric platform to deploy and monitor AI agents, even for non-technical users. We recently raised a $17M Series A from a16z and are building the future of human-AI interactions, starting in the automotive industry.

Our Team

We're assembling a team of Avengers: engineers, product managers, former founders, athletes, and leaders from Scale AI, Uber, Braze, Microsoft, Amazon, and more. We consider everyone regardless of their backgrounds or identities. Learn more about us here.

About this Role

We are seeking an experienced Software Engineer to scale Toma's infrastructure from 1 to 100. You will report directly to the CTO and be provided the opportunity to shape the roadmap, make critical technical decisions, and collaborate cross-functionally.

What you will do

• Manage release deployments on AWS EKS/Porter
• Architect and build infrastructure to improve reliability and operational excellence
• Deploy and maintain self-hosted LLMs and other ML models
• Engage with software providers and develop long-term partnerships
• Improve DevOps with AI tooling
• Automate end-to-end testing with synthetic data

Preferred Qualifications

• Proficiency in TypeScript & Python
• Experience in low-level Node.js (Bun), Kubernetes, and instrumentation providers (Datadog, Sentry, Grafana, Prometheus, etc.)
• Strong utilization of LLMs and familiarity with prompt engineering
• Desire to continuously learn

Don't think you meet all the qualifications? Apply anyway. We'd love to hear what excites you about us, and we may have a role that's a good fit for you.

Benefits

• Competitive salary with meaningful equity
• Free health, dental, and vision insurance
• Free in-office lunch and dinners
• Monthly $200 wellness benefit
• Unlimited PTO