Job Details

Title: Senior AI Software Engineer

Client: Private Equity firm

Logistics: 4 days per week onsite in SF or NYC

Compensation: $250-325k base plus annual bonus - TC $450-550k

Company Overview

Join a tech-focused private equity firm that has raised over $50 billion in capital and invests exclusively in technology companies. The team operates like a high-performance startup, combining institutional scale with a lean, high-caliber environment where every role has direct impact on investment decisions.

The Role

Senior AI Software Engineer to own the end-to-end technical architecture of our client's AI investment platform. This is a high-ownership, high-visibility role where you'll design and ship production AI products from the ground up, including agentic workflows, RAG systems, and LLM-based tooling that directly support deal diligence, portfolio monitoring, knowledge management, and decision support.

Responsibilities

• Architect and build the firm's AI platform from the ground up, owning decisions across the full stack
• Design and implement RAG pipelines, agentic workflows, and LLM-based tooling for investment use cases
• Build and maintain embedding pipelines, vector databases, and evaluation harnesses
• Partner with investment team stakeholders to translate complex workflows into scalable AI products
• Establish engineering best practices including CI/CD, testing, and model evaluation frameworks

Requirements

• 5+ years of software engineering experience, with at least 2 years building production AI/ML systems (LLM applications, RAG, agentic frameworks, or equivalent)
• Strong fundamentals in Python, cloud infrastructure on AWS, and modern CI/CD practices
• Deep knowledge of LLM application patterns: prompt engineering, embedding pipelines, vector databases, evaluation harnesses, and tool-use architectures
• Experience shipping end-to-end AI products in a fast-moving environment
• Startup experience or comfort operating with high autonomy and low process overhead