Sr Staff Software Engineer - Backend Core AI
Join to apply for the Sr Staff Software Engineer - Backend Core AI role at interface.ai
Sr Staff Software Engineer - Backend Core AI
1 week ago Be among the first 25 applicants
Join to apply for the Sr Staff Software Engineer - Backend Core AI role at interface.ai
Get AI-powered advice on this job and more exclusive features.
interface.ai is the industry's-leading specialized AI provider for banks and credit unions, serving over 100 financial institutions. The company's integrated AI platform offers a unified banking experience through voice, chat, and employee-assisting solutions, enhanced by cutting-edge proprietary Generative AI.
Our mission is clear: to transform the banking experience so every consumer enjoys hyper-personalized, secure, and seamless interactions, while improving operational efficiencies and driving revenue growth.
interface.ai offers pre-trained, domain-specific AI solutions that are easy to integrate, scale, and manage, both in-branch and online. Combining this with deep industry expertise, interface.ai is the AI solution for banks and credit unions that want to deliver exceptional experiences and stay at the forefront of AI innovation.
About the Role
We're hiring a Staff Engineer – AI Frameworks to architect and lead the development of the foundational multi-agent infrastructure powering the next generation of intelligent systems for financial institutions.
This role is not about plugging in pre-built models—it's about designing and scaling custom AI orchestration frameworks that bind language models, memory, judgment modules, and tool use into autonomous systems that are trustworthy, composable, and policy-aligned.
You'll work at the intersection of machine learning, distributed systems, and agentic reasoning, partnering with researchers, backend engineers, and product leaders to bring real-time, LLM-driven intelligence into production at scale.
This is a rare opportunity to define and build the AI runtime and execution architecture for mission-critical agents in a high-regulation, high-trust industry.
What You'll Own
- Architect a multi-agent AI framework for orchestrating LLMs, tools, memory, and decision modules in live user-facing systems
- Build and optimize low-latency, distributed inference systems that meet real-time SLAs for transactional environments
- Develop modular components for task planning, reward routing, fallback handling, and multi-turn reasoning
- Design developer-facing APIs and tooling to allow AI product teams to safely extend and compose agentic functionality
- Integrate vector stores, custom retrieval pipelines, model evaluators, judgment layers, and auto-tuning workflows
- Drive the implementation of prompt tuning, reward modeling, and LLM-as-a-Judge techniques in production loops
- Collaborate with research to productionize new RL, planning, or alignment strategies
- Establish architectural best practices for extensibility, observability, and trust in AI-enabled systems
What We're Looking For
Required Qualifications
- 8+ years of backend or platform engineering experience, with at least 2 years building or deploying AI/ML systems
- Prior hands-on experience building ML models or training pipelines—you know how models learn, behave, and break
- Expert knowledge of LLM system design, agent architectures, and Reinforcement Learning techniques
- Deep experience with Node.js, asynchronous architecture, and performance-critical backend systems
- Proven track record building distributed, event-driven systems in high-throughput environments
- Experience building real-time inference systems that integrate LLMs with retrieval, memory, or tool use
- Strong systems design skills: designing modular, fault-tolerant, observable software at scale
- Demonstrated ability to lead architectural design and cross-functional engineering initiatives
Preferred Experience
- Experience building multi-agent systems or intelligent orchestration engines
- Familiarity with vector databases, semantic search, and prompt engineering techniques
- Comfort integrating ML eval frameworks and offline/online experimentation pipelines
- Open-source contributions to LLM tooling or infrastructure a plus
What Makes This Role Special
- You'll define the core AI infrastructure powering autonomous financial workflows across millions of users
- You'll lead the engineering strategy behind multi-agent AI systems—designing how autonomous AI thinks, adapts, and acts
- You'll build for speed, scale, and compliance, solving real-world challenges in applied alignment, observability, and modularity
- You'll work with a team that combines world-class AI research, backend engineering, and product-first thinking to move fast with purpose
Compensation
Compensation is expected to be between $170,000 - $210,000. Exact compensation may vary based on skills and location.
What We Offer
- Health: medical, dental, and vision insurance and wellbeing resources and programs
- Time away: Public holidays and discretionary PTO package for flexible days off with manager approval
- Financial: 401K, ESPP, Basic life and AD&D insurance, long-term and short-term disability
- Family: parental leave
- Development: Access to internal professional development resources.
At interface.ai, we are committed to providing an inclusive and welcoming environment for all employees and applicants. We celebrate diversity and believe it is critical to our success as a company. We do not discriminate on the basis of race, color, religion, national origin, age, sex, gender identity, gender expression, sexual orientation, marital status, veteran status, disability status, or any other legally protected status. All employment decisions at Interface.ai are based on business needs, job requirements, and individual qualifications. We strive to create a culture that values and respects each person's unique perspective and contributions. We encourage all qualified individuals to apply for employment opportunities with Interface.ai and are committed to ensuring that our hiring process is inclusive and accessible.
Seniority level
Seniority level
Mid-Senior level
Employment type
Job function
Job function
Engineering and Information TechnologyIndustries
Technology, Information and Internet
Referrals increase your chances of interviewing at interface.ai by 2x
Get notified about new Senior Staff Software Engineer jobs in San Francisco, CA.
Sr. Software Engineer - Payments Support
San Francisco, CA $138,400.00-$173,000.00 2 weeks ago
San Francisco, CA $204,000.00-$259,000.00 19 hours ago
Agentic Software Engineer / AI Systems Developer (Contract/Part-Time Lead)
Staff Software Engineer, Frontend (Rapid Prototyping Leader)
San Francisco, CA $202,000.00-$238,000.00 2 weeks ago
Staff Software Engineer, Demand Engineering - Slack
Staff Software Product Engineer, RCM (SF)
San Francisco, CA $180,000.00-$220,000.00 1 month ago
Redwood City, CA $140,000.00-$198,000.00 3 days ago
Senior Robotics Software Engineer, Planning and Control
San Francisco, CA $150,000.00-$240,000.00 1 month ago
Staff Software Product Engineer, RCM (SF)
San Francisco, CA $180,000.00-$220,000.00 2 weeks ago
Senior/Staff Motor Control Software Engineer
Staff Software Engineer, Vessel Performance Modeling
San Francisco, CA $170,000.00-$220,000.00 2 weeks ago
Senior Motion Controls Software Engineer
Emeryville, CA $200,000.00-$235,000.00 5 hours ago
Senior/Staff Motion Controls Software Engineer
Senior Software Engineer, Robotics Reliability (Hardware in the Loop Experience Required)
Emeryville, CA $170,000.00-$220,000.00 6 days ago
Emeryville, CA $200,000.00-$230,000.00 5 days ago
Senior Software Engineer, Fullstack (Quip)
San Francisco, CA $184,000.00-$276,100.00 1 month ago
Senior Software Engineer, Infrastructure
San Francisco, CA $130,000.00-$200,000.00 9 months ago
San Francisco, CA $125,700.00-$334,600.00 2 weeks ago
San Francisco, CA $165,000.00-$220,000.00 4 months ago
San Francisco, CA $175,000.00-$230,000.00 5 months ago
Senior Software Engineer, Consumer Identity
San Francisco, CA $198,000.00-$220,000.00 6 days ago
San Francisco, CA $154,000.00-$210,000.00 2 months ago
San Francisco, CA $152,200.00-$223,600.00 3 weeks ago
San Francisco, CA $160,000.00-$200,000.00 7 months ago
Senior Software Engineer, Backend - Fintech
San Francisco, CA $150,000.00-$350,000.00 6 days ago
Senior Software Engineer, Full Stack, Google Workspace
San Francisco, CA $166,000.00-$244,000.00 1 day ago
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr