Job Details

Head of Engineering, QA

  2025-10-20     Sully.ai     San Francisco,CA  
Description:

About Us

Team from OpenAI, DeepMind, NASA, GoogleX, Tesla, and 2 physicians: 6 exits, 2 IPOs.

Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.

400+ healthcare orgs signed in 16 months.

$25M raised from YC, Amity Ventures, Sequoia scouts, and more.

$1T+ market opportunity. We're going after all of it.

About The Role

We are seeking a Head of Engineering, QA to build Sully.ai's QA function from the ground up—owning strategy, automation, and execution. This is a 0→1 role: you'll set the framework for functional, performance, and compliance testing, scale automation across our stack, and ensure our AI medical employees are safe, reliable, and high-performing. You will also recruit and mentor a team, embedding QA into CI/CD pipelines to enable fast, clinical-grade releases.

Key Responsibilities

  • Own QA strategy, defining frameworks for automation, functional, performance, and compliance testing
  • Build and scale Playwright-based test automation for UI and API coverage
  • Ensure reliability by expanding automation coverage, monitoring dashboards, and resolving test failures quickly
  • Guarantee accuracy, security, and compliance (HIPAA/SOC-2), partnering with Engineering and Clinical teams
  • Recruit, mentor, and lead a high-performing QA team
  • Embed QA into CI/CD pipelines using GitHub Actions and related tooling

Hard Requirements

  • Founder / 0→1 experience — first in function, building QA processes and teams from scratch
  • 6–8+ years in QA with strong expertise in Playwright
  • 3–4+ years of people leadership experience
  • Proven ability to automate functional UI and API test cases
  • Hands‑on with QA tools (Playwright, Cypress, PyTest, Postman)
  • Experience scaling test automation and maintaining reliability
  • Highly motivated, driven, and ownership‑oriented

Nice‑to‑Have

  • Experience testing AI/LLM workflows
  • Familiarity with dashboarding and observability tooling
  • GitHub Actions CI/CD integration experience
  • Prior startup or healthcare QA background

First‑Month Focus

  • Define Sully.ai's QA strategy and initial automation framework
  • Implement core Playwright test cases across key workflows
  • Partner with Engineering and Clinical teams to validate compliance needs

Success OKRs (90 Days)

  • Establish automated test coverage across UI and API workflows
  • Integrate QA pipelines into GitHub Actions for reliable CI/CD
  • Deliver measurable improvements in test reliability and release confidence

Culture Fit

  • Persistent, driven problem solver
  • Willing to push back on leadership to defend quality/timelines
  • Thrives in high‑ambiguity, fast‑paced startup environments

Why Join

Shape the Future of Healthcare: Build category‑defining partnerships that enable doctors to focus on saving lives.

Early‑Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.

Remote‑First Culture: Work with a talented, mission‑driven team in a flexible, remote environment.

Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.

Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.

#J-18808-Ljbffr


Apply for this Job

Please use the APPLY HERE link below to view additional details and application instructions.

Apply Here

Back to Search