Job Details

Overview

As a Senior Staff Software Optimization Engineer you will collaborate with a specialized team to drive C++ system optimizations for enhancing LLM model inference and training performance. You will play a pivotal role in transforming innovative concepts into tangible products alongside top AI/ML researchers. This is a full-time position. Working remotely is possible, but local candidates are preferred.

Responsibilities

• Efficiently transform ideas and concepts into working prototypes and production-level code.
• Conduct in-depth performance analysis and profiling, and identify performance bottlenecks.
• Devise and implement novel strategies that exploit algorithm insights and hardware capabilities for enhanced efficiency, and speed.
• Optimize core AI/ML algorithms to enhance performance.
• Stay at the forefront of software, hardware optimization and AI advancements, utilizing this knowledge to spearhead continuous improvements.
• Offer technical leadership and mentorship, elevating engineering practices and contributing to the development process.

Qualifications

• Master's degree (or equivalent experience) in Computer Science, Engineering, or a related field.
• Must have over 5 years of experience in software engineering and product development. A minimum of 2 years experience in optimizing AI models is strongly preferred.
• Outstanding proficiency in C/C++, with hands-on experience developing high-performance systems. Familiarity with SIMD programming, assembly, intrinsic functions, AVX, or similar instruction sets, is a strong plus.
• A strong understanding of memory allocation, the memory hierarchy and optimizing to make the best use of caches and memory layout on multi-core multi socket servers.
• Expertise in common data structures and an understanding of CPU/GPU architectures, essential for developing optimized software.
• A thorough grasp of system architecture, including hardware accelerators and advanced optimization techniques.
• Experience working with LLMs, and a strong understanding of transformer attention is strongly preferred.
• Strong communication abilities, capable of simplifying complex technical details for diverse audiences.
• Adaptable and quick to embrace new technologies and methods, thriving in a fast-paced and innovative environment.

What We Offer

• A role at the forefront of the AI revolution with a company shaping the future of intelligent computing.
• A high degree of autonomy and responsibility from the outset, with significant opportunities for professional growth.
• The chance to work with a world-class team of scientists and engineers.
• A vibrant startup culture that values innovation, creativity, and collaboration.

Compensation & Application

Compensation: At Numenta, we offer a competitive salary reflective of the candidate's expertise. Our compensation package includes full medical, dental, and vacation benefits. The base annual salary range for this position for candidates residing in the San Francisco Bay Area is $150,000 to $225,000; exact salary will depend on the candidate's experience level and fit to the job description. We also include a competitive stock option package, ensuring a shared stake in our future success.

How To Apply

To apply please send your resume and a cover letter to ...@numenta.com. The cover letter must state your specific fit to Numenta's technology and products, and the requirements above.

Numenta is an equal opportunity employer supporting workforce diversity.

Join us at Numenta to help shape the future of AI. Apply today!