Job Details

AI Specialist (AI Engineering)

San Francisco Bay Area, USA

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.

Responsibilities:

• Compress and optimize large language and vision models for on-device inference.
• Develop pipelines for model distillation and hardware-specific compilation.
• Benchmark performance across various NPU/GPU architectures.

Qualifications:

• Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
• Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
• Strong C++ and Python skills.