Edge AI Inference Engineer — High-Performance ML

webAI; Austin (TX); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Equity options

Comprehensive health, dental, and vision benefits package

401(k) match (U.S.-based employees only)

$200/month Health & Wellness stipend

Continuing Education support

$500/year Function Health subscription (U.S.-based employees only)

Free parking for in-office employees

Flexible Time Off (FTO)

Parental leave for eligible employees

Supplemental life insurance

Job summary

webAI is seeking an experienced AI Software Engineer at their Austin, Texas location. This role involves optimizing machine learning models for edge computing and cloud environments, deploying high-performance APIs, and collaborating with AI Scientists to enhance codebases. The ideal candidate will have over 5 years of experience in Software Engineering, proficiency in C++ and Python, and a Bachelor's or Master's in Computer Science. WebAI offers a competitive benefits package including health benefits, equity options, and flexible time off.

Qualifications

• 5+ years in Software Engineering or equivalent university experience with a focus on ML systems and distributed computing.
• Proficiency in high-performance computing and machine learning inference.
• Experience in low-level systems programming and hardware-aware optimization.

Responsibilities

• Implement techniques like pruning, quantization, and distillation for efficient model performance.
• Wrap models in high-performance APIs and integrate them into broader software ecosystems.
• Build and maintain ML frameworks for AI Scientist’s scalable experiments.
• Refactor research code into production-grade, maintainable code.

Skills

C++

Python

Docker

Kubernetes

Vector Databases (Pinecone, Weaviate)

CI/CD for ML

Education

Bachelor's or Master's in Computer Science or Software Engineering

Job description

webAI is seeking an experienced AI Software Engineer at their Austin, Texas location. This role involves optimizing machine learning models for edge computing and cloud environments, deploying high-performance APIs, and collaborating with AI Scientists to enhance codebases. The ideal candidate will have over 5 years of experience in Software Engineering, proficiency in C++ and Python, and a Bachelor's or Master's in Computer Science. WebAI offers a competitive benefits package including health benefits, equity options, and flexible time off.