Autonomy Engineer - Deep Learning Infrastructure

Perot Jain; San Mateo, Northern (CA, KY); Hybrid; USD 170,000 - 237,000; Full time

Benefits offered by this job

Equity in stock options

Relocation assistance may be provided

Group health insurance plans

Job summary

Skydio, a leading US drone company, seeks a Deep Learning Infrastructure Engineer in San Mateo to design and scale the infrastructure powering DL/AI efforts. You’ll work across autonomy, embedded, and cloud teams to deliver new capabilities and optimize CV workloads.

You will build end-to-end MLOps, profile and optimize CV/VLM models, and implement high-performance inference across hardware, while upholding Skydio’s engineering standards and security requirements.

Qualifications

• Hands-on experience with MLOps, ML inference optimization and edge deployment.
• Strong knowledge of DL fundamentals, techniques and state-of-the-art DL models/architectures.
• Strong fundamentals in CV, image processing and video processing.
• Hands-on experience building and managing ML pipelines for solving vision or vision language tasks including data preparation, model training, model deployment and monitoring.
• Experience and understanding of security and compliance requirements in ML infrastructure.
• Experience with ML frameworks and libraries.
• Ability to take a concept and systematically drive it through the software lifecycle: architecture, development, testing, and deployment, and monitoring.
• Comfortable navigating and delivering within a complex codebase.
• Strong communication skills and the ability to collaborate effectively at all levels of technical depth.

Responsibilities

• Develop solutions for high-performance deep learning inference for CV workloads that can deliver high throughput and low latency on different hardware platforms
• Profile CV and Vision Language Models (VLMs) to analyze performance, identify bottlenecks and optimization opportunities and improve power efficiency of deep learning inference workloads
• Design and implement end to end MLOps workflows for model deployment, monitoring and re-training
• Utilize advanced Machine Learning knowledge to leverage training or runtime frameworks or model efficiency tools to improve system performance
• Create new methods for improving training efficiency
• Implement GPU kernels for custom architectures and optimized inference
• Design and implement SDKs that allow customers/external developers to create autonomous workflows using ML
• Leverage your expertise and best-practices to uphold and improve Skydio’s engineering standards

Skills

MLOps

ML inference optimization

edge deployment

DL fundamentals

CV / Vision processing

Vision-language tasks

software lifecycle

communication skills

Tools

ML frameworks

Job description

San Mateo, California, United States- Full-time

Skydio is the leading US drone company and the world leader in autonomous flight. We leverage breakthrough AI to create the world's most intelligent flying machines for use by enterprise and government. Learning a semantic and geometric understanding of the world from visual data is the core of our autonomy system. We are pushing the boundaries of what is possible with real-time deep networks to accelerate progress in intelligent mobile robots.

About the role:

If you are excited about leveraging massive amounts of structured video data to solve problems in Computer Vision (CV) such as object detection and tracking, optical flow estimation and segmentation, we would love to hear from you.

How you'll make an impact:

As a deep learning infrastructure engineer, you will be responsible for building and scaling the infrastructure that supports Skydio’s DL and AI efforts. You will be working at the nexus of Skydio’s autonomy, embedded and cloud teams to deliver new capabilities and empower the deep learning team.

• Develop solutions for high-performance deep learning inference for CV workloads that can deliver high throughput and low latency on different hardware platforms
• Profile CV and Vision Language Models (VLMs) to analyze performance, identify bottlenecks and optimization opportunities and improve power efficiency of deep learning inference workloads
• Design and implement end to end MLOps workflows for model deployment, monitoring and re-training
• Utilize advanced Machine Learning knowledge to leverage training or runtime frameworks or model efficiency tools to improve system performance
• Create new methods for improving training efficiency
• Implement GPU kernels for custom architectures and optimized inference
• Design and implement SDKs that allow customers/external developers to create autonomous workflows using ML
• Leverage your expertise and best-practices to uphold and improve Skydio’s engineering standards

What makes you a good fit:

• Demonstrated hands-on experience with MLOps, ML inference optimization and edge deployment
• Strong knowledge of DL fundamentals, techniques and state-of-the-art DL models/architectures
• Strong fundamentals in CV, image processing and video processing
• Demonstrated hands-on experience building and managing ML pipelines for solving vision or vision language tasks including data preparation, model training, model deployment and monitoring
• Experience and understanding of security and compliance requirements in ML infrastructure
• Experience with ML frameworks and libraries
• You have demonstrated ability to take a concept and systematically drive it through the software lifecycle: architecture, development, testing, and deployment, and monitoring
• You are comfortable navigating and delivering within a complex codebase
• Strong communication skills and the ability to collaborate effectively at all levels of technical depth

Compensation:

At Skydio, our compensation packages for regular, full-time employees include competitive base salaries, equity in the form of stock options, and comprehensive benefits packages. Compensation will vary based on factors, including skill level, proficiencies, transferable knowledge, and experience. Relocation assistance may also be provided for eligible roles. The annual base salary range for this position is $170,000 - 236,500*.

Fundamentally, we believe that equity is the key to long-term financial growth, and we ensure all regular, full-time employees have the opportunity to significantly benefit from the company's success.

Regular, full-time employees are eligible to enroll in the Company’s group health insurance plans.

• Paid vacation time, sick leave, holiday pay and 401K savings plan.

This position and all associated benefits are subject to applicable federal, state, and local laws, as well as the Company’s policies and eligibility criteria.

* Compensation for certain positions may vary based on the position’s location.

At Skydio we believe that diversity drives innovation. We have created a multidisciplinary environment that embraces the power of diverse perspectives to create elegant solutions for complex problems. We are committed to growing our network of people, programs, and resources to nurture an inclusive culture.

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or other characteristics protected by federal, state or local anti-discrimination laws.

For positions located in the United States of America, Skydio, Inc. uses E-Verify to confirm employment eligibility. To learn more about E-Verify, including your rights and responsibilities, please visit https://www.e-verify.gov/

U.S. EQUAL EMPLOYMENT OPPORTUNITY INFORMATION

Skydio provides equal employment opportunities to applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other classification protected by applicable law.

Skydio is a federal contractor or subcontractor subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. Employment decisions are made on the basis of job-related criteria without regard to race, ethnicity, color, religion, sex, sexual orientation, gender identity, marital status, age, genetic information, national origin, disability, protected veteran status, or any other classification protected by applicable law.

We invite all applicants to voluntarily self-identify their race, ethnicity, and gender. Submission of the information on this form is strictly voluntary and refusal to provide it will not subject you to any adverse treatment. Information obtained will be retained in a confidential file and separate from personnel records. This information may only be used in accordance with the provision of applicable federal laws, executive orders, and regulations. If you want more information about any of the sections, please check with a company representative.

• Hispanic or Latino - A person of Cuban, Mexican, Puerto Rican, South or Central American, or other Spanish culture or origin regardless of race.
• White (Not Hispanic or Latino) - A person having origins in any of the original peoples of Europe, the Middle East, or North Africa.
• Black or African American (Not Hispanic or Latino) - A person having origins in any of the Black racial groups of Africa.
• Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) - A person having origins in any of the peoples of Hawaii, Guam, Samoa, or other Pacific Islands.
• Asian (Not Hispanic or Latino) - A person having origins in any of the original peoples of the Far East, Southeast Asia, or the Indian Subcontinent, including, for example, Cambodia, China, India, Japan, Korea, Malaysia, Pakistan, the Philippine Islands, Thailand, and Vietnam.
• American Indian or Alaska Native (Not Hispanic or Latino) - A person having origins in any of the original peoples of North and South America (including Central America), and who maintain tribal affiliation or community attachment.
• Two or More Races (Not Hispanic or Latino) - All persons who identify with more than one of the above five races.

SELF-IDENTIFICATION OF VETERAN STATUS

Skydio is a Government contractor subject to Section 4212 of the Vietnam Era Veterans’ Readjustment Assistance Act of 1974, as amended by the Jobs for Veterans Act of 2002, which requires Government contractors to take affirmative action to employ and advance in employment protected veterans. If you believe that you belong to any of the following categories of protected veterans, please indicate by making the appropriate selection.

Disabled veteran – A veteran who served on active duty in the U.S. military and is entitled to disability compensation (or who but for the receipt of military retired pay would be entitled to disability compensation) under laws administered by the Secretary of Veterans Affairs, or was discharged or released from active duty because of a service-connected disability.

Recently separated veteran – A veteran separated during the three-year period beginning on the date of the veteran's discharge or release from active duty in U.S military, ground, naval, or air service.

Active duty wartime or campaign badge veteran – A veteran who served on active duty in the U.S. military during a war, or in a campaign or expedition for which a campaign badge was authorized under the laws administered by the Department of Defense.

Armed forces service medal veteran – A veteran who, while serving on active duty in the U.S. military, ground, naval, or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985 (61 Fed. Reg. 1209).

I identify as one or more of the classifications of protected veteran listed above.

I am not a protected veteran.

I decline to self-identify for protected veteran status.

VOLUNTARY SELF-IDENTIFICATION OF DISABILITY

Form CC-305, OMB Control Number 1250-0005, Expires 07/31/2029.

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

Alcohol or other substance use disorder (not currently using drugs illegally)

Blind or low vision

Cancer (past or present)

Cardiovascular or heart disease

Celiac disease

Cerebral palsy

Deaf or serious difficulty hearing

Diabetes

Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders

Epilepsy or other seizure disorder

Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome

Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD

Missing limbs or partially missing limbs

Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports

Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)

Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities

Partial or complete paralysis (any cause)

Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

Disability Status Yes, I have a disability, or have had one in the past No, I do not have a disability and have not had one in the past I do not want to answer