Lead AI Engineer: Production ML on Azure Databricks

Vytwo Technologies Inc.; Prosper (TX); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Flexible work from home options

Job summary

Vytwo Technologies Inc. is seeking a Lead AI Engineer to focus on building production-ready AI applications and deploying them on Azure Databricks and Azure cloud infrastructure. The role involves end-to-end responsibilities, from data ingestion to scalable deployment and optimization.

The ideal candidate should have strong experience in Azure Databricks, Python, SQL, and Azure services, working closely with data scientists and business stakeholders to ensure effective AI applications.

Qualifications

• Solid Azure Databricks experience, handling jobs and workflows.
• Proficient in Python with a focus on PySpark, not just pandas.
• Ability to write complex SQL queries including joins and window functions.

Responsibilities

• Design and build end-to-end data and AI pipelines using Azure Databricks.
• Develop robust ETL/ELT workflows using Python (PySpark) and SQL.
• Implement CI/CD pipelines for Databricks deployments.

Skills

Azure Databricks

Python (PySpark)

SQL

Azure Cloud

ML lifecycle and MLOps

Tools

Azure DevOps

MLflow

Terraform

Job description

Vytwo Technologies Inc. is seeking a Lead AI Engineer to focus on building production-ready AI applications and deploying them on Azure Databricks and Azure cloud infrastructure. The role involves end-to-end responsibilities, from data ingestion to scalable deployment and optimization.

The ideal candidate should have strong experience in Azure Databricks, Python, SQL, and Azure services, working closely with data scientists and business stakeholders to ensure effective AI applications.