AI/ML Lead

Persistent Systems; Los Angeles (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive salary and benefits package

Quarterly promotion cycles

Company-sponsored education and certifications

Annual health check-ups

Flexible work hours

Job summary

A technology consulting firm is looking for an experienced AI/ML Lead to develop and optimize machine learning models using Databricks and drive data-driven decision-making. The ideal candidate should have over 12 years of experience in data science, strong analytical skills, and the ability to collaborate with cross-functional teams. This full-time position emphasizes working with large datasets and modern analytics frameworks, offering competitive salary and opportunities for professional growth.

Qualifications

• 12+ years of experience in data science or a related field.
• Proven track record of developing and optimizing machine learning models.
• Experience with MLOps frameworks and cloud environments.

Responsibilities

• Develop, train, and optimize machine learning models using Databricks.
• Perform exploratory data analysis to identify trends and patterns.
• Deploy ML models into production using MLOps pipelines.
• Conduct A/B testing and other analytical techniques as needed.
• Build scalable ETL/ELT pipelines using PySpark and SQL.

Skills

Hands-on experience in Databricks

Strong analytical capabilities

Experience building scalable data pipelines

Machine learning model deployment

Collaboration with cross-functional teams

Data analysis

SQL

Cloud (Azure/AWS)

Tools

Databricks

Python

PySpark

MLflow

Delta Lake

Job description

We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create unique competitive advantage for our clients by giving them the power to see beyond and rise above.

We are experiencing tremendous growth, with $566 million in revenue in FY21, representing 12.9% year-over-year growth. Along with that growth, we onboarded over 3,000 new employees in the past year, bringing our total employee count to over 15,000 people located in 18 countries across the globe.

At Persistent, our values are more than a list of ideals to improve our corporate image. We’re dedicated to building an inclusive culture that reflects what’s important to our employees and is based on what they value. As a result, 95% of our employees approve of the CEO and 83% recommend working at Persistent to a friend.

About Position

We are seeking a skilled AI/ML Lead with hands-on experience in Databricks to join our team. The ideal candidate has strong analytical capabilities, experience building scalable data pipelines and machine learning models, and the ability to collaborate with cross‑functional teams to drive data‑driven decision‑making.

This role involves working with large datasets, advanced analytics, and modern data engineering and ML frameworks—primarily using Databricks on Azure/AWS.

Role Details

Role: AI/ML Lead with hands‑on experience in Databricks

Hire Type: Fulltime

Experience: 12+ years of experience

What You'll Do

• Develop, train, and optimize machine learning and statistical models using Databricks, Python, PySpark, and MLflow.
• Perform exploratory data analysis (EDA) to identify trends, patterns, and insights in large datasets.
• Deploy ML models into production using Databricks MLflow, Delta Live Tables, or other MLOps pipelines.
• Conduct A/B testing, forecasting, segmentation, anomaly detection, or recommendation systems as required by the business.
• Build scalable, high‑performance ETL/ELT pipelines using PySpark, SQL, and Databricks workflows.
• Work with Delta Lake to ensure high-quality, reliable, and performant data.
• Optimize cluster usage and job performance within the Databricks environment.
• Collaborate with data engineers to ensure high-quality data availability for modeling.

Business Collaboration

• Translate business problems into analytical solutions and present findings to non‑technical stakeholders.
• Partner with product, engineering, and business teams to drive data‑informed decisions.
• Communicate complex statistical concepts in a clear and concise manner.

Expertise You'll Bring

• Experience deploying models in production using MLOps frameworks.
• Knowledge of Azure Databricks or AWS Databricks environments.
• Understanding of CICD pipelines and DevOps concepts (Azure DevOps, GitHub Actions, etc.)
• Familiarity with deep learning frameworks (TensorFlow, PyTorch) is a plus
• Competitive salary and benefits package
• Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
• Opportunity to work with cutting‑edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and ‘Long Service’ awards
• Annual health check‑ups as well as insurance:
• Group term life insurance
• Mediclaim hospitalization insurance for self, spouse, two children, and parents

Why Persistent is an employer of choice

• Technology Innovation: culture of innovation using cutting‑edge technology to bring value to clients.
• Growth and Career Progression: learning opportunities for growth, including quarterly promotion cycles.
• One Persistent Culture: global outlook with diversity and inclusion at its core.
• Mental and Physical Wellness: employee health and mindfulness programs