Senior Data Scientist

Trigyn Technologies; United States; Remote; USD 100,000 - 140,000; Full time

Job summary

A leading company is seeking a Machine Learning Engineer with over 5 years of experience in predictive analytics. The role involves designing ML models and building end-to-end pipelines on Databricks, emphasizing collaboration with engineering teams for effective deployment. Candidates should have expertise in Python, PySpark, and applicable certifications, particularly for the life insurance industry.

Qualifications

• 5+ years in predictive analytics with expertise in regression, classification, time-series modeling.
• Hands-on experience with Databricks Runtime for ML, Spark SQL, and PySpark.
• Familiarity with MLflow, Feature Store, and Unity Catalog for governance.

Responsibilities

• Design and deploy predictive models using Python/SQL and Databricks.
• Collaborate with engineering teams to operationalize models.
• Implement Delta Lake for scalable data workflows.

Skills

Python

PySpark

MLflow

Databricks AutoML

Predictive Modelling

Cloud platform

Delta Lake

Unity Catalog

Education

B.Tech/BE or MCA

Job description

Job Description

**Responsibilities:**
• Design and deploy predictive models (e.g., forecasting, churn analysis, fraud detection) using Python/SQL, Spark MLlib, and Databricks ML
• Build end-to-end ML pipelines (data ingestion ? feature engineering ? model training ? deployment) on Databricks Lakehouse
• Optimize model performance via hyperparameter tuning, AutoML, and MLflow tracking
• Collaborate with engineering teams to operationalize models (batch/real-time) using Databricks Jobs or REST APIs
• Implement Delta Lake for scalable, ACID-compliant data workflows.
• Enable CI/CD for ML pipelines using Databricks Repos and GitHub Actions
• Troubleshoot issues in Spark Jobs and Databricks Environment.

**Requirements:**
• 5+ years in predictive analytics, with expertise in regression, classification, time-series modeling
• Hands-on experience with Databricks Runtime for ML, Spark SQL, and PySpark
• Familiarity with MLflow, Feature Store, and Unity Catalog for governance.
• Industry experience in Life Insurance or P&C.

**Skills:**
• Python, PySpark , MLflow , Databricks AutoML
• Predictive Modelling ( Classification , Clustering , Regression , timeseries and NLP)
• Cloud platform (Azure/AWS) , Delta Lake , Unity Catalog

**Certifications**
• Databricks Certified ML Practitioner

Qualification and Experience:
B.Tech/BE or MCA
Experience: 5+ years