Cloud Data Engineer - ML Pipelines (Remote)

Manulife; California (MO); On-site; USD 90,000 - 167,000; Full time

Benefits offered by this job

Remote work across the United States

Incentive programs

Job summary

The Data Engineer position at John Hancock Life Insurance Company (USA) is a fully remote opportunity available across the United States. The role focuses on building scalable data pipelines, migrating data architectures to cloud platforms, and delivering analytics-ready datasets for business stakeholders.

You will design and optimize Spark-based pipelines, implement secure governance, work with SQL and NoSQL databases, and collaborate with data scientists to deploy ML models.

Qualifications

• Master’s degree or foreign equivalent in Computer Science, Electrical Engineering, Information Systems or related field and 3 years of experience with Python, SQL, and ETL processes.
• Experience with cloud platforms including AWS and Azure.
• Experience with distributed computing frameworks including Spark, Databricks and Synapse.
• Experience with orchestration tools including Apache Airflow.
• Experience with data visualization tools including Power BI and Tableau.

Responsibilities

• Discover insights from large datasets using analytics and ML techniques.
• Design, build and maintain data pipelines for ETL/ELT processes.
• Migrate legacy data architectures to Azure and AWS.
• Develop Spark-based pipelines using Databricks and Synapse.
• Automate data ingestion, transformation, and delivery with Airflow.
• Create dashboards to communicate insights to stakeholders.
• Design and manage MSSQL, PostgreSQL and NoSQL databases.
• Implement secure, governed data pipelines.
• Integrate data from REST APIs for analysis and modeling.
• Collaborate with data scientists to deploy ML models.
• Monitor data pipelines for health and cost efficiency.
• Use Docker to build and deploy applications.

Skills

Python

SQL

ETL

AWS

Azure

Spark

Databricks

Synapse

Airflow

Power BI

Tableau

MSSQL

PostgreSQL

NoSQL

REST APIs

Docker

ML/Predictive modeling

Monitoring

DevOps

Containerization

Education

Master’s degree in Computer Science or related field

Tools

Databricks

Synapse

Apache Airflow

Spark

Docker

Job description

The Data Engineer position at John Hancock Life Insurance Company (USA) is a fully remote opportunity available across the United States. The role focuses on building scalable data pipelines, migrating data architectures to cloud platforms, and delivering analytics-ready datasets for business stakeholders.

You will design and optimize Spark-based pipelines, implement secure governance, work with SQL and NoSQL databases, and collaborate with data scientists to deploy ML models.