Senior Data Engineer: AI-Driven Platform & MLOps

hatch I.T.; Somerville (MA); On-site; USD 120,000 - 150,000; Full time

Job summary

A tech-driven organization is looking for a Senior Data Engineer to design and implement robust cloud-based data storage solutions. This role involves working cross-functionally with teams to develop efficient ETL/ELT pipelines that leverage AI for data-driven decision-making. The ideal candidate will have a Bachelor's degree and over 5 years of experience in data engineering, with expertise in Python and cloud databases. Join us to drive innovation in data accessibility and governance.

Qualifications

• 5+ years of professional experience in data engineering or a related role.
• A strong foundation in Python including testing frameworks and ORMs.
• Experience building resilient pipelines using frameworks such as Dagster or Apache Airflow.

Responsibilities

• Design and implement robust, cloud-based data storage solutions.
• Develop, deploy, and maintain resilient ETL/ELT pipelines for data flow.
• Drive data governance and best practices for maintaining data health.

Skills

Data engineering

Python

Cloud-based databases

ETL/ELT pipelines

Data governance

REST APIs

MLOps

Query tuning

Education

Bachelor’s degree in Computer Science, Engineering, or Data Science

Tools

AWS RDS

Azure Database

Apache Airflow

Docker

Kubernetes

Job description

A tech-driven organization is looking for a Senior Data Engineer to design and implement robust cloud-based data storage solutions. This role involves working cross-functionally with teams to develop efficient ETL/ELT pipelines that leverage AI for data-driven decision-making. The ideal candidate will have a Bachelor's degree and over 5 years of experience in data engineering, with expertise in Python and cloud databases. Join us to drive innovation in data accessibility and governance.