Senior Data Engineer - AI-Driven Data Platform

Hatch IT; Somerville (MA); On-site; USD 130,000 - 180,000; Full time

Job summary

VIA is seeking a Senior Data Engineer to join their data platform as part of a cross-functional team. You will design cloud-based data storage, build robust ETL/ELT pipelines for both real-time streaming and batch processing, and develop data access layers to empower downstream users.

A strong foundation in Python and SQL is required, with experience in data governance and MLOps. You will work with a high-performing team of data professionals, developers, DevOps, and Client Delivery specialists

Qualifications

• Bachelor’s degree or higher in Computer Science, Engineering, or Data Science.

Responsibilities

• Design and implement cloud-based data storage solutions with multi-tenant schemas.
• Develop, deploy, and maintain robust ETL/ELT pipelines for real-time streaming and batch processing.
• Build and manage data access layers, including REST APIs and streaming services.
• Drive data governance and promote data health, integrity and security across teams.
• Support AI operations (MLOps) by managing versioning, containerization, and deployment of AI models.
• Create monitoring and alerting systems to track data health and performance.

Skills

Python

Data engineering

SQL

Data modeling

ETL/ELT

CI/CD

Git

Education

Bachelor’s degree in Computer Science, Engineering, or Data Science

Tools

Dagster

Apache Airflow

Kafka

Docker

Kubernetes

SQLAlchemy

pytest

Job description

VIA is seeking a Senior Data Engineer to join their data platform as part of a cross-functional team. You will design cloud-based data storage, build robust ETL/ELT pipelines for both real-time streaming and batch processing, and develop data access layers to empower downstream users.

A strong foundation in Python and SQL is required, with experience in data governance and MLOps. You will work with a high-performing team of data professionals, developers, DevOps, and Client Delivery specialists