Senior Data Engineer: AI-Driven Data Pipelines

Boston University; Boston (MA); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Time Off

Retirement

Tuition Assistance Program

Job summary

Boston University IS&T seeks a Data Engineer III to design and scale modern data pipelines and platforms supporting institutional reporting, research, and strategic initiatives.

You will build batch and streaming ETL processes, optimize data models, and ensure data quality with governance across enterprise data assets. A collaborative, agile team environment is offered with robust cloud and container-based workflows.

Qualifications

• Degree in Computer Science, Information Systems, Data Analytics, or Business Analytics.
• Master's degree preferred.
• 3+ years of data engineering, data analytics, and backend software development experience.
• Proficiency in Python for data transformation and automation.
• Strong SQL skills with PostgreSQL and SQL Server.
• Hands-on experience with orchestration frameworks (Dagster, Airflow, SSIS).
• Experience with ETL/ELT pipelines, data warehousing, and Kimball dimensional modeling.
• Familiarity with AWS data lake components and containerized workflows (Kubernetes, Docker).
• CI/CD pipelines, Git, and Agile processes.
• Data governance, privacy, and compliance experience.

Responsibilities

• Design and maintain scalable DAG-based data pipelines using Dagster.
• Build and optimize data models in PostgreSQL using DBT for analytical use cases.
• Develop batch and streaming ETL processes leveraging AWS services.
• Deploy and manage containerized workloads on Kubernetes; use IaC.
• Implement data quality checks, observability, and automated validation.
• Define schemas and data contracts with cross-functional teams.
• Contribute to CI/CD workflows to review code and document standards.

Skills

Python data tooling

SQL proficiency

ETL/ELT design

Communication

CI/CD practices

Agile teamwork

Cloud data frameworks

Education

Bachelor's degree in CS/IS/Analytics

Master's degree preferred

Tools

Dagster

Airflow

SSIS

PostgreSQL

SQL Server

Kubernetes

Docker

AWS (S3, Glue, Athena)

GitHub Actions

Job description

Boston University IS&T seeks a Data Engineer III to design and scale modern data pipelines and platforms supporting institutional reporting, research, and strategic initiatives.

You will build batch and streaming ETL processes, optimize data models, and ensure data quality with governance across enterprise data assets. A collaborative, agile team environment is offered with robust cloud and container-based workflows.