Senior Data Engineer: Real-Time Pipelines & Data Platforms

Strategic Employment Partners (SEP); Boston (MA); Hybrid; USD 150,000 - 210,000; Full time

Job summary

Unknown company in the Boston area is hiring a Senior Data Engineer to modernize data systems behind its digital products. This senior role offers high autonomy on a cross-functional Scrum team, building and operating data pipelines for real-time and batch workloads.

You will partner with product, analytics and engineering stakeholders to turn ambiguous requirements into reliable systems while setting a high technical standard for pipeline design, testing, and monitoring.

Qualifications

• 7+ years of software engineering with a focus on data engineering.
• ,
• ,
• ],
• job_responsibilities_description:[
• ,
• ,
• ,
• ] ,
• ,
• ,
• ,
• ,
• ]} } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } }
• } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } }

Responsibilities

• Build and operate data pipelines for real-time and batch use cases.
• Partner with product, analytics, and engineering to translate ambiguous requirements into reliable systems.
• Help set the technical bar for pipeline design, testing, and monitoring.
• Mentor other engineers and contribute to broader technical direction.

Skills

Data engineering

AWS

Python

Java

Scala

Spark

Kafka

Airflow

dbt

Snowflake

BigQuery

Data modeling

Dimensional modeling

Agile

Tools

Spark

Kafka

Airflow

dbt

Snowflake

BigQuery

Job description

Unknown company in the Boston area is hiring a Senior Data Engineer to modernize data systems behind its digital products. This senior role offers high autonomy on a cross-functional Scrum team, building and operating data pipelines for real-time and batch workloads.

You will partner with product, analytics and engineering stakeholders to turn ambiguous requirements into reliable systems while setting a high technical standard for pipeline design, testing, and monitoring.