Senior Data Engineer — AI-Driven AWS/Python Platform

Eevd; City of Troy (NY); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

High-impact data products

Platform ownership

Backed by Hearst

Collaborative team

Job summary

MOTOR Information Systems, part of Hearst, seeks a hands-on Senior Data Engineer to architect, design, and evolve an AWS-based data platform. You will own end-to-end data pipelines, drive architecture decisions, establish best practices, and mentor juniors.

The role partners with product teams to deliver scalable, cost-efficient data solutions. The position features collaboration across engineering and data science, a hybrid work model (3 days onsite in Troy, MI), and a chance to shape the

Qualifications

• Hands-on expertise in Python and SQL development.
• Strong AWS experience including Lambda, Glue, Fargate and RedShift.
• Experience with semi-structured data formats (XML/CSV/JSON/Parquet).
• Automation and data pipeline development expertise.

Responsibilities

• Analyze large, complex data sets to extract insights.
• Design, develop and coordinate generation of data pipelines.
• Collaborate across engineering and product teams on solutions.
• Design for performance and cost optimization of pipelines.

Skills

Python

SQL

AWS

Semi-structured data

Databricks

Kubernetes

DevOps CI/CD

Agent AI

Pandas/NumPy/Spark/Ray

Tools

Lambda

Glue

State Machines

Fargate

CloudFormation

RedShift

Octopus Deploy

Delta Lake

Spark

Job description

MOTOR Information Systems, part of Hearst, seeks a hands-on Senior Data Engineer to architect, design, and evolve an AWS-based data platform. You will own end-to-end data pipelines, drive architecture decisions, establish best practices, and mentor juniors.

The role partners with product teams to deliver scalable, cost-efficient data solutions. The position features collaboration across engineering and data science, a hybrid work model (3 days onsite in Troy, MI), and a chance to shape the