Senior Data Engineer

Eevd

City of Troy (NY)

Hybrid

USD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

High-impact data products

Platform ownership

Backed by Hearst

Collaborative team

Job summary

MOTOR Information Systems, part of Hearst, seeks a hands-on Senior Data Engineer to architect, design, and evolve an AWS-based data platform. You will own end-to-end data pipelines, drive architecture decisions, establish best practices, and mentor juniors.

The role partners with product teams to deliver scalable, cost-efficient data solutions. The position features collaboration across engineering and data science, a hybrid work model (3 days onsite in Troy, MI), and a chance to shape the

Qualifications

Hands-on expertise in Python and SQL development.
Strong AWS experience including Lambda, Glue, Fargate and RedShift.
Experience with semi-structured data formats (XML/CSV/JSON/Parquet).
Automation and data pipeline development expertise.

Responsibilities

Analyze large, complex data sets to extract insights.
Design, develop and coordinate generation of data pipelines.
Collaborate across engineering and product teams on solutions.
Design for performance and cost optimization of pipelines.

Skills

Python

SQL

AWS

Semi-structured data

Databricks

Kubernetes

DevOps CI/CD

Agent AI

Pandas/NumPy/Spark/Ray

Tools

Lambda

Glue

State Machines

Fargate

CloudFormation

RedShift

Octopus Deploy

Delta Lake

Spark

Job description

Senior DATA ENGINEER at MOTOR INFORMATION SYSTEMS

About MOTOR Information Systems (Hearst)
MOTOR is the industry leader in automotive data and insights. We power the aftermarket ecosystem with some of the most comprehensive datasets in the world—and we’re investing heavily in modernizing our data platform to support the next generation of products and AI-driven capabilities.

The Opportunity

We’re looking for a hands-on Senior Data Engineer to take a leading role in architecting, designing, building, and evolving our AWSbased data platform. This is not a maintenance role—you’ll have meaningful technical ownership and influence over how data is architected, processed, and delivered across our systems and product suite.

You’ll tackle large-scale, complex data challenges while driving architectural decisions, establishing engineering best practices, and designing solutions for scalability, reliability, performance, and cost efficiency. As a senior member of the team, you’ll collaborate across engineering and product, provide technical guidance and mentorship, and help shape the evolution of our platform toward a more modern, scalable, and intelligent data architecture.

Required Experience (Must Have)

Expert Python & SQL Developer
Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
Strong Automation Experience
Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)

Helpful Experience (Nice to Have)

Experience with LLMs, Machine Learning & Deep Learning Libraries, AI Application Frameworks, Vector Databases
Experience with Automotive Data / Industry
Experience with Agile / Scrum

Primary Responsibilities