Senior Data Engineer

Hearst; Troy (MI); Hybrid; USD 130,000 - 180,000; Full time

Benefits offered by this job

Hybrid schedule: 3 days onsite in Troy

Job summary

MOTOR Information Systems, a Hearst company, seeks a hands-on Senior Data Engineer to architect and evolve an AWS-based data platform, owning data pipelines and delivering scalable solutions across the product suite.

You will tackle large-scale data challenges, drive architectural decisions, mentor teammates, and help shape a modern, cost-efficient data architecture enabling AI-driven capabilities across products.

Qualifications

• Expert Python and SQL development experience.
• Strong AWS experience including Lambda, Glue, State Machines, Fargate and RedShift.
• Experience with Databricks, Delta Lake, notebooks, SQL Analytics.
• Experience with Kubernetes and container orchestration.
• DevOps, CI/CD, Deployment Orchestration experience.
• Experience with data handling tools like Pandas/NumPy, Spark, Ray.

Responsibilities

• Analyze large, complex data sets.
• Design, develop and coordinate the generation of data pipelines.
• Collaborate with team to plan and solve complex problems.
• Design for performance and cost optimization of pipelines.

Skills

Python

SQL

Automation

Pandas/NumPy

Apache Spark

Ray

Tools

AWS

Databricks

Kubernetes

Octopus Deploy

CloudFormation

RedShift

Job description

Senior DATA ENGINEER at MOTOR INFORMATION SYSTEMS

About MOTOR Information Systems (Hearst)
MOTOR is the industry leader in automotive data and insights. We power the aftermarket ecosystem with some of the most comprehensive datasets in the world—and we’re investing heavily in modernizing our data platform to support the next generation of products and AI-driven capabilities.

The Opportunity

We’re looking for a hands-on Senior Data Engineer to take a leading role in architecting, designing, building, and evolving our AWSbased data platform. This is not a maintenance role—you’ll have meaningful technical ownership and influence over how data is architected, processed, and delivered across our systems and product suite.

You’ll tackle large-scale, complex data challenges while driving architectural decisions, establishing engineering best practices, and designing solutions for scalability, reliability, performance, and cost efficiency. As a senior member of the team, you’ll collaborate across engineering and product, provide technical guidance and mentorship, and help shape the evolution of our platform toward a more modern, scalable, and intelligent data architecture.

Required Experience (Must Have)

• Expert Python & SQL Developer
• Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
• Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
• Strong Automation Experience
• Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
• Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
• Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
• Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
• Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)

Helpful Experience (Nice to Have)

• Experience with LLMs, Machine Learning & Deep Learning Libraries, AI Application Frameworks, Vector Databases
• Experience with Automotive Data / Industry
• Experience with Agile / Scrum

Primary Responsibilities

• Analyze large, and complex, data sets
• Design, develop and coordinate the generation of Data Pipelines
• Work collaboratively with team to plan and solve complex problems
• Design for, or optimize existing pipelines, for performance and cost

Why Join MOTOR

• Work on high-impact data products used across the automotive industry
• Real ownership and influence over platform direction
• Backed by Hearst—stable, but with room to innovate
• Collaborative team solving meaningful, complex problems

Additional Details

• Hybrid schedule: 3 days onsite in Troy, MI
• No visa sponsorship available at this time

EEO EMPLOYER

We’re looking for a hands-on Senior Data Engineer to take a leading role in architecting, designing, building, and evolving our AWSbased data platform. This is not a maintenance role—you’ll have meaningful technical ownership and influence over how data is architected, processed, and delivered across our systems and product suite.