Senior Data Engineer

MOTOR Information Systems; Troy (MI); Hybrid; USD 120,000 - 160,000; Full time

Job summary

MOTOR INFORMATION SYSTEMS in Troy, MI is seeking a Senior Data Engineer to lead architecture and build of an AWS-based data platform. You will own data architecture decisions, drive scalable pipelines, and mentor teammates across engineering and product groups.

Bring hands-on expertise with Python, SQL, AWS services, Databricks, Kubernetes, and data processing tools. The role emphasizes performance, reliability, cost efficiency, and collaboration in a hybrid work model.

Qualifications

• Expert Python & SQL development experience.
• Strong AWS experience with Lambda/Glue/State Machines.
• Experience with semi-structured data (XML/CSV/JSON/Parquet).
• Automation, CI/CD, and deployment orchestration skills.
• Experience with Databricks, Kubernetes, and Spark.
• Familiarity with agentic AI and data handling libraries.

Responsibilities

• Analyze large, complex data sets to derive insights.
• Design and coordinate data pipelines end-to-end.
• Collaborate across teams to solve complex problems.
• Design for performance, cost efficiency, and reliability.

Skills

Python

SQL

AWS

Data modeling

Databricks

Kubernetes

CI/CD

DevOps

Big data

Pandas/NumPy

Apache Spark

Parquet

LangGraph/Agent Frameworks

Tools

Databricks

AWS CloudFormation

RedShift

Fargate

Notebooks

Job description

Job Description

Senior DATA ENGINEER at MOTOR INFORMATION SYSTEMS

About MOTOR Information Systems (Hearst)

MOTOR is the industry leader in automotive data and insights. We power the aftermarket ecosystem with some of the most comprehensive datasets in the world—and we’re investing heavily in modernizing our data platform to support the next generation of products and AI-driven capabilities.

The Opportunity

We’re looking for a hands-on Senior Data Engineer to take a leading role in architecting, designing, building, and evolving our AWSbased data platform. This is not a maintenance role—you’ll have meaningful technical ownership and influence over how data is architected, processed, and delivered across our systems and product suite.

You’ll tackle large-scale, complex data challenges while driving architectural decisions, establishing engineering best practices, and designing solutions for scalability, reliability, performance, and cost efficiency. As a senior member of the team, you’ll collaborate across engineering and product, provide technical guidance and mentorship, and help shape the evolution of our platform toward a more modern, scalable, and intelligent data architecture.

Required Experience (Must Have)

• Expert Python & SQL Developer
• Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
• Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
• Strong Automation Experience
• Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
• Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
• Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
• Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
• Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)

Helpful Experience (Nice to Have)

• Experience with LLMs, Machine Learning & Deep Learning Libraries, AI Application Frameworks, Vector Databases
• Experience with Automotive Data / Industry
• Experience with Agile / Scrum

Primary Responsibilities

• Analyze large, and complex, data sets
• Design, develop and coordinate the generation of Data Pipelines
• Work collaboratively with team to plan and solve complex problems
• Design for, or optimize existing pipelines, for performance and cost

Why Join MOTOR

• Work on high-impact data products used across the automotive industry
• Real ownership and influence over platform direction
• Backed by Hearst—stable, but with room to innovate
• Collaborative team solving meaningful, complex problems

Additional Details

• Hybrid schedule: 3 days onsite in Troy, MI
• No visa sponsorship available at this time

EEO EMPLOYER