Full-Stack Data Engineer: Build AI-Driven Data Pipelines
MOTOR Information Systems
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
MOTOR Information Systems, part of Hearst, seeks a Full-Stack Data Engineer to design, optimize, and upgrade complex data solutions across the Automotive Content product line. You will help drive the Insights-based product suite and modernize data platforms in a hands-on role.
The role emphasizes building scalable data pipelines, collaborating with cross-functional teams, and leveraging AWS, Databricks, and AI/ML toolchains to improve performance and cost efficiency.
Qualifications
- Expert Python development experience.
- Strong SQL development experience.
- Robust AWS experience (Lambda, Glue, Step Functions, Fargate).
- Experience with semi-structured data (XML, CSV, JSON, Parquet).
- Strong automation experience across data pipelines.
- Experience with Databricks (Delta Lake, Notebooks, SQL Analytics).
- Experience with Kubernetes (Cluster Orchestration, Networking).
- Experience with DevOps/CI-CD/Deployment Orchestration (Octopus Deploy).
- Experience with Git and Azure DevOps.
- Experience with Agentic AI frameworks.
- Experience with data handling tools (Pandas/NumPy, Apache Spark, Ray).
Responsibilities
- Analyze large, complex data sets.
- Design, develop and coordinate data pipelines.
- Collaborate with team to plan and solve complex problems.
- Design for performance and cost optimization of pipelines.
Skills
Tools
Job description
MOTOR Information Systems, part of Hearst, seeks a Full-Stack Data Engineer to design, optimize, and upgrade complex data solutions across the Automotive Content product line. You will help drive the Insights-based product suite and modernize data platforms in a hands-on role.
The role emphasizes building scalable data pipelines, collaborating with cross-functional teams, and leveraging AWS, Databricks, and AI/ML toolchains to improve performance and cost efficiency.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
