Senior Data Engineer: Scale Data Pipelines & Architecture

AiAuto; Parsippany-Troy Hills (NJ); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

PTO & Sick Time

Medical, Dental, Vision

401k matching

Life Insurance

On-site cafeteria

Corporate events and team activities

Job summary

AiAuto in Parsippany, NJ is seeking a Senior Data Engineer to design, build, and maintain scalable data architecture and pipelines that power our data-driven initiatives.

You will mentor junior engineers, guide best practices, and collaborate across product, analytics, and DevOps to ensure high performance, reliability, and governance of our data platforms. We value clear communication and hands-on leadership in a fast-growing SaaS environment.

Qualifications

• Minimum 7-10+ years of data engineering experience is required.
• Bachelor's Degree in Data Engineering, Computer Science, Data Analytics or related field is required. Master’s Degree preferred.
• Must live in commutable distance to Parsippany, NJ. We are not considering out of state candidates at this time.
• Must have excellent communication skills both written and verbal in English. Must be able to present data to leadership and collaborate with team members.
• Strong technical coding capabilities.
• Advanced proficiency with SQL, Python, and ETL development are required.
• Python proficiency is required. Must be seen on resume.
• Strong experience with data modeling, data warehousing, and database technologies (e.g. PostgreSQL, Snowflake, Redshift).
• Experience with cloud data platforms (AWS or Azure) and cloud-native data engineering tools.
• Solid understanding of data architecture patterns (batch, streaming, event-driven) and best practices.
• Proven ability to optimize data workflows, troubleshoot complex issues, and ensure high system performance.
• Strong project management capabilities and ability to work independently.
• Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
• Must be able to pass a technical coding assessment.

Responsibilities

• Data Architecture, Pipeline Development, and Automation
• Lead the automation of data ingestion from diverse sources (databases, APIs, cloud services) and ensure system reliability and failover readiness.
• Oversee the optimization of data storage, processing, and retrieval for performance, cost-efficiency, and scalability.
• Process Improvement and Technical Leadership
• Identify, evaluate, and implement improvements to legacy systems, ensuring alignment with current and future business demands.
• Research, recommend, and introduce advanced tools, frameworks, and technologies to enhance the data platform.
• Provide technical leadership to the data engineering team, including mentoring, code reviews, and enforcing engineering best practices.
• Data Governance, Integrity, and Quality
• Ensure end-to-end data quality and integrity by establishing and enforcing robust validation, monitoring, and testing protocols.
• Collaborate with cross-functional stakeholders to translate business requirements into well-defined data models and transformations.
• Proactively identify and resolve data inconsistencies, gaps, and errors across systems.
• Cross-functional Collaboration
• Partner closely with data analysts, data scientists, product managers, and business leaders to deliver data products that enable analytics, reporting, and advanced modeling.
• Work with DevOps, software engineering, and IT teams to ensure seamless integration of data systems with enterprise platforms.
• Drive the creation of self-service data tools, dashboards, and reporting solutions that empower business teams.
• Documentation, Knowledge Sharing, and Strategy
• Develop and maintain comprehensive documentation for data models, pipelines, processes, and system architecture.
• Share knowledge and lead training efforts to upskill the team and promote a data-driven culture.
• Contribute to the long-term data strategy, including architecture roadmaps, data governance policies, and compliance initiatives.
• Other Responsibilities
• Perform any other duties assigned by the discretion of management.

Skills

SQL

Python

ETL development

Data modeling

Data warehousing

PostgreSQL

Snowflake

Redshift

AWS

Azure

Batch processing

Streaming data

Event-driven

Data governance

DevOps collaboration

Communication skills

Education

Bachelor's Degree in Data Engineering, Computer Science, Data Analytics or related field

Master’s Degree preferred

Tools

PostgreSQL

Snowflake

Redshift

AWS

Azure

ETL tools

Job description

AiAuto in Parsippany, NJ is seeking a Senior Data Engineer to design, build, and maintain scalable data architecture and pipelines that power our data-driven initiatives.

You will mentor junior engineers, guide best practices, and collaborate across product, analytics, and DevOps to ensure high performance, reliability, and governance of our data platforms. We value clear communication and hands-on leadership in a fast-growing SaaS environment.