Data Engineer

Siri InfoSolutions, Inc.; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Siri InfoSolutions, Inc. seeks an experienced Data Engineer to lead the architecture of multimodal data pipelines, including ingestion, processing, and publishing of sensor datasets.

You will design scalable data platforms, collaborate with AI and platform teams, and drive data quality, governance, and observability across pipelines.

Qualifications

• 8+ years of data engineering experience with technical leadership.
• Experience processing unstructured and multimodal data including video, images, LiDAR, GNSS, IMU, and telemetry.
• Proven track record designing architectures and pipelines for AI training dataset creation at scale.
• Advanced Python and SQL skills with distributed processing and workflow orchestration.
• Experience with cloud data platforms, object storage, lakehouse patterns, metadata, lineage, governance, and dataset versioning.
• Strong understanding of data quality, observability, performance engineering, and production support.

Responsibilities

• Own the end-to-end architecture for ingestion, transformation, synchronization, validation, and publishing of multimodal sensor datasets.
• Define engineering standards, reusable frameworks, data contracts, metadata, lineage, and quality controls.
• Lead design reviews and guide engineers on implementation, testing, troubleshooting, and performance optimization.
• Partner with AI, perception, annotation, platform, and business stakeholders to prioritize requirements and milestones.
• Establish monitoring and operational controls for pipeline reliability, throughput, traceability, and cost.
• Lead root-cause analysis and remediation for complex data and pipeline defects.
• Maintain architecture documentation, technical roadmaps, delivery risks, and knowledge transfer.

Skills

Data engineering

Leadership

Python

SQL

Multimodal data

Video data

LiDAR data

GNSS data

IMU data

Telemetry data

Distributed processing

Orchestration

Cloud platforms

Object storage

Lakehouse

Metadata

Data governance

Data quality

Observability

Production support

End-to-end architecture

Data contracts

Monitoring

Root-cause analysis

Knowledge transfer

Job description

• 8+ years of data engineering experience, including technical leadership of complex data platforms or pipelines.
• Demonstrated proficiency processing unstructured and multimodal data, including video, images, LiDAR, GNSS, IMU, and telemetry.
• Proven experience designing architectures and pipelines for AI training dataset creation at scale.
• Advanced Python and SQL skills with hands-on experience in distributed processing and workflow orchestration.
• Experience with cloud data platforms, object storage, lakehouse patterns, metadata, lineage, governance, and dataset versioning.
• Strong understanding of data quality, observability, performance engineering, and production support.
• Own the end-to-end architecture for ingestion, transformation, synchronization, validation, and publishing of multimodal sensor datasets.
• Define engineering standards, reusable frameworks, data contracts, metadata, lineage, and quality controls.
• Lead design reviews and guide engineers on implementation, testing, troubleshooting, and performance optimization.
• Partner with AI, perception, annotation, platform, and business stakeholders to prioritize requirements and milestones.
• Establish monitoring and operational controls for pipeline reliability, throughput, traceability, and cost.
• Lead root-cause analysis and remediation for complex data and pipeline defects.
• Maintain architecture documentation, technical roadmaps, delivery risks, and knowledge transfer.