Data Engineer

Apptad Inc; Dallas (TX); Vor Ort; USD 110.000 - 170.000; Vollzeit

Zusammenfassung

Apptad Inc is seeking a senior data engineer to design and maintain scalable pipelines for multimodal data including video, LiDAR, GNSS, and telemetry. You will normalize, synchronize, and enrich data to support AI training and annotation workflows, ensuring dataset quality and reproducibility.

Responsibilities include implementing automated data checks, modeling metadata, and guiding lineage practices while collaborating with AI, quality, and platform teams to optimize performance and cost.

Qualifikationen

• 5+ years of data engineering experience.
• Experience processing unstructured and multimodal data including video, images, LiDAR, GNSS, IMU, and telemetry.
• Experience building pipelines to ingest, transform, validate, and publish curated AI training datasets.
• Strong Python and SQL skills with experience in distributed data processing frameworks.
• Experience with cloud data platforms, object storage, data lake or lakehouse patterns, and workflow orchestration.
• Knowledge of data quality, metadata, lineage, schema management, and reproducible dataset pipelines.

Aufgaben

• Design, develop, and maintain scalable pipelines for camera, LiDAR, GNSS, IMU, and telemetry data.
• Normalize, synchronize, enrich, and package multimodal data for annotation and AI training.
• Implement automated checks for completeness, integrity, calibration, timestamps, formats, and dataset consistency.
• Create reusable data models, metadata standards, lineage, and dataset-versioning practices.
• Optimize pipeline performance, reliability, observability, and cost.
• Troubleshoot data defects and collaborate with AI, annotation, quality, and platform teams.
• Document technical designs, operating procedures, and handoffs.

Kenntnisse

Data engineering

Multimodal data processing

AI training data pipelines

Python

SQL

Distributed processing

Cloud platforms

Metadata & data quality

Tools

Python

SQL

Distributed data processing

Jobbeschreibung

Must Have Technical/Functional Skills

• 5+ years of data engineering experience.


• Demonstrated experience processing unstructured and multimodal data, including video, images, LiDAR, GNSS, IMU, and telemetry.


• Experience building pipelines that create curated AI training datasets through ingestion, synchronization, transformation, validation, and publishing.


• Strong Python and SQL skills with experience in distributed data processing frameworks.


• Experience with cloud data platforms, object storage, data lake or lakehouse patterns, workflow orchestration, and version control.


• Knowledge of data quality, metadata, lineage, schema management, and reproducible dataset pipelines.

Roles & Responsibilities

• Design, develop, and maintain scalable pipelines for camera, LiDAR, GNSS, IMU, and telemetry data.


• Normalize, synchronize, enrich, and package multimodal data for annotation and AI training.


• Implement automated checks for completeness, integrity, calibration, timestamps, formats, and dataset consistency.


• Create reusable data models, metadata standards, lineage, and dataset-versioning practices.


• Optimize pipeline performance, reliability, observability, and cost.


• Troubleshoot data defects and collaborate with AI, annotation, quality, and platform teams.


• Document technical designs, operating procedures, and handoffs.

Generic Managerial Skills, If Any

• Strong ownership, analytical problem solving, communication, and ability to work independently within an agile delivery team