Data Engineer

Realign LLC; Dallas (TX); Sur place; USD 110 000 - 130 000; Plein temps

Résumé du poste

Realign LLC in Dallas, TX is seeking a Data Engineer to build and maintain scalable pipelines for multimodal AI training data. This onsite role focuses on ingesting, normalizing, and enriching camera, LiDAR, GNSS, IMU, and telemetry streams to support high-quality datasets.

You will work with Python and SQL, leverage cloud data platforms, and ensure data quality, lineage, and reproducibility within an agile delivery team.

Qualifications

• 5+ years of data engineering experience.
• Experience processing unstructured and multimodal data (video, images, LiDAR, GNSS, IMU, telemetry).
• Experience building pipelines that produce curated AI training datasets through ingestion, synchronization, transformation, validation, and publishing.
• Strong Python and SQL skills, plus experience with distributed data processing frameworks.
• Experience with cloud data platforms and patterns (object storage, data lake/lakehouse, workflow orchestration, version control).
• Knowledge of data quality, metadata, lineage, schema management, and reproducible dataset pipelines.
• Strong ownership, analytical problem solving, and ability to work independently within an agile delivery team.

Responsabilités

• Design, develop, and maintain scalable pipelines for camera, LiDAR, GNSS, IMU, and telemetry data.
• Normalize, synchronize, enrich, and package multimodal data for annotation and AI training.
• Implement automated checks covering completeness, integrity, calibration, timestamps, formats, and dataset consistency.
• Create reusable data models and define metadata standards.
• Establish data lineage and dataset-versioning practices for dataset-versioned, quality-controlled outputs.
• Optimize pipeline performance, reliability, observability, and cost.
• Troubleshoot data defects and collaborate with AI, annotation, quality, and platform teams.
• Document technical designs, operating procedures, and handoffs.

Connaissances

Python

SQL

Distributed data processing

Description du poste

Realign LLC is hiring a Data Engineer in Dallas, TX onsite to build and maintain scalable pipelines for multimodal, curated AI training datasets.

Responsibilities

• Design, develop, and maintain scalable pipelines for camera, LiDAR, GNSS, IMU, and telemetry data
• Normalize, synchronize, enrich, and package multimodal data for annotation and AI training
• Implement automated checks covering completeness, integrity, calibration, timestamps, formats, and dataset consistency
• Create reusable data models and define metadata standards
• Establish data lineage and dataset-versioning practices for dataset-versioned, quality-controlled outputs
• Optimize pipeline performance, reliability, observability, and cost
• Troubleshoot data defects and collaborate with AI, annotation, quality, and platform teams
• Document technical designs, operating procedures, and handoffs

Requirements

• 5+ years of data engineering experience
• Experience processing unstructured and multimodal data, including video, images, LiDAR, GNSS, IMU, and telemetry
• Experience building pipelines that produce curated AI training datasets through ingestion, synchronization, transformation, validation, and publishing
• Strong Python and SQL skills, plus experience with distributed data processing frameworks
• Experience with cloud data platforms and patterns including object storage, data lake / lakehouse, workflow orchestration, and version control
• Knowledge of data quality, metadata, lineage, schema management, and reproducible dataset pipelines
• Strong ownership, analytical problem solving, communication, and ability to work independently within an agile delivery team

Skills & Tools

• Python
• SQL

Location: Dallas, TX (onsite)

Salary: USD 120,000 per year

Minimum experience: 5 years