ML Data Engineer: Build & Scale Data Pipelines

CLEAR DEMAND Inc.; Scottsdale (AZ); On-site; USD 120,000 - 180,000; Full time

Job summary

CLEAR DEMAND Inc. is seeking a data/ML data engineer in Scottsdale, AZ to bridge data engineering and ML engineering, ensuring high-quality, scalable data flows for model training, inference, evaluation, and business reporting.

You will build and optimize data pipelines, manage large datasets, and collaborate with ML engineers to prepare clean datasets for model workflows, while improving performance, reliability, and cost efficiency.

Qualifications

• Strong programming skills.
• Hands-on experience with data processing pipelines and large datasets.
• ETL / ELT design, data modeling, partitioning, incremental processing, and data validation.
• Experience with Spark, Airflow, AWS Glue, Databricks, BigQuery, Snowflake, Redshift, Athena.
• Debug data quality issues and trace data across systems.
• Experience building monitoring, reconciliation, or data quality frameworks.
• APIs, file formats, and data storage formats understanding.
• Strong with AWS and GCP.
• ML workflows basics: training data prep, inference data generation, evaluation datasets, feature engineering.
• Experience with ML pipelines or MLOps workflows.
• Write clean, modular, maintainable, well-documented code.

Responsibilities

• Build, maintain, and optimize data pipelines that support ML/Model workflows, Decision systems, model inference, and validation processes.
• Work with large-scale structured and semi-structured datasets across product catalogs, competitor data, customer data, match data, and validation data.
• Develop robust ETL / ELT workflows using Python, SQL, Spark or equivalent distributed processing frameworks.
• Support feature generation, data reconciliation, data quality checks, and data observability for ML systems.
• Collaborate with ML Engineers and Data Scientists to prepare clean, reliable datasets for model training, evaluation, and inference.
• Improve pipeline performance, scalability, reliability, and cost efficiency.
• Build reusable data processing components and automation utilities.
• Debug data discrepancies across upstream and downstream systems.
• Support operational reporting, dashboards, metric pipelines, and audit workflows.
• Work closely with engineering teams to productionize ML data flows and ensure smooth handoffs between data systems and ML systems.

Skills

Data pipelines

Python

SQL

Spark

Airflow

Cloud (AWS/GCP)

MLOps

Data quality

Tools

Spark

Airflow

AWS Glue

Databricks

BigQuery

Snowflake

Redshift

Athena

Job description

CLEAR DEMAND Inc. is seeking a data/ML data engineer in Scottsdale, AZ to bridge data engineering and ML engineering, ensuring high-quality, scalable data flows for model training, inference, evaluation, and business reporting.

You will build and optimize data pipelines, manage large datasets, and collaborate with ML engineers to prepare clean datasets for model workflows, while improving performance, reliability, and cost efficiency.