Remote ML Data Engineer: Scalable Pipelines

EdgeQ Technologies Private Limited; United States; Remote; USD 110,000 - 175,000; Full time

Job summary

EdgeQ Technologies Private Limited in the United States is seeking a Machine Learning Data Engineer to design and maintain scalable data pipelines and data infrastructure supporting ML applications.

You will work with Data Scientists and ML engineers to prepare high-quality training data, implement preprocessing and feature extraction, and optimize cloud-based pipelines for performance and governance.

Qualifications

• 3–8 years of professional experience in Data Engineering or ML data engineering.
• Strong programming skills in Python and SQL.
• Hands-on experience building ETL/ELT pipelines.
• Experience with distributed processing frameworks (Spark/PySpark).
• Knowledge of cloud data platforms and data warehouses.

Responsibilities

• Design, develop, and maintain scalable data pipelines for ML/AI applications.
• Build and optimize ETL/ELT workflows for structured and unstructured datasets.
• Develop data ingestion, transformation, validation, and processing solutions.
• Collaborate with Data Scientists, ML Engineers, and AI teams to prepare training datasets.
• Implement data preprocessing, feature engineering, and feature extraction pipelines.
• Manage large-scale datasets using distributed processing technologies.
• Develop and maintain cloud-based data infrastructure.
• Implement data quality checks, monitoring, and automated validation processes.
• Optimize data storage, retrieval, and processing performance.
• Support machine learning model training, evaluation, and deployment workflows.
• Integrate data from APIs, databases, streaming platforms, and external sources.
• Implement data governance, security, and compliance best practices.
• Maintain technical documentation and participate in code reviews.

Skills

Python

SQL

ETL/ELT pipelines

Apache Spark

Airflow

AWS/Azure/GCP

Data modeling

Git CI/CD

Kubernetes

Education

Bachelor's or Master's degree in CS/DS/IT/Engineering

Tools

Snowflake

BigQuery

Redshift

Databricks

Kafka

Docker

Kubernetes

Delta Lake

Dagster

MLflow

Job description

EdgeQ Technologies Private Limited in the United States is seeking a Machine Learning Data Engineer to design and maintain scalable data pipelines and data infrastructure supporting ML applications.

You will work with Data Scientists and ML engineers to prepare high-quality training data, implement preprocessing and feature extraction, and optimize cloud-based pipelines for performance and governance.