Data Engineer - ML Pipelines & Data Quality

voltai-com; Edison (CA); On-site; USD 140,000 - 220,000; Full time

Benefits offered by this job

Unlimited PTO

Comprehensive Health Coverage

Free Meals and Snacks

Professional Growth

Visa Sponsorship

Job summary

Voltai is seeking a data engineering-focused professional to collect, parse, and structure diverse data types for machine learning. You will design and maintain scalable data pipelines, optimize storage, and collaborate with ML and infrastructure teams to curate high-quality training datasets.

You will implement robust data validation and governance, ensuring data integrity across workflows. A strong background in Python and data tooling is essential for success in this role.

Qualifications

• Proficiency in Python and compiled languages (Go or Rust).
• Experience parsing data from PDFs, HTML, images, and binaries.
• Experience building scalable data pipelines and data ingestion workflows.

Responsibilities

• Collect, parse, and structure diverse data types into ML-ready formats.
• Design and maintain scalable data pipelines for high throughput data ingestion.
• Optimize storage for performance, cost, and scalability.
• Collaborate with ML and infrastructure engineers to curate training datasets.
• Implement data validation and governance processes to ensure data quality.

Skills

Python

Go or Rust

Data Parsing

Data Pipeline Frameworks

Data Processing Tools

Database Systems

AWS / Cloud

Web Crawling

Data Quality & Governance

Education

Bachelor's degree in CS/Engineering

Tools

BeautifulSoup

pdfminer.six

Scrapy

Apache Airflow

Dagster

Apache Beam

Job description

Voltai is seeking a data engineering-focused professional to collect, parse, and structure diverse data types for machine learning. You will design and maintain scalable data pipelines, optimize storage, and collaborate with ML and infrastructure teams to curate high-quality training datasets.

You will implement robust data validation and governance, ensuring data integrity across workflows. A strong background in Python and data tooling is essential for success in this role.