Senior Data Engineer - Remote (US) | Data Pipelines & ML

Coderio; New York (NY); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Coderio is seeking a Senior Data Engineer based in the United States to design, build, and maintain robust data pipelines and scalable infrastructure across our cloud platform. You will enable data products throughout their lifecycle, sourcing data via batch and stream processing, and collaborating with Data Scientists and ML Engineers to automate workflows.

As a US-based team member, you will work in a remote-friendly, hybrid environment with a focus on data quality, governance, and scalable

Qualifications

• 5+ years of experience in Data Engineering or a closely related field.
• Strong mastery of Python and advanced SQL (query optimization and performance tuning).
• Hands-on experience with AWS Redshift/EMR or GCP BigQuery and modern data processing engines (PySpark).
• Experience with UNIX environments, Docker, Git, and CI/CD pipelines.

Responsibilities

• Design, build, and deploy scalable data pipelines for batch and streaming data ingestion into Data Lakes and Data Warehouses.
• Develop and optimize ETL/ELT processes using Python, PySpark, and SQL.
• Collaborate with Data Scientists and ML Engineers to enable ML workflow automation and MLOps practices.
• Monitor, troubleshoot, and optimize pipeline performance, costs, and storage resources across cloud platforms.
• Implement data quality controls and governance across raw and curated datasets.
• Document data architectures and technical standards; uphold DevOps practices and containerization.

Skills

Python

PySpark

SQL

Data Modeling

Data Warehousing

REST APIs

Tools

Docker

Git

CI/CD

UNIX/Linux

Terraform

Job description

Coderio is seeking a Senior Data Engineer based in the United States to design, build, and maintain robust data pipelines and scalable infrastructure across our cloud platform. You will enable data products throughout their lifecycle, sourcing data via batch and stream processing, and collaborating with Data Scientists and ML Engineers to automate workflows.

As a US-based team member, you will work in a remote-friendly, hybrid environment with a focus on data quality, governance, and scalable