Senior Data Engineer — Remote US, Build Scalable Pipelines

Coderio; Sacramento (CA); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Coderio is seeking a Senior Data Engineer in the US to design, build, and maintain robust data pipelines and scalable infrastructure on our cloud platform. You will enable Data Products across their lifecycle, sourcing data via batch and stream processing while optimizing architecture and data quality.

You will partner with Data Scientists and ML Engineers to automate workflows and deploy resilient data pipelines in production.

Qualifications

• 5+ years of experience in Data Engineering, with a proven track record of designing and running large-scale data systems.
• Mastery of Python and advanced SQL (query optimization and performance tuning).
• Hands-on experience with AWS (Redshift, Glue, EMR, MWAA, S3) or GCP (BigQuery) and PySpark.
• Proficiency with UNIX environments, Docker, Git, and CI/CD pipelines.
• Solid understanding of data structures, batch/streaming processing, and MLOps or ML deployment lifecycle.
• Excellent verbal and written English communication skills.

Responsibilities

• Design, build, and deploy scalable, decoupled data pipelines for batch and streaming data ingestion into Data Lakes and Data Warehouses.
• Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL.
• Collaborate with Data Scientists and ML Engineers to build resilient pipelines and automate MLOps workflows.
• Monitor, troubleshoot, and optimize pipeline performance, costs, and storage across cloud platforms.
• Implement data quality frameworks and governance across raw and curated datasets.
• Apply MLOps and DevOps best practices, maintain CI/CD pipelines, and document architectures.

Skills

Python

PySpark

SQL

AWS

GCP

Data Modeling

UNIX/Linux

Docker

Git

CI/CD

MLOps

Tools

Terraform

CI/CD Tools

Job description

Coderio is seeking a Senior Data Engineer in the US to design, build, and maintain robust data pipelines and scalable infrastructure on our cloud platform. You will enable Data Products across their lifecycle, sourcing data via batch and stream processing while optimizing architecture and data quality.

You will partner with Data Scientists and ML Engineers to automate workflows and deploy resilient data pipelines in production.