Senior Data Engineer - Remote Cloud Data Pipelines

Eraytec; United States; Remote; USD 140,000 - 180,000; Full time

Job summary

Eraytec is urgently seeking a Senior Data Engineer to architect, build, and optimize large-scale data pipelines in a fully remote contract role. The candidate will lead the design and implementation of scalable cloud data solutions using Python, PySpark, SQL, and AWS services, collaborating with cross-functional teams to deliver enterprise-grade analytics.

The role requires deep expertise in distributed data systems, Airflow orchestration, and data governance to support BI and advanced analytics

Qualifications

• 6+ years in big data engineering, data platform development, and distributed data systems.
• Advanced Python for complex data processing, pipeline automation, and ETL operations.
• Proven PySpark experience for distributed data transformation and large-scale data cleansing.
• Strong SQL, data modeling, database indexing, and query optimization for big data workloads.
• Extensive experience with AWS data services: S3, Redshift, Lambda, EMR, Glue.
• Experience designing and managing Apache Airflow DAGs for automated workflows.
• Proven ability to work independently in a fully remote contract setting.

Responsibilities

• Design, build, scale, and maintain high-performance batch and real-time data pipelines using Python, PySpark, and AWS services.
• Develop complex distributed data transformations on Amazon EMR clusters.
• Write, tune, and optimize SQL queries and data models across large relational/analytical databases.
• Architect and manage cloud data lakehouse storage with S3, Glue Data Catalog, and Redshift.
• Implement and orchestrate automated, fault-tolerant DAGs with Apache Airflow.
• Deploy event-driven, serverless data ingestion pipelines using AWS Lambda.
• Identify and resolve performance bottlenecks and pipeline failures in distributed environments.
• Implement automated data validation and quality checks with comprehensive monitoring and alerts.

Skills

Python

PySpark

SQL

Airflow

AWS

Data modeling

ETL

Distributed systems

Tools

dbt

Delta Lake

Iceberg

Terraform

Docker

Job description

Eraytec is urgently seeking a Senior Data Engineer to architect, build, and optimize large-scale data pipelines in a fully remote contract role. The candidate will lead the design and implementation of scalable cloud data solutions using Python, PySpark, SQL, and AWS services, collaborating with cross-functional teams to deliver enterprise-grade analytics.

The role requires deep expertise in distributed data systems, Airflow orchestration, and data governance to support BI and advanced analytics