Data engineer in cloud-native platforms

Proxify; United States; Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Flexible monthly payments

8-hour client workdays

Up to 24 flex days off per year

Exclusive long-term remote roles

Consistent monthly pay via Proxify

Job summary

Proxify is seeking a Senior Data Engineer to design and optimize cloud-native data pipelines and data warehouses using AWS, Python, and modern ETL/ELT practices. You will work on scalable architectures supporting analytics, ML, and BI initiatives for clients.

The role requires 5+ years in data engineering, deep AWS service expertise, Snowflake/Redshift/BigQuery experience, and strong SQL. CET timezone alignment is preferred; remote opportunities available.

Qualifications

• 5+ years of professional experience in data engineering.
• Expert proficiency in Python for data manipulation, scripting, and pipeline development (Pandas, PySpark).
• Deep hands-on experience with the AWS cloud platform, specifically core data services (S3, Glue, Lambda, EMR).
• Proven experience with modern data warehouses (Snowflake, Redshift, BigQuery).
• Strong SQL skills and query optimization.
• Knowledge of containerization and orchestration (Docker, Kubernetes).
• Fluent English communication skills.
• Located in CET timezone (+/- 3 hours) or willingness to work with CET overlap.
• Nice to have: IaC with Terraform or CloudFormation; Airflow; Kafka/Kinesis/Flink; AWS certifications.

Responsibilities

• Architect, implement, and maintain scalable data pipelines (ETL/ELT) using Python and native AWS services to ingest data into data lakes and warehouses.
• Serve as SME for core AWS data services (S3, Glue, EMR, Kinesis/MSK, Redshift).
• Design robust data models (star/snowflake/data vault) for analytics and reporting.
• Perform performance tuning and query optimization on large datasets in cloud data warehouses.
• Implement IaC with Terraform or CloudFormation and integrate pipelines into CI/CD processes.
• Establish data quality monitoring, logging, alerting, and governance standards across the data platform.

Skills

Python

SQL

ETL/ELT design

Fluent English

Tools

AWS

Snowflake

Redshift

BigQuery

PySpark

Terraform

CloudFormation

Airflow

Docker

Kubernetes

Kafka

Kinesis

Flink

Job description

About the role

Talent has no borders. Proxify's mission is to connect top developers around the world with the opportunities they deserve. So, it doesn't matter where you are; we are here to help you fast-track your independent career in the right direction.

We are looking for a Senior Data Engineer specializing in modern, cloud-native data platforms, with a strong focus on Amazon Web Services (AWS) and Python. You will be responsible for designing, building, and optimizing highly scalable and reliable ETL/ELT pipelines and data warehouses that power analytics, machine learning, and business intelligence for our clients.

Responsibilities

• Architect, implement, and maintain scalable data pipelines (ETL/ELT) using Python and native AWS services to ingest data from various sources (APIs, databases, streaming services) into data lakes and warehouses.
• Serve as the subject matter expert for the core AWS data services, including S3, Glue, EMR, Kinesis/MSK, and Redshift or Amazon Aurora.
• Design robust and efficient data models (e.g., star schema, snowflake, data vault) for analytical and reporting needs.
• Perform performance tuning and query optimization on large datasets within cloud data warehouses to ensure fast data delivery.
• Implement infrastructure as code (IaC) using Terraform or CloudFormation, and integrate data pipelines into modern CI/CD processes.
• Establish data quality monitoring, logging, alerting, and governance standards across the data platform.

Requirements

• 5+ years of professional experience in data engineering
• Expert proficiency in Python for data manipulation, scripting, and pipeline development (e.g., Pandas, PySpark).
• Deep hands-on experience with the AWS cloud platform, specifically the core services used for data ingestion, storage, and processing (S3, Glue, Lambda, EMR).
• Proven experience working with modern data warehouses (Snowflake, Amazon Redshift, or Google BigQuery/Azure Synapse).
• Solid expertise in SQL and complex query writing/optimization.
• Strong understanding of containerization and orchestration concepts (Docker, Kubernetes).
• Fluent English communication skills.
• Located in CET timezone (+/- 3 hours), we are unable to consider applications from candidates in other time zones.
• Будет плюсом: Experience with Infrastructure as Code (Terraform or CloudFormation); Proficiency with a modern orchestration tool like Apache Airflow; Familiarity with data streaming technologies (Kafka, Kinesis, or Flink); AWS certifications

Benefits

• Enjoy on-time monthly payments with flexible withdrawal options.
• Enjoy a harmonious work-life balance with consistent 8-hour working days with clients.
• Enjoy up to 24 flex days off per year without losing pay, for full-time positions found through Proxify.
• Discover exclusive long-term remote positions at the world's most exciting companies.
• Enjoy the same pay, every month with positions landed through Proxify.