Remote Data Engineer: Scalable Pipelines & Spark Expert

BairesDev; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

100% remote work

USD compensation

Home office setup provided

Flexible hours

Paid parental leaves and vacation

Mentorship and growth opportunities

Job summary

BairesDev is seeking a Data Engineer to design and implement scalable data pipelines using AWS Glue or Databricks and to optimize Spark-based workflows for large data sets.

You will manage Delta Lake tables, ensure data integrity, and write modular Python code for ETL and automation while collaborating with cross-functional teams to translate business requirements into reliable data solutions. This role is 100% remote with competitive compensation in USD.

Qualifications

• 5+ years in Data Engineering.
• 3+ years with AWS Glue or Databricks.
• 3+ years with Spark.
• 2+ years with Delta Lake.
• 5+ years Python for ETL.

Responsibilities

• Design and implement scalable data pipelines using AWS Glue or Databricks.
• Develop and optimize distributed processes in Apache Spark for large data volumes.
• Manage Delta Lake tables with integrity, versioning, and schema evolution.
• Write clean, modular Python code for ETL and automation.
• Collaborate with cross-functional teams to translate business needs into data solutions.

Skills

AWS Glue

Databricks

Apache Spark

Python

Delta Lake

ETL pipelines

Observability

English proficiency

Tools

AWS

Databricks

Delta Lake tooling

Job description

BairesDev is seeking a Data Engineer to design and implement scalable data pipelines using AWS Glue or Databricks and to optimize Spark-based workflows for large data sets.

You will manage Delta Lake tables, ensure data integrity, and write modular Python code for ETL and automation while collaborating with cross-functional teams to translate business requirements into reliable data solutions. This role is 100% remote with competitive compensation in USD.