Data Engineer - Remote Work

BairesDev; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

100% remote work

USD compensation

Home office setup provided

Flexible hours

Paid parental leaves and vacation

Mentorship and growth opportunities

Job summary

BairesDev is seeking a Data Engineer to design and implement scalable data pipelines using AWS Glue or Databricks and to optimize Spark-based workflows for large data sets.

You will manage Delta Lake tables, ensure data integrity, and write modular Python code for ETL and automation while collaborating with cross-functional teams to translate business requirements into reliable data solutions. This role is 100% remote with competitive compensation in USD.

Qualifications

• 5+ years in Data Engineering.
• 3+ years with AWS Glue or Databricks.
• 3+ years with Spark.
• 2+ years with Delta Lake.
• 5+ years Python for ETL.

Responsibilities

• Design and implement scalable data pipelines using AWS Glue or Databricks.
• Develop and optimize distributed processes in Apache Spark for large data volumes.
• Manage Delta Lake tables with integrity, versioning, and schema evolution.
• Write clean, modular Python code for ETL and automation.
• Collaborate with cross-functional teams to translate business needs into data solutions.

Skills

AWS Glue

Databricks

Apache Spark

Python

Delta Lake

ETL pipelines

Observability

English proficiency

Tools

AWS

Databricks

Delta Lake tooling

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Data Engineer at BairesDev

What You'll Do:

• Design and implement scalable and secure data pipelines using AWS Glue or Databricks.
• Develop and optimize distributed processes in Apache Spark for large volumes of data.
• Manage and maintain Delta Lake tables, ensuring integrity, versioning, and schema evolution.
• Write and maintain clean, modular Python code for ETL and automation.
• Collaborate with cross-functional teams to translate business needs into reliable data solutions.

What we are looking for:

• 5+ years of total experience in Data Engineering.
• 3+ years of experience with AWS Glue or Databricks.
• 3+ years of experience with Spark.
• 2+ years of experience with Delta Lake.
• 5+ years of experience with Python for ETL and automation.
• Familiarity with monitoring, observability, and alerting in data pipelines.
• Advanced proficiency in English.

Nice to have:

• Experience with AWS.
• Familiarity with DataOps and DevOps workflows.
• Experience working with data cataloging and lineage tracking tools.
• Knowledge of SQL performance optimization.
• Exposure to event-driven architectures.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.