Software Engineer (Data) - Remote Work

BairesDev; United States; Remote; USD 110,000 - 170,000; Full time

Benefits offered by this job

Remote work

USD payments

Home setup provided

Flexible hours

Paid parental leave

Mentorship & growth

Job summary

BairesDev is seeking a Software Engineer (Data) to design and maintain large-scale data pipelines powering data-driven insights across cloud environments. You will collaborate with engineering teams to optimize Spark-based workloads, implement Delta Lake or Iceberg storage, and orchestrate complex workflows with Airflow, while ensuring data quality and availability at scale.

This role requires 4+ years of data engineering experience and strong English skills.

Qualifications

• 4+ years of software engineering experience focusing on data engineering.
• Proven expertise building large-scale data pipelines with Python and SQL.
• Hands-on experience with Apache Spark and PySpark; knowledge of Spark internals.
• Experience with data lakehouse technologies like Delta Lake or Iceberg.
• Experience orchestrating data workflows with Airflow.
• Strong English communication skills.

Responsibilities

• Design and develop scalable data pipelines using Python and PySpark for large-scale processing.
• Optimize Spark jobs to improve performance and cost-efficiency.
• Implement robust data storage with Delta Lake or Iceberg for reliable data lakes.
• Orchestrate data workflows and dependencies using Airflow or similar tools.
• Design and execute SQL queries for data transformation and analysis across cloud environments.
• Collaborate with engineering teams to ensure data quality, integrity, and availability at scale.

Skills

Python

SQL

Apache Spark

PySpark

Spark internals

Delta Lake

Apache Iceberg

Airflow

English proficiency

Tools

Delta Lake

Apache Iceberg

Airflow

Spark internals

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Software Engineer (Data) at BairesDev

As a Software Engineer (Data), you will build and maintain large-scale batch and streaming pipelines to power data-driven insights. You will serve as the crucial link between raw data sources and production-ready analytics, ensuring the efficiency and reliability of complex data architectures.

What You'll Do:

• Design and develop scalable data pipelines using Python and PySpark for large-scale processing.
• Optimize Apache Spark jobs by deep-diving into internals to improve performance and cost-efficiency.
• Implement robust data storage solutions using Delta Lake or Iceberg for consistent and reliable data lakes.
• Orchestrate complex data workflows and dependencies using Airflow or similar automation tools.
• Design and execute efficient SQL queries for data transformation and analysis across cloud environments.
• Collaborate with engineering teams to ensure data quality, integrity, and availability at scale.

What we are looking for:

• 4+ years of experience in Software Engineering with a focus on data engineering.
• Proven expertise in building large-scale data pipelines using Python and SQL.
• Strong hands-on experience with Apache Spark, PySpark, and Spark internals.
• Proficiency in managing data lakehouse technologies like Delta Lake or Apache Iceberg.
• Experience with data orchestration tools such as Apache Airflow.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.