Senior Data Engineer (Databricks) - Remote Work | REF#308450

BairesDev; Rio de Janeiro; Remote; BRL 657,000 - 986,000; Full time

Benefits offered by this job

Remote work

Competitive salary

Hardware provided

Flexible hours

Parental leave

Vacation days

Global team

Job summary

BairesDev is seeking a Senior Data Engineer (Databricks) to design and optimize scalable data pipelines in lakehouse environments. You will serve as a technical anchor to drive analytics and operational excellence across our remote teams.

Responsibilities include building robust ETL/ELT pipelines, modeling data with a Medallion Architecture, and ensuring data quality through automated tests. English proficiency is required for global collaboration.

Qualifications

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics-ready datasets.
• Advanced proficiency in English.

Responsibilities

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

Skills

Databricks

Airflow

dbt

SQL

Data modeling

English

Tools

Apache Spark

dbt

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Databricks) at BairesDev

As a Senior Data Engineer (Databricks), you will design and optimize robust data pipelines and models within lakehouse environments. You will ensure data assets are scalable, reliable, and accessible, acting as a technical anchor to drive analytics and operational excellence.

What You'll Do

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

What We Are Looking For

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics-ready datasets.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!