Senior Data Engineer (Databricks) - Remote Work | REF#302095

BairesDev; Minas Gerais; Remote; BRL 200,000 - 320,000; Full time

Benefits offered by this job

100% remote work

Competitive compensation in USD or|BRL

Hardware and software setup for home

Flexible hours

Paid parental leave, vacations & hols

Mentorship and growth opportunities

Diverse global team

Job summary

BairesDev is seeking a Senior Data Engineer (Databricks) to design and optimize robust data pipelines and models within lakehouse environments. You will ensure data assets are scalable, reliable, and accessible, serving analytics and operations.

You will architect ETL/ELT processes with Databricks and Spark, implement Medallion Architecture, orchestrate workflows with Airflow, and use dbt and SQL to create production-ready data products.

Qualifications

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable analytics-ready datasets.
• Advanced proficiency in English.

Responsibilities

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

Skills

Databricks

Apache Airflow

dbt

SQL

Data modeling

English proficiency

Tools

Apache Spark

Job description

At BairesDev® we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Databricks) at BairesDev

As a Senior Data Engineer (Databricks), you will design and optimize robust data pipelines and models within lakehouse environments. You will ensure data assets are scalable, reliable, and accessible, acting as a technical anchor to drive analytics and operational excellence.

What You'll Do

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

What We Are Looking For

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics-ready datasets.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!