Senior Data Engineer (Databricks) - Remote Work | REF#303337

BairesDev; São Paulo; Presencial; BRL 614 000 - 922 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

100% remote

Competitive USD compensation

Home office setup provided

Flexible hours

Paid parental leaves & vacations

Mentorship & growth

Resumo da oferta

Senior Data Engineer (Databricks) at BairesDev is responsible for designing and optimizing robust data pipelines and models within lakehouse environments. You will ensure data assets are scalable, reliable, and accessible, acting as a technical anchor to drive analytics and operational excellence.

Join a global 100% remote team and work with Databricks, Apache Spark, Airflow, dbt, and SQL to deliver production-grade data products while upholding data governance and quality standards.

Qualificações

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands-on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics-ready datasets.
• Advanced proficiency in English.

Responsabilidades

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well-documented, and production-ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

Conhecimentos

Databricks

Apache Spark

Airflow

dbt

SQL

ETL/ELT

Data Modeling

Lakehouse

Data Pipelines

English

Ferramentas

Databricks

Apache Spark

Airflow

dbt

SQL

Descrição da oferta de emprego

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting‑edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Databricks) at BairesDev

As a Senior Data Engineer (Databricks), you will design and optimize robust data pipelines and models within lakehouse environments. You will ensure data assets are scalable, reliable, and accessible, acting as a technical anchor to drive analytics and operational excellence.

What You'll Do

• Architect and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark for high-throughput data processing.
• Design and implement durable data models and schemas within a Medallion Architecture (Bronze, Silver, Gold layers).
• Orchestrate complex data workflows and manage task dependencies using Airflow to ensure data freshness and reliability.
• Leverage dbt and SQL to transform raw datasets into clean, well‑documented, and production‑ready data products.
• Optimize pipeline performance and compute resource usage through effective partitioning, caching, and query tuning.
• Implement data quality checks and automated testing standards to ensure the integrity and governance of the data lakehouse.

What We Are Looking For

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in designing and optimizing data pipelines in Databricks lakehouse environments.
• Proficiency in orchestrating complex workflows using Apache Airflow.
• Hands‑on experience with data transformation and modeling using dbt and SQL.
• Strong background in building scalable and maintainable analytics‑ready datasets.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!