Data Engineer (Databricks) - Remote Work | REF#297218

BairesDev; Santiago; Remote; CLP 41,217,000 - 68,695,000; Full time

Benefits offered by this job

100% remote

Pay in USD or local currency

Home office setup

Flexible hours

Paid parental leave

Career growth

Job summary

BairesDev is seeking a Data Engineer (Databricks) to design and maintain scalable data pipelines within Databricks environments. You will connect raw data sources to analytics-ready datasets, applying lakehouse architectures to ensure data reliability.

You will work remotely with a diverse team, implement end-to-end ETL/ELT, build Bronze/Silver/Gold layers, and collaborate with data scientists to enable advanced analytics and ML workloads. Fluent English and 4+ years of experience required.

Qualifications

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in developing and optimizing data pipelines using Databricks and PySpark.
• Strong proficiency in SQL and experience with data warehousing concepts.
• Hands-on experience building and maintaining data lakehouse architectures.
• Deep understanding of ETL/ELT processes and large-scale data transformations.
• Advanced proficiency in English.

Responsibilities

• Design and implement end-to-end ETL pipelines using PySpark and SQL within the Databricks platform.
• Build and optimize data transformations following the Medallion Architecture to create high-quality Bronze, Silver, and Gold layers.
• Develop declarative pipelines and manage complex orchestration workflows to ensure reliable production deployments.
• Collaborate with data scientists and analysts to provide clean, structured data for advanced analytics and machine learning workloads.
• Ensure data integrity and performance through proactive monitoring, schema enforcement, and automated data quality checks.
• Maintain and scale lakehouse environments to handle diverse structured and unstructured datasets efficiently.

Skills

Databricks

PySpark

SQL

ETL/ELT

Data warehousing concepts

English proficiency

Tools

Databricks platform

PySpark

SQL

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Data Engineer (Databricks) at BairesDev

As a Data Engineer specializing in Databricks, you will develop and maintain scalable data pipelines and transformations within Databricks environments. You will act as a key link between raw data sources and analytics-ready datasets, leveraging lakehouse architectures to ensure data consistency and reliability.

What You'll Do

• Design and implement end-to-end ETL pipelines using PySpark and SQL within the Databricks platform.
• Build and optimize data transformations following the Medallion Architecture to create high-quality Bronze, Silver, and Gold layers.
• Develop declarative pipelines and manage complex orchestration workflows to ensure reliable production deployments.
• Collaborate with data scientists and analysts to provide clean, structured data for advanced analytics and machine learning workloads.
• Ensure data integrity and performance through proactive monitoring, schema enforcement, and automated data quality checks.
• Maintain and scale lakehouse environments to handle diverse structured and unstructured datasets efficiently.

What We Are Looking For

• 4+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in developing and optimizing data pipelines using Databricks and PySpark.
• Strong proficiency in SQL and experience with data warehousing concepts.
• Hands-on experience building and maintaining data lakehouse architectures.
• Deep understanding of ETL/ELT processes and large-scale data transformations.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!