Senior Data Engineer (Azure Databricks, Python) - Remote Work

BairesDev; Puebla de Zaragoza; Remote; MXN 1,282,000 - 2,015,000; Full time

Benefits offered by this job

100% remote

USD compensation

Hardware provided

Flexible hours

Paid parental leave

Job summary

BairesDev is hiring a Senior Data Engineer (Azure Databricks, Python) to design scalable data pipelines and robust ETL solutions with cloud data platforms. You will collaborate with regional stakeholders to translate analytics requirements into reliable data services across the enterprise.

The role calls for 5+ years in data engineering, deep Python and SQL expertise, Pandas, and hands-on experience with LLM APIs and prompt engineering.

Qualifications

• 5+ years of experience in Data Engineering, Python development, or a related field.
• Proven expertise in Azure Databricks, Python, and SQL for ETL delivery and data discovery.
• Hands-on experience with Pandas, LLM API integration, and prompt engineering.
• Fluency in Spanish for daily stakeholder interaction and independent client-facing communication.
• Advanced proficiency in English.

Responsibilities

• Design and implement scalable data pipelines and automated workflow orchestration to process large-scale datasets.
• Develop clean, optimized code for data discovery, ingestion, and transformation tasks.
• Integrate advanced model APIs and prompt engineering patterns to power downstream data-driven applications.
• Facilitate daily technical discussions and coordinate independently with cross-functional business stakeholders.
• Partner with compliance and architecture teams to enforce data governance standards and pipeline performance optimizations.

Skills

Data engineering

Python development

LLM API integration

Prompt engineering

Spanish fluency

English proficiency

Tools

Azure Databricks

Python

SQL

Pandas

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Azure Databricks, Python) at BairesDev

As a Senior Data Engineer, you will design and develop highly efficient data pipelines and ingestion frameworks using cloud data platforms. You will collaborate closely with regional stakeholders to translate analytical requirements into robust ETL solutions, ensuring data is accessible and reliable across the enterprise.

What You'll Do:

• - Design and implement scalable data pipelines and automated workflow orchestration to process large-scale datasets.
• - Develop clean, optimized code for data discovery, ingestion, and transformation tasks.
• - Integrate advanced model APIs and prompt engineering patterns to power downstream data-driven applications.
• - Facilitate daily technical discussions and coordinate independently with cross-functional business stakeholders.
• - Partner with compliance and architecture teams to enforce data governance standards and pipeline performance optimizations.

What we are looking for:

• - 5+ years of experience in Data Engineering, Python development, or a related field.
• - Proven expertise in Azure Databricks, Python, and SQL for ETL delivery and data discovery.
• - Hands-on experience with Pandas, LLM API integration, and prompt engineering.
• - Fluency in Spanish for daily stakeholder interaction and independent client-facing communication.
• - Advanced proficiency in English.

How we do make your work (and your life) easier:

• - 100% remote work (from anywhere).
• - Excellent compensation in USD or your local currency if preferred
• - Hardware and software setup for you to work from home.
• - Flexible hours: create your own schedule.
• - Paid parental leaves, vacations, and holidays.
• - Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• - Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.