Senior Data Engineer (Azure Databricks, Python) - Remote Work

BairesDev; Cajamarca; À distance; PEN 412 000 - 618 000; Plein temps

Avantages offerts par ce poste

Remote work 100%

Competitive USD/local compensation

Hardware provided for home office

Flexible hours

Mentorship and growth opportunities

Résumé du poste

BairesDev is seeking a Senior Data Engineer to design and build scalable data pipelines using Azure Databricks and Python. You will collaborate with regional stakeholders to translate analytics requirements into robust ETL solutions, ensuring reliable data access across the enterprise.

Responsibilities include developing optimized code for data discovery and ingestion, and integrating LLM APIs with prompt engineering.

Qualifications

• 5+ years of experience in Data Engineering, Python development, or a related field.
• Proven expertise in Azure Databricks, Python, and SQL for ETL delivery and data discovery.
• Hands-on experience with Pandas, LLM API integration, and prompt engineering.

Responsabilités

• Design and implement scalable data pipelines and automated workflow orchestration to process large-scale datasets.
• Develop clean, optimized code for data discovery, ingestion, and transformation tasks.
• Integrate advanced model APIs and prompt engineering patterns to power downstream data-driven applications.
• Facilitate daily technical discussions and coordinate independently with cross-functional business stakeholders.
• Partner with compliance and architecture teams to enforce data governance standards and pipeline performance optimizations.

Connaissances

Python development

Azure Databricks

SQL

Pandas

LLM API integration

Prompt engineering

Data engineering

Spanish fluency

English proficiency

Outils

Azure Databricks

Python

SQL

Pandas

LLM APIs

Prompt engineering

Description du poste

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Engineer (Azure Databricks, Python) at BairesDev

As a Senior Data Engineer, you will design and develop highly efficient data pipelines and ingestion frameworks using cloud data platforms. You will collaborate closely with regional stakeholders to translate analytical requirements into robust ETL solutions, ensuring data is accessible and reliable across the enterprise.

What You'll Do:

• - Design and implement scalable data pipelines and automated workflow orchestration to process large-scale datasets.
• - Develop clean, optimized code for data discovery, ingestion, and transformation tasks.
• - Integrate advanced model APIs and prompt engineering patterns to power downstream data-driven applications.
• - Facilitate daily technical discussions and coordinate independently with cross-functional business stakeholders.
• - Partner with compliance and architecture teams to enforce data governance standards and pipeline performance optimizations.

What we are looking for:

• - 5+ years of experience in Data Engineering, Python development, or a related field.
• - Proven expertise in Azure Databricks, Python, and SQL for ETL delivery and data discovery.
• - Hands-on experience with Pandas, LLM API integration, and prompt engineering.
• - Fluency in Spanish for daily stakeholder interaction and independent client-facing communication.
• - Advanced proficiency in English.

How we do make your work (and your life) easier:

• - 100% remote work (from anywhere).
• - Excellent compensation in USD or your local currency if preferred
• - Hardware and software setup for you to work from home.
• - Flexible hours: create your own schedule.
• - Paid parental leaves, vacations, and holidays.
• - Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• - Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.