Lead Data Engineer

AIDA Recruitment; Buenos Aires; Presencial; ARS 138 564 000 - 200 148 000; Tempo integral

Resumo da oferta

A Senior Data Engineer/Technical Lead role at AIDA Recruitment focuses on leading data engineering efforts to design and deliver scalable ETL pipelines in Azure-centric environments. You will translate complex business requirements into robust data solutions while guiding engineering teams and communicating with international clients in English.

You will own data models, workflow orchestration with Airflow, and performance optimization across Spark/PySpark pipelines, ensuring high data quality

Qualificações

• 5+ years of experience in Data Engineering, including ETL pipelines and data integration.
• Advanced proficiency in SQL for data processing and optimization.
• Strong experience with Spark/PySpark for distributed data processing.
• Hands-on experience with Azure data technologies and cloud platforms.
• Experience with data modeling and data quality controls.

Responsabilidades

• Design and develop scalable ETL and data integration pipelines across Azure environments.
• Own technical implementation and ensure reliable, scalable data processing.
• Collaborate with clients, architects, and engineering teams to translate requirements into data solutions.
• Build and optimize data processing workflows using SQL, Python, Spark, PySpark, Azure Data Factory, and Airflow.
• Develop data models aligned with business needs and downstream consumption.
• Implement data quality and validation controls to maintain data integrity.

Conhecimentos

SQL

Python

Data modeling

ETL development

Data integration

Data architecture

Data quality

English communication

Ferramentas

Spark/PySpark

Azure Data Factory

Azure Synapse

Apache Airflow

Descrição da oferta de emprego

We are looking for a Senior Data Engineer / Technical Lead with 5+ years of experience and strong hands-on expertise in SQL, Python, Spark/PySpark, and Azure (Azure Data Factory, Synapse, Apache Airflow).

The ideal candidate should have solid experience in ETL pipeline development, data integration, and data modeling, as well as the ability to provide technical guidance to engineering teams and communicate effectively with international clients in English.

Location: Brazil or Argentina.

REQUIREMENTS:

• 5+ years of experience in Data Engineering, including hands-on development of ETL pipelines and data integration solutions
• Advanced proficiency in SQL and Python for data processing, transformation, and optimization
• Strong experience with Spark and PySpark for distributed data processing
• Hands-on experience with Azure data technologies and cloud-based data platforms
• Advanced proficiency with Azure Synapse, Azure Data Factory and/or Apache Airflow for workflow orchestration and scheduling
• Strong understanding of Data Architecture, Data Modeling, Data Quality, Data Integration, and SQL and ETL performance optimization
• Proven ability to provide technical guidance to engineering teams and serve as a technical reference throughout project delivery
• Strong working proficiency in English for daily communication with international clients and teams
• Client-facing, communication, analytical, and problem-solving skills
• Exposure to Microsoft Fabric, Hadoop, Hive, Kafka, Power BI, or Tableau as a plus
• Experience with healthcare or pharmaceutical data environments as an advantageSelling PointsRESPONSIBILITIES

RESPONSIBILITIES

• Design and develop scalable ETL and data integration pipelines across Azure data environments
• Own technical implementation and solution quality, ensuring reliable, scalable, and maintainable data processing
• Collaborate with clients, Solution Architects, and engineering teams to translate business requirements into effective data solutions
• Build and optimize data processing workflows using SQL, Python, Spark, PySpark, Azure Data Factory, and Apache Airflow
• Develop data models and schemas aligned with business requirements, architecture standards, and downstream consumption needs
• Implement data quality and validation controls to maintain data integrity and consistency across platforms
• Optimize SQL queries, ETL processes, and data workflows to improve performance and reliability
• Guide the Data Engineering team on technical decisions, engineering practices, troubleshooting, and successful solution delivery

Team Description

In this role, you will design and deliver scalable data solutions within Azure environments while serving as a technical reference for the engineering team. Combining hands‑on Data Engineering with technical leadership, you will work closely with clients and architects to translate business needs into reliable solutions across the delivery lifecycle, with a focus on data integration, performance, and quality.

Interview Process

Approximately 2–3 stages, including a short AI‑led Q&A session focused on the candidate's experience, an interview with the project team, and a final interview with the end client.