Azure Data Engineering Lead: Scale, Quality & Insight

SoftServe; Colombia; Presencial; COP 120.000.000 - 180.000.000; Jornada completa

Descripción de la vacante

SoftServe is seeking a Senior Data Engineer to design and deliver scalable data solutions in Azure. You will act as a technical reference for the team and work with clients and architects to translate business needs into reliable data solutions across the delivery lifecycle, focusing on data integration, performance and quality.

Responsibilities include building ETL pipelines, owning implementation, collaborating with architects, and guiding the team on best practices.

Formación

• 5+ years of experience in data engineering.
• Advanced proficiency in SQL and Python for data processing.
• Strong experience with Spark and PySpark for distributed processing.
• Hands-on experience with Azure data technologies and cloud platforms.
• Advanced proficiency with Azure Data Factory and/or Apache Airflow for orchestration.
• Knowledge of Data Architecture, Modeling, Quality and ETL performance.
• Ability to guide engineering teams and act as a technical reference.
• Excellent English communication for international clients.

Responsabilidades

• Design and develop scalable ETL and data integration pipelines across Azure data environments.
• Own technical implementation and ensure reliable, scalable data processing.
• Collaborate with clients, Solution Architects and engineering teams to translate requirements into data solutions.
• Build and optimize data processing workflows using SQL, Python, Spark, PySpark, Azure Data Factory, Airflow.
• Develop data models and schemas aligned with business requirements and downstream needs.
• Implement data quality and validation controls to ensure data integrity.
• Optimize SQL queries and ETL processes for performance and reliability.
• Guide the Data Engineering team on technical decisions and delivery.

Conocimientos

Data engineering

SQL

Python

Herramientas

Spark

PySpark

Azure Data Factory

Apache Airflow

Descripción del empleo

SoftServe is seeking a Senior Data Engineer to design and deliver scalable data solutions in Azure. You will act as a technical reference for the team and work with clients and architects to translate business needs into reliable data solutions across the delivery lifecycle, focusing on data integration, performance and quality.

Responsibilities include building ETL pipelines, owning implementation, collaborating with architects, and guiding the team on best practices.