Senior Data Engineer

MPS Group LLC; Bogotá; Presencial; COP 120.000.000 - 180.000.000; Jornada completa

Descripción de la vacante

MPS Group LLC in Bogotá seeks a Senior Data Engineer to design, build, and maintain robust data pipelines that move, transform, and reliably integrate data across enterprise platforms and systems. You will develop scalable solutions to meet business needs and ensure data integrity.

You will work with Python, Snowflake, and Azure Synapse Analytics to extract, transform, and deliver data to downstream systems, collaborate with data analysts, business stakeholders, and technology teams to implement

Formación

• Proficiency in Python for data engineering tasks.
• Experience building robust ETL pipelines.
• Hands-on with Snowflake and Azure Synapse Analytics.
• Strong SQL skills and data transformation knowledge.
• Experience with Pandas, NumPy, or PySpark.
• Ability to work with data governance and quality controls.

Responsabilidades

• Design, build, and maintain data pipelines across enterprise platforms.
• Extract, transform, and load data using Python with Snowflake and Synapse.
• Collaborate with analytics and business teams to understand requirements.
• Monitor performance, troubleshoot bottlenecks, and ensure data quality.
• Document pipeline architecture and transformation rules.
• Ensure secure, compliant data transfer and integration.
• Stay current with data engineering best practices.

Conocimientos

Python

ETL pipelines

SQL

Data governance

Data quality

Collaboration

Large-scale data

Troubleshooting

Herramientas

Snowflake

Azure Synapse Analytics

Pandas

NumPy

PySpark

Descripción del empleo

We're seeking a Senior Data Engineer to design, build, and maintain data pipelines that enable reliable data movement and transformation across enterprise platforms. In this role, you will work with Python, Snowflake, and Azure Synapse Analytics to extract, transform, integrate, and deliver data to downstream systems. You'll collaborate with data analysts, business stakeholders, and technology teams to ensure scalable, secure, and high-quality data solutions that support business objectives.

Your Impact

• Design, develop, and maintain robust data pipelines using Python to extract data from Snowflake and Azure Synapse Analytics and transform it for target systems.
• Implement efficient ETL processes, ensuring accurate, reliable, and scalable data movement across platforms.
• Collaborate with stakeholders to understand source systems, target systems, and business requirements, translating them into effective data pipeline solutions.
• Write clean, optimized, and scalable code capable of processing large data volumes while maintaining performance and reliability.
• Monitor, troubleshoot, and optimize data pipeline performance, resolving bottlenecks, failures, and data quality issues.
• Define and implement data transformation logic, including cleansing, filtering, aggregation, normalization, and standardization of data.
• Develop data mapping and schema conversion processes to ensure consistency and compatibility between systems.
• Establish and maintain connectivity with Snowflake and Azure Synapse Analytics through APIs, database connectors, and other integration methods.
• Integrate and synchronize data from multiple sources while maintaining consistency, accuracy, and data integrity.
• Partner with IT and platform teams to implement secure data transfer mechanisms aligned with governance and compliance requirements.
• Develop error handling and exception management processes to ensure resilience and reliability across data integrations.
• Document pipeline architecture, transformation rules, source specifications, and target system requirements.
• Collaborate with cross-functional teams including data analysts, data scientists, and business stakeholders to support data-driven initiatives.
• Participate in planning discussions and technical reviews to align data engineering activities with business goals.
• Stay current with emerging technologies, tools, and best practices in data engineering and recommend process improvements where appropriate.

Skills & Experience

• Strong proficiency in Python programming.
• Experience building and maintaining data pipelines and ETL processes.
• Hands-on experience with Snowflake and Azure Synapse Analytics, including data extraction methods such as APIs and database connectors.
• Knowledge of data transformation techniques and tools.
• Experience using Python data processing libraries and frameworks, including Pandas, NumPy, and/or PySpark.
• Strong understanding of database systems and SQL querying.
• Experience with data integration and synchronization across multiple systems.
• Familiarity with data governance and compliance principles.
• Strong analytical and problem-solving skills.
• Excellent collaboration and communication abilities.
• High attention to detail and experience working with large-scale datasets.

Set Yourself Apart With

• Experience optimizing high-volume data processing workflows and pipeline performance.
• Strong understanding of schema mapping, data validation, and data quality controls.
• Experience implementing secure and compliant enterprise data transfer solutions.
• Ability to collaborate effectively across engineering, analytics, and business teams.
• Passion for continuous improvement and adoption of modern data engineering best practices.