Lead Data Engineer - Multi-Cloud Data Pipelines

Scotiatech Limited; Bogotá; In loco; COP 284.765.000 - 442.968.000; Tempo pieno

Descrizione del lavoro

Scociatech Limited in Bogotá seeks a Senior Data Engineer to design, build, and maintain scalable data products and pipelines across AWS, Azure, and GCP. You will lead a small team, drive data-driven decision making, and ensure robust, secure data infrastructure.

The role emphasizes governance, security, and performance, with collaboration across Data Scientists, Product Managers, and Software Engineers to deliver data solutions that advance business goals.

Competenze

• Bachelor’s degree in Computer Science, Data Engineering, IT, or related field.
• Master’s degree is an asset.

Mansioni

• Design, build, and optimize data pipelines and architectures on cloud platforms to support data products, ensuring scalability, reliability, and performance.
• Lead a team of up to three Data Engineers, providing mentorship, technical direction, and performance feedback.
• Collaborate with cross-functional teams to understand requirements and deliver data products that align with business goals.
• Implement best practices for data governance, security, and compliance within cloud environments.
• Monitor and maintain data infrastructure, ensuring high availability, data quality, and efficient processing.
• Drive the adoption of modern data engineering tools and methodologies, including ETL/ELT processes, data modeling, and orchestration.
• Troubleshoot and resolve complex data pipeline issues, ensuring minimal downtime and optimal performance.
• Contributes to the evaluation and integration of new cloud services and third-party tools to enhance data capabilities.

Conoscenze

Python

Java

Scala

SQL

Data modeling

CI/CD

Git

Terraform

Formazione

Bachelor’s degree in Computer Science or related field

Master’s degree preferred

Strumenti

Azure

AWS

GCP

Databricks

BigQuery

Dataflow

Dataproc

Pub/Sub

Cloud Composer

Git

Terraform

Descrizione del lavoro

Scociatech Limited in Bogotá seeks a Senior Data Engineer to design, build, and maintain scalable data products and pipelines across AWS, Azure, and GCP. You will lead a small team, drive data-driven decision making, and ensure robust, secure data infrastructure.

The role emphasizes governance, security, and performance, with collaboration across Data Scientists, Product Managers, and Software Engineers to deliver data solutions that advance business goals.