Data Platform Engineer — AWS, PySpark & SQL

CI&T; Colombia; Presencial; COP 100.440.000 - 156.240.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Premium Healthcare

Meal voucher

Maternity and Parental leaves

Mobile services subsidy

Sick pay-Life insurance

CI&T University

Colombian Holidays

Paid Vacations

Descripción de la vacante

CI&T Colombia is seeking a talented Data Developer to design, build, and optimize scalable data pipelines and lake architectures that empower data-driven decision making across the organization.

The role emphasizes strong Python and PySpark coding, SQL mastery, and cloud expertise in AWS. You will work with AWS Glue, Athena, Redshift, and Delta Lake, collaborating with analysts and engineers to deliver reliable data solutions.

Formación

• Solid experience with ETL and data pipeline development in AWS
• Strong Python and PySpark coding for distributed data processing
• Thorough understanding of SQL (CTEs, window functions, aggregations) and migrating workloads to cloud analytics
• Hands-on with AWS Glue (Jobs, Catalog, Triggers, Workflows), Athena, and Redshift
• Data Lake architectures and partitioning strategies to optimize performance and cost
• OOP principles and reusable code libraries
• Git, shell scripts, and Linux environment familiarity
• Advanced/Fluent English

Responsabilidades

• Design, build, and maintain robust ETL/ELT processes for a modern Data Lake
• Develop and optimize PySpark workflows for large-scale datasets
• Implement partitioning strategies to balance performance and cost
• Translate complex SQL queries and modernize pipelines from legacy systems
• Collaborate with data analysts and engineers to deliver scalable data solutions
• Create technical documentation and participate in code reviews
• Stay current with cloud-native data engineering practices

Conocimientos

Python

PySpark

SQL

AWS

Git

Shell scripting

Linux

Data pipelines

Observability

OOP

English

Herramientas

AWS Glue

Athena

Redshift

Delta Lake

Apache Iceberg

CloudFormation

CDK

Terraform

Pandas

Descripción del empleo

CI&T Colombia is seeking a talented Data Developer to design, build, and optimize scalable data pipelines and lake architectures that empower data-driven decision making across the organization.

The role emphasizes strong Python and PySpark coding, SQL mastery, and cloud expertise in AWS. You will work with AWS Glue, Athena, Redshift, and Delta Lake, collaborating with analysts and engineers to deliver reliable data solutions.