Data Platform Engineer — AWS, PySpark & Lakehouse

CI; Colombia; A distancia; USD 90.000 - 150.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Premium Healthcare

Meal voucher

Maternity and Parental leaves

Mobile services subsidy

CI&T University

Paid Vacations

Descripción de la vacante

CI&T is seeking a Data Developer to design, build, and optimize scalable data pipelines and lake architectures that empower data-driven decisions.

You will work with cloud-native solutions across ingestion, transformation, storage optimization, and analytics enablement, using Python, PySpark, and AWS services to balance performance and cost, while ensuring data governance and reusable tooling.

Formación

• Strong experience building ETL/ELT pipelines and data workflows in AWS.
• Proficient in Python and PySpark for distributed data processing.
• Deep SQL knowledge with complex queries and workloads migration to cloud analytics.
• Hands-on AWS Glue, Athena, Redshift, S3, Lambda, and EventBridge.
• Understanding of Data Lake architectures and partitioning strategies.
• Experience with OOP and reusable libraries for data tooling.
• Familiarity with Git, Shell, Linux; observability practices.
• English Advanced/Fluent communication.

Responsabilidades

• Design, implement, and optimize ETL/ELT pipelines for modern Data Lake architectures.
• Develop distributed data processing workflows using Python and PySpark.
• Partition and optimize data lake storage to balance performance and cost.
• Migrate legacy pipelines to cloud-native analytics environments.
• Collaborate with DevOps to provision data resources using IaC tools.
• Monitor pipeline health and telemetry using CloudWatch and related tools.
• Contribute to data governance, metadata, and documentation.

Conocimientos

Python

PySpark

SQL

AWS

ETL/ELT

Data Lake

Git

Linux

Observability

English (Advanced)

Educación

Bachelor's degree in Computer Science, Data Engineering, or related field

Herramientas

AWS Glue

Athena

Redshift

Delta Lake / Apache Iceberg

Terraform / CloudFormation / CDK

Descripción del empleo

CI&T is seeking a Data Developer to design, build, and optimize scalable data pipelines and lake architectures that empower data-driven decisions.

You will work with cloud-native solutions across ingestion, transformation, storage optimization, and analytics enablement, using Python, PySpark, and AWS services to balance performance and cost, while ensuring data governance and reusable tooling.