Cloud Data Developer: Spark, SQL & AWS

CI&T Software S.A.; Colombia; A distancia; COP 18.000.000 - 32.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Maternity and Parental leaves

Mobile services subsidy

Sick pay-Life insurance

CI&T University

Colombian Holidays

Paid Vacations

Descripción de la vacante

CI&T Software S.A. is seeking a Data Developer to design, build, and optimize scalable data pipelines and lake architectures. You will work with AWS-native services and PySpark to unlock data-driven decision making across client engagements.

The role emphasizes Python, SQL, and cloud-native best practices, with responsibilities spanning ingestion, transformation, and governance in a modern Data Lake environment.

Formación

• Solid experience with ETL and data pipeline development in AWS
• Strong proficiency in Python as the primary language with PySpark for distributed processing
• Thorough understanding of SQL including complex queries and translating workloads from legacy RDBMS
• Hands-on experience with AWS Glue (Jobs, Catalog, Triggers, Workflows), Athena, and Redshift
• Understanding of Data Lake architectures and partitioning strategies to optimize performance and cost
• Familiarity with Git, Shell scripts, and Linux environments
• Knowledge of observability, monitoring, and metric tracking practices

Responsabilidades

• Design, build, and maintain ETL/ELT processes to ingest, transform, and deliver data across a modern Data Lake
• Develop and optimize distributed data processing workflows using Python and PySpark for large-scale datasets
• Implement and refine data lake partitioning strategies to balance query performance and storage costs
• Write and optimize complex SQL queries (CTEs, window functions, aggregations) and migrate pipelines to cloud-native analytics
• Collaborate with infrastructure and DevOps teams to provision data resources via IaC (CloudFormation, CDK, Terraform)
• Monitor data pipeline health with CloudWatch and other observability tools and improve reliability
• Support data catalog management and metadata governance practices
• Partner with analysts and stakeholders to translate requirements into scalable technical solutions

Conocimientos

Python

PySpark

SQL

AWS

Git

Shell scripting

Linux

Observability

Herramientas

AWS Glue

Athena

Redshift

CloudFormation

CDK

Terraform

Delta Lake

Apache Iceberg

Pandas

SageMaker

ECS

RDS

DynamoDB

IAM

EventBridge

Descripción del empleo

CI&T Software S.A. is seeking a Data Developer to design, build, and optimize scalable data pipelines and lake architectures. You will work with AWS-native services and PySpark to unlock data-driven decision making across client engagements.

The role emphasizes Python, SQL, and cloud-native best practices, with responsibilities spanning ingestion, transformation, and governance in a modern Data Lake environment.