Data Engineer - Build Scalable Data Pipelines & Lakehouse

Sonatype; Bogotá; Vor Ort; COP 120.000.000 - 180.000.000; Vollzeit

Benefits dieser Stelle

Parental leave

Diversity and inclusion groups

Flexible working practices

Zusammenfassung

Sonatype is seeking a data engineer to build and optimize data pipelines, models, and analytics tools. You will work with Spark, AWS services, and distributed systems to ensure reliable, clean datasets and scalable data infrastructure.

The role emphasizes collaboration, documentation, and contributing to CI/CD processes while shaping the data lakehouse platform and roadmap at a cloud-first company.

Qualifikationen

• Bachelor's degree or equivalent practical experience in CS/Engineering or related field.

Aufgaben

• Build and maintain reliable data pipelines and ETL/ELT workflows.
• Develop and optimize data models for analytics and internal tools.
• Collaborate with team members to deliver clean, trusted datasets.
• Support core data platform tools like Spark and AWS services (S3, SNS, SQS, ECS/Fargate, EMR).
• Monitor data pipelines for quality, performance, and reliability.
• Write clear documentation and contribute to test coverage and CI/CD processes.
• Help shape our data lakehouse architecture and platform roadmap.

Kenntnisse

Java

Scala

Backend development

Python

PySpark

SQL

Distributed data systems

English communication

Self-driven

Debugging

Code reviews

AI-assisted tools

Internet reliability

Ausbildung

Bachelor's degree in Computer Science/Engineering or related

Tools

Spark

S3/SNS/SQS

ECS/Fargate

EMR

Kafka

Cassandra

HBase

Jobbeschreibung

Sonatype is seeking a data engineer to build and optimize data pipelines, models, and analytics tools. You will work with Spark, AWS services, and distributed systems to ensure reliable, clean datasets and scalable data infrastructure.

The role emphasizes collaboration, documentation, and contributing to CI/CD processes while shaping the data lakehouse platform and roadmap at a cloud-first company.