Data Engineer: Build Scalable Pipelines & Data Lakehouse

Sonatype Inc; Colombia; Remote; COP 60.000.000 - 120.000.000; Vollzeit

Benefits dieser Stelle

Parental leave

Diversity and Inclusion groups

Flexible working

Zusammenfassung

Sonatype is seeking a data engineer to build and maintain reliable data pipelines, develop analytics-ready data models, and ensure data quality across platforms. You will work with Spark, AWS services, and NoSQL stores while applying SQL and Python/Java/Scala skills across collaborative teams.

The role emphasizes CI/CD, documentation, and opportunities to influence our data lakehouse architecture and platform roadmap, in a cloud-first environment that values autonomy and learning.

Qualifikationen

• Bachelor's degree in Computer Science, Engineering, or related field.
• 2–4 years of experience in data engineering or backend data roles.
• Strong skills in Java, Scala, or another backend programming language.
• Python (PySpark/pandas) skills.
• Experience with SQL and distributed data systems (e.g., Spark, Kafka, SQS).
• Familiarity with NoSQL stores like Cassandra, HBase, or similar.
• Understanding of data modeling for analytics and reporting.
• Proficient in English with strong communication skills—able to explain or demo work to non-engineers.
• Self-driven — picks up new technologies and frameworks with little guidance.
• Debugs methodically; breaks complex problems into smaller steps.
• Open to feedback — iterates and improves through code reviews.
• Uses AI-assisted engineering tools (Claude Code, Codex, Cursor, etc.) as part of daily workflow.
• Reliable internet connection to sustain video, audio, and screen sharing.

Aufgaben

• Build and maintain reliable data pipelines and ETL/ELT workflows.
• Develop and optimize data models for analytics and internal tools.
• Work with team members to deliver clean, trusted datasets.
• Support core data platform tools like Spark and AWS (S3, SNS, SQS, ECS/Fargate, EMR).
• Monitor data pipelines for quality, performance, and reliability.
• Write clear documentation and contribute to test coverage and CI/CD processes.
• Help shape our data lakehouse architecture and platform roadmap.

Kenntnisse

Java

Scala

Python

SQL

Spark

Kafka

SQS

NoSQL

English

Communication

Problem-solving

Ausbildung

Bachelor's degree in Computer Science/Engineering or related field

Tools

dbt

Databricks

Terraform

CloudFormation

Jobbeschreibung

Sonatype is seeking a data engineer to build and maintain reliable data pipelines, develop analytics-ready data models, and ensure data quality across platforms. You will work with Spark, AWS services, and NoSQL stores while applying SQL and Python/Java/Scala skills across collaborative teams.

The role emphasizes CI/CD, documentation, and opportunities to influence our data lakehouse architecture and platform roadmap, in a cloud-first environment that values autonomy and learning.