Senior Data Engineer - Remote (Brazil/Colombia)

Fundacion Avanzar Fos; Santander; Remote; COP 120,000,000 - 180,000,000; Part time

Job summary

Insight Global is seeking a senior data engineer to design, build, and maintain production-grade batch and streaming pipelines using Databricks, Lakeflow Declarative Pipelines, and dbt. You will collaborate in sprint ceremonies and mentor junior engineers while driving data governance and CI/CD automation.

This is a 3-month contract with potential yearly extensions and remote work options in Brazil or Colombia.

Qualifications

• 7+ years of data engineering and architecture experience.
• Production experience with Databricks and lakehouse platforms.
• Strong Spark experience including PySpark and Spark SQL.
• Experience with batch and streaming pipelines.
• Experience with Lakeflow Declarative Pipelines.
• Strong Python programming and SQL skills.
• Cloud experience (AWS, Azure, GCP).
• Databricks Unity Catalog experience.
• Familiarity with Confluent Kafka and Fivetran.
• Immuta and data catalog tooling experience.

Responsibilities

• Design, build, and maintain production-grade batch and streaming pipelines.
• Partner with cross-functional stakeholders to deliver curated analytics-ready datasets and data models.
• Review pipeline designs and guide mid-level and junior engineers.
• Evaluate Databricks capabilities and recommend platform improvements.

Skills

Data engineering

Spark

SQL

Python

Databricks

Airflow

Cloud

Databricks Unity Catalog

Data modeling

Scala/Java

dbt

Fivetran

Immuta

Alation

Tools

Databricks

Lakeflow Declarative Pipelines

dbt

Apache Airflow

Fivetran

Immuta

Alation

Unity Catalog

Kafka

Job description

Insight Global is seeking a senior data engineer to design, build, and maintain production-grade batch and streaming pipelines using Databricks, Lakeflow Declarative Pipelines, and dbt. You will collaborate in sprint ceremonies and mentor junior engineers while driving data governance and CI/CD automation.

This is a 3-month contract with potential yearly extensions and remote work options in Brazil or Colombia.