Senior Data Engineer (Databricks on Azure) - Remote

Devsu; Colombia; Remote; COP 90,000,000 - 150,000,000; Full time

Benefits offered by this job

Private health insurance

Remote-friendly culture

Continuous training

AI training resources

Paid time off

Job summary

Devsu is seeking a Data Engineer in Colombia to design, build, and operate scalable data pipelines for Tax tech platforms. You will work with Python, Spark, PySpark, and Databricks to deliver reliable, cloud‑native data solutions and improve processing workloads.

Join a remote‑friendly team that values collaboration, testing, CI/CD, and strong data quality practices while tackling production ETL/ELT challenges for US and LatAm clients.

Qualifications

• 3+ years of data engineering experience.
• Strong Python development experience.
• Strong Apache Spark and PySpark experience.
• Hands-on Databricks experience.
• Strong SQL and data modelling skills.
• Experience building, testing, deploying, and troubleshooting production ETL/ELT pipelines.
• Experience with Git-based source control and CI/CD pipelines.
• Experience consuming REST APIs for data ingestion, including auth, pagination, and error handling.
• Experience writing automated tests for data pipelines.
• Strong data quality, reliability, and best practices.

Responsibilities

• Design, build, and support scalable data pipelines using Python, Spark, PySpark, and Databricks.
• Modernize and migrate legacy data workloads to cloud-native platforms.
• Build and maintain batch data ingestion pipelines from structured and unstructured sources.
• Integrate data from REST APIs, SharePoint, documents, and cloud platforms.
• Implement data quality, monitoring, observability, and operational controls.
• Optimize data workloads for performance, scalability, reliability, and cost.
• Develop document extraction, classification, metadata enrichment, and automation pipelines.
• Apply software engineering practices including Git, CI/CD, automated testing, and code reviews.
• Build, deploy, troubleshoot, and maintain production ETL/ELT pipelines.
• Collaborate with architects, developers, tax SMEs, and platform teams.
• Analyze existing code for maintainability, security, and reliability.

Skills

Python

Apache Spark

PySpark

Databricks

SQL

Data modelling

Git CI/CD

REST APIs

Automated tests

Data quality

Collaboration

Job description

Devsu is seeking a Data Engineer in Colombia to design, build, and operate scalable data pipelines for Tax tech platforms. You will work with Python, Spark, PySpark, and Databricks to deliver reliable, cloud‑native data solutions and improve processing workloads.

Join a remote‑friendly team that values collaboration, testing, CI/CD, and strong data quality practices while tackling production ETL/ELT challenges for US and LatAm clients.