Senior Data Engineer

AgileEngine; Colombia; Híbrido; COP 376.530.000 - 564.794.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

Flextime

Descripción de la vacante

AgileEngine in Colombia seeks a Senior Data Engineer to architect and build an enterprise data platform on Snowflake and Azure, owning the full stack from infrastructure provisioning through pipeline development, data modeling, governance, and observability.

You will implement CI/CD pipelines with GitHub Actions, govern data with HIPAA-aligned practices, and deliver production-grade pipelines with minimal oversight in a high-ownership environment.

Formación

• 4+ years of hands-on data engineering experience with full production pipeline ownership.
• Deep expertise in Snowflake administration and performance tuning.
• Strong SQL and dimensional modeling fundamentals including SCD management.
• Production experience with SQLMesh or DBT in warehouse-centric architectures.
• Ingesting data from REST APIs and SQL Server using ADF and Azure Functions.
• Terraform for infrastructure provisioning and CI/CD with GitHub Actions.
• Ability to audit and operate existing data platforms built by third-party vendors.

Responsabilidades

• Architect and build an enterprise data platform on Snowflake and Azure from the ground up.
• Develop scalable data pipelines ingesting from EHR, ERP, CRM, and SaaS sources.
• Implement CI/CD pipelines for automated testing and multi-environment releases.
• Enforce HIPAA-aligned data handling, RBAC, and data governance standards.
• Build and maintain platform observability and data lineage.
• Write production-grade Python for ingestion utilities and data quality checks.

Conocimientos

Data engineering

SQL

Cloud data platforms

Kimball dimensional modeling

Ownership & delivery

Herramientas

Snowflake

SQLMesh/DBT

Terraform

Azure Data Factory

GitHub Actions

Azure DevOps

Datadog

Python

Descripción del empleo

We are looking for a Senior Data Engineer to architect and build an enterprise data platform from the ground up on Snowflake and Azure, owning the full stack from infrastructure provisioning through pipeline development, data modeling, governance, and observability. You will build Bronze/Silver/Gold data models using SQLMesh, provision all platform resources with Terraform, implement CI/CD pipelines via GitHub Actions, and enforce HIPAA-aligned data handling and Snowflake RBAC standards. The role is a solo senior contributor position requiring high ownership and the ability to deliver production-grade platform without specialist support teams.

What you will do

• Develop and maintain scalable data pipelines ingesting from enterprise source systems (EHR, ERP, CRM, SaaS, PMS) into Snowflake using Azure Data Factory, Azure Event Hub, and ADLS Gen2.
• Build and optimize analytics-ready data models (Bronze/Silver/Gold layers) using SQLMesh.
• Provision and manage all platform infrastructure through Terraform, including Snowflake objects, Azure resources, networking components, and access controls, following infrastructure-as-code standards.
• Implement CI/CD pipelines using GitHub Actions for automated testing, environment promotion, and controlled multi-environment releases (dev/test/staging/production).
• Design and enforce data governance, security, and access control standards, including Snowflake RBAC, row-level security, column masking, and HIPAA-aligned data handling practices.
• Configure and maintain cloud networking and private connectivity, including Azure Private Endpoints, Private Link, Private DNS zones, managed identities, and network security groups.
• Build and operate platform-wide observability using Datadog or equivalent, covering pipeline health, data freshness, anomaly detection, alerting, and end-to-end data lineage.
• Write production-grade Python for ingestion utilities, data quality frameworks, and platform integrations, including reconciliation checks and automated tests that block bad data from reaching production.
• Apply Agile delivery practices including sprint planning, standups, and backlog refinement in collaboration with analytics and business stakeholders.
• Establish and document data engineering standards, reusable patterns, and best practices that scale with the platform and organization.
• Diagnose and resolve production issues across pipelines, infrastructure, networking, security, and platform services.

Must haves

• 4+ years of hands-on data engineering experience with full production pipeline ownership in a lean, high-ownership environment (you build it, you own it, you support it).
• Proven track record building and managing cloud data platforms, featuring deep expertise in Snowflake administration and performance tuning.
• Strong SQL and data modeling fundamentals, including Kimball methodology, dimensional design, and Slowly Changing Dimension (SCD) management.
• Production experience with SQLMesh or DBT operating in a warehouse-centric architecture.
• Hands-on experience ingesting data from REST APIs and SQL Server using Azure Data Factory (ADF) and Azure Functions.
• Hands-on experience using Terraform for infrastructure provisioning, paired with robust CI/CD experience using GitHub Actions, Azure DevOps, or equivalent.
• Proven ability to rapidly audit, take over, and operate an existing data platform built by a third-party vendor.

Nice to haves

• Experience with Power BI, including building or supporting semantic models and paginated reports.
• Healthcare domain knowledge, including familiarity with dental, medical, or HIPAA-regulated data environments.
• Experience with Azure VNet integration, including configuring virtual network peering, service endpoints, or VNet-injected resources.

Perks and Benefits

• Professional growth

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps

• Competitive compensation

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities

• A selection of exciting projects

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands

• Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.