Senior Data Engineer

AgileEngine, LLC; Brasil; Presencial; BRL 300 000 - 420 000; Tempo integral

Resumo da oferta

AgileEngine is seeking a Senior Data Engineer to architect and build an enterprise data platform on Snowflake and Azure. You will own the full stack from infrastructure provisioning to pipeline development, data modeling, governance, and observability.

You will implement CI/CD using GitHub Actions and enforce HIPAA-aligned data handling with robust RBAC and security practices.

Qualificações

• 4+ years of hands-on data engineering with full production-pipeline ownership.
• Snowflake administration and performance tuning expertise.
• Strong SQL and data modeling fundamentals (Kimball, SCD).
• Production experience with SQLMesh or DBT in warehouse-centric architecture.
• Ingesting data from REST APIs and SQL Server using Azure Data Factory and Azure Functions.
• Terraform for infrastructure provisioning with CI/CD using GitHub Actions/Azure DevOps.
• Ability to audit, take over, and operate an existing data platform.

Responsabilidades

• Develop and maintain scalable data pipelines from EHR/ERP/CRM sources into Snowflake via ADF, Event Hub, and ADLS Gen2.
• Build and optimize Bronze/Silver/Gold data models using SQLMesh.
• Provision platform resources end-to-end with Terraform, including Snowflake objects and Azure infra.
• Implement CI/CD pipelines with GitHub Actions for tests and multi-environment promotions.
• Enforce data governance, RBAC, and HIPAA-aligned data handling practices.
• Configure cloud networking, Private Endpoints, Private Link, and network security groups.
• Build observability with Datadog for pipeline health, data freshness, and lineage.
• Develop production-grade Python utilities for ingestion, quality, and integrations.
• Collaborate with analytics and business stakeholders using Agile practices.

Conhecimentos

SQL

Data modeling

Kimball methodology

SCD management

Python

REST APIs

SQLServer

HIPAA compliance

Analytics

Leadership

Ferramentas

Snowflake

Azure

Terraform

GitHub Actions

SQLMesh

DBT

Azure Data Factory

Azure Functions

ADLS Gen2

Datadog

Descrição da oferta de emprego

We are looking for a Senior Data Engineer to architect and build an enterprise data platform from the ground up on Snowflake and Azure, owning the full stack from infrastructure provisioning through pipeline development, data modeling, governance, and observability. You will build Bronze/Silver/Gold data models using SQLMesh, provision all platform resources with Terraform, implement CI/CD pipelines via GitHub Actions, and enforce HIPAA-aligned data handling and Snowflake RBAC standards. The role is a solo senior contributor position requiring high ownership and the ability to deliver production-grade platform without specialist support teams.

What you will do

• Develop and maintain scalable data pipelines ingesting from enterprise source systems (EHR, ERP, CRM, SaaS, PMS) into Snowflake using Azure Data Factory, Azure Event Hub, and ADLS Gen2.
• Build and optimize analytics-ready data models (Bronze/Silver/Gold layers) using SQLMesh.
• Provision and manage all platform infrastructure through Terraform, including Snowflake objects, Azure resources, networking components, and access controls, following infrastructure-as-code standards.
• Implement CI/CD pipelines using GitHub Actions for automated testing, environment promotion, and controlled multi-environment releases (dev/test/staging/production).
• Design and enforce data governance, security, and access control standards, including Snowflake RBAC, row-level security, column masking, and HIPAA-aligned data handling practices.
• Configure and maintain cloud networking and private connectivity, including Azure Private Endpoints, Private Link, Private DNS zones, managed identities, and network security groups.
• Build and operate platform-wide observability using Datadog or equivalent, covering pipeline health, data freshness, anomaly detection, alerting, and end-to-end data lineage.
• Write production-grade Python for ingestion utilities, data quality frameworks, and platform integrations, including reconciliation checks and automated tests that block bad data from reaching production.
• Apply Agile delivery practices including sprint planning, standups, and backlog refinement in collaboration with analytics and business stakeholders.
• Establish and document data engineering standards, reusable patterns, and best practices that scale with the platform and organization.
• Diagnose and resolve production issues across pipelines, infrastructure, networking, security, and platform services.

Must haves

• 4+ years of hands-on data engineering experience with full production pipeline ownership in a lean, high-ownership environment (you build it, you own it, you support it).
• Proven track record building and managing cloud data platforms, featuring deep expertise in Snowflake administration and performance tuning.
• Strong SQL and data modeling fundamentals, including Kimball methodology, dimensional design, and Slowly Changing Dimension (SCD) management.
• Production experience with SQLMesh or DBT operating in a warehouse-centric architecture.
• Hands-on experience ingesting data from REST APIs and SQL Server using Azure Data Factory (ADF) and Azure Functions.
• Hands-on experience using Terraform for infrastructure provisioning, paired with robust CI/CD experience using GitHub Actions, Azure DevOps, or equivalent.
• Proven ability to rapidly audit, take over, and operate an existing data platform built by a third-party vendor.

Nice to haves

• Experience with Power BI, including building or supporting semantic models and paginated reports.
• Healthcare domain knowledge, including familiarity with dental, medical, or HIPAA-regulated data environments.
• Experience with Azure VNet integration, including configuring virtual network peering, service endpoints, or VNet-injected resources.
• Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
• Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
• Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
• Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
• Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
• Well-being & support: access local well-being programs and people-focused support tailored to your location

Subscribe to get notified about new roles that match your skills and interests.

We designed our hiring process to be fast, transparent, and convenient — so you always know what to expect and can move through the steps without unnecessary delays.

After applying, keep an eye on your inbox — including your spam folder. Occasionally, emails from our hiring platform, LaunchPod, may land there.

1. Tell us about yourself

   Submit a short application form.

2. Pass a 30’- 60’ test

3. Record a short video

   Introduce yourself on video to fast-track your application process.

4. Meet our team

   Once you pass the video review, grab a spot on our calendar for a technical interview.

5. Get an offer

   Welcome to AgileEngine!

FAQ

Have any questions?

What is the work format andschedule?

What level of English isrequired?

Does AgileEngine provide workequipment?

What opportunities for professional growth do youoffer?

What does a typical team look like, and what tools do youuse?

If something doesn’t work or you have questions regarding your application process, drop us a line.