Data Engineer

AgileEngine; Brasil; Remote; BRL 658,000 - 878,000; Full time

Job summary

AgileEngine is seeking a Senior Data Engineer to own and operate a Snowflake-based data platform in a regulated healthcare environment. You will lead day-to-day operations, optimize production pipelines, and ensure data quality across RAW, CURATED, and CONSUMPTION layers.

You will work with Snowflake, dbt, Fivetran/HVR, S3, and Argo on Kubernetes, coordinating with Cloud/DevOps and analytics teams. Strong English, and Pacific Time availability are required.

Qualifications

• 5+ years of professional experience in Data Engineering or Data Platform Engineering.
• Strong hands-on Snowflake, including data-layer design, warehouse performance, access patterns, and production troubleshooting.
• Advanced SQL skills and strong experience with dbt for transformation, testing, documentation, lineage, and controlled deployment.
• Experience operating managed ingestion tools such as Fivetran or HVR and supporting custom data-ingestion pipelines.
• Hands-on experience with AWS data services, particularly S3 and event-driven or file-based ingestion patterns.
• Experience orchestrating and troubleshooting data workloads with Argo Workflows on Kubernetes, or comparable workflow-orchestration technologies.
• Proficiency in Python for data engineering, automation, and tooling.
• Strong understanding of data modeling, dependencies, schema evolution, backfills, data validation, and production data quality.
• Experience with observability, logging, alerting, and incident-management practices for production data platforms.
• Demonstrated ability to lead complex incident resolution and perform root-cause analysis.
• Ability to make well-reasoned technical decisions and guide cross-team improvements.
• Experience mentoring engineers and collaborating with Cloud/DevOps, Analytics, Security, Governance, and business stakeholders.
• Excellent written and verbal English communication; ability to work with client stakeholders.
• Full availability to work from 9:00 AM to 6:00 PM Pacific Time and participate in an on-call rotation.

Responsibilities

• Provide senior technical ownership for the Data Platform service tower during the LatAm coverage window, including day-to-day operations and escalation.
• Operate and improve Snowflake production and non-production environments, including warehouse config, monitoring, and deployment support.
• Administer data access with least-privilege and audit-ready practices.
• Operate and improve ingestion across Fivetran, HVR, and custom pipelines, including scheduling, onboarding, and backfills.
• Design, build, and maintain dbt models across RAW, CURATED, and CONSUMPTION layers with testing and CI/CD.
• Support AWS S3 data-lake operations, including lifecycle and access controls; coordinate with downstream Snowflake workloads.
• Coordinate with Cloud/DevOps for Argo Workflows/Kubernetes-hosted workloads, including deployment and troubleshooting.
• Define and improve data quality and observability standards (freshness, zero-row checks, schema drift).
• Expand monitoring and lineage using SYNQ, dbt, Snowflake audit data, Splunk, and alerting stack.
• Lead or support major data incidents, root-cause analysis, and preventive actions across ingestion and downstream Tableau dependencies.
• Support Tableau Cloud operations when upstream data/connectivity/refresh issues arise.
• Identify and deliver standardization, automation, and cost-improvements; migrate legacy patterns to golden paths.
• Execute work through incident, request, access, change, and release processes using iRhythm service-management workflows.
• Create runbooks, procedures, architecture context, and knowledge-transfer materials.
• Mentor mid-level engineers and ensure effective handoffs within a distributed team.
• Participate in Data Platform on-call rotation for critical incidents.

Skills

SQL

Snowflake

dbt

Python

Data Engineering

Data Modeling

Observability

Incident Management

Leadership

English Communication

Argo Workflows

Kubernetes

AWS

Tools

Fivetran

HVR

Argo Workflows

Job description

We are looking for a Senior Data Engineer to operate and improve a Snowflake-based enterprise data platform in a regulated healthcare environment.

The mandatory requirements are 5+ years of data engineering experience, strong hands-on Snowflake and dbt experience, hands-on AWS data services experience, experience orchestrating workloads with Argo Workflows on Kubernetes, and full availability to work Pacific Time hours.

What you will do

• Provide senior technical ownership for the Data Platform service tower during the LatAm coverage window, including day-to-day operations, complex troubleshooting, and L2/L3 escalation.
• Operate and improve Snowflake production and non-production environments, including warehouse configuration and sizing, performance and consumption monitoring, object lifecycle, environment hygiene, and support for production changes.
• Administer data access within established controls, including users, roles, service accounts, secrets, and credential rotation, while maintaining least-privilege and audit-ready practices.
• Operate and improve data ingestion across Fivetran, HVR where applicable, and custom pipelines, including connector configuration, scheduling, source onboarding, schema-change coordination, failure recovery, backfills, and dependency management.
• Design, build, and maintain reliable pipelines and dbt models across RAW, CURATED, and CONSUMPTION layers, with appropriate testing, documentation, lineage, version control, and CI/CD practices.
• Support AWS S3 data-lake operations, including raw and landing-zone workflows, lifecycle and retention controls, access patterns, logging, ingestion failures, and coordination with downstream Snowflake workloads.
• Support Argo Workflows and Kubernetes-hosted data workloads in close coordination with the Cloud / DevOps team, including scheduling, troubleshooting, deployment, recovery, and capacity dependencies.
• Define and improve data quality and observability standards, including freshness, zero-row, row-count growth, null, duplicate, schema-drift, and referential-integrity checks.
• Expand end-to-end monitoring and lineage using tools such as SYNQ, dbt, Snowflake audit data, Splunk, and the agreed alerting stack, linking actionable alerts to evidence and runbooks.
• Lead or support major data incidents, root-cause analysis, post-incident reviews, and preventive actions across ingestion, orchestration, Snowflake, and downstream Tableau dependencies.
• Support Tableau Cloud operations where upstream data, connectivity, permissions, extracts, or refresh failures require Data Platform investigation.
• Identify and deliver standardization, automation, reliability, performance, and cost improvements, including migration of suitable legacy or custom extraction patterns toward agreed golden paths.
• Execute work through controlled incident, request, access, change, and release processes using iRhythm's service-management workflows.
• Create and maintain runbooks, operating procedures, architecture context, ownership information, recovery procedures, and knowledge-transfer materials.
• Mentor Middle-level engineers, review technical work, improve team practices, and ensure effective handoffs across the distributed service team.
• Participate in the Data Platform on-call rotation for critical incidents outside staffed service hours.

Must haves

• 5+ years of professional experience in Data Engineering or Data Platform Engineering.
• Strong hands-on experience operating and developing solutions on Snowflake, including data-layer design, warehouse performance, access patterns, and production troubleshooting.
• Advanced SQL skills and strong experience with dbt for transformation, testing, documentation, lineage, and controlled deployment.
• Experience operating managed ingestion tools such as Fivetran or HVR and supporting custom data-ingestion pipelines.
• Hands-on experience with AWS data services, particularly S3 and event-driven or file-based ingestion patterns.
• Experience orchestrating and troubleshooting data workloads with Argo Workflows on Kubernetes, or comparable workflow-orchestration technologies.
• Proficiency in Python or a comparable language for data engineering, automation, and operational tooling.
• Strong understanding of data modeling, pipeline dependencies, schema evolution, backfills, data validation, and production data quality.
• Experience with observability, logging, alerting, and incident-management practices for production data platforms.
• Demonstrated ability to lead complex incident resolution, perform root-cause analysis, and convert findings into preventive improvements.
• Ability to make well-reasoned technical decisions, identify tradeoffs, estimate work, and guide improvements across a complex platform.
• Experience mentoring engineers and collaborating effectively with Cloud / DevOps, Analytics, Security, Governance, and business stakeholders.
• Strong written and verbal English communication skills, with the ability to work directly with client stakeholders.
• Full availability to work from 9:00 AM to 6:00 PM Pacific Time and participate in an agreed on-call rotation.

Nice to haves

• Hands-on experience with a data-specific observability platform.
• Experience supporting Tableau Cloud administration, data-source connectivity, extracts, scheduled refreshes, or production dashboard dependencies.
• Familiarity with Snowflake cost optimization, audit logging, tasks, stored procedures, and environment rationalization.
• Experience migrating legacy ingestion or orchestration patterns such as Boomi or AWS Data Pipeline to modern managed or Kubernetes-based solutions.
• Experience with Terraform, CI/CD pipelines, and Infrastructure as Code practices supporting data platforms.
• Experience with service-management and change-control tools such as Freshservice and Jira.
• Familiarity with HIPAA, GDPR, FDA-related controls, least-privilege access, separation of duties, and audit-ready operational practices.
• Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
• Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
• Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
• Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
• Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
• Well-being & support: access local well-being programs and people-focused support tailored to your location