Databricks Engineer - INTL Brazil

Insight Global; Bezerros; Presencial; BRL 150 000 - 210 000; Tempo integral

Resumo da oferta

Insight Global is seeking a Data Engineer to build and operate the data platform powering Herself Health's analytics. You will own dbt models end to end—from source ingestion to marts that feed Databricks dashboards and payor reporting.

This hands-on role emphasizes production-grade data pipelines: versioned, tested, observable, and reversible, with CI/CD and a strong focus on data governance and PHI security.

Qualificações

• 3–6 years of professional data engineering or analytics engineering experience.
• 2+ years building and owning dbt projects in production.
• Strong SQL with window functions, complex joins, set operations and performance tuning on large datasets.
• Practical experience with Git and PR-based CI/CD, promoting data changes from development to production.
• Experience with CI platforms (CircleCI, GitHub Actions, GitLab CI or Azure DevOps) and configuring automated checks for dbt.
• Hands-on experience with a cloud lakehouse/warehouse (Databricks preferred; Snowflake/BigQuery ok).

Responsabilidades

• Build and operate the data platform powering BI dashboards and reports.
• Own dbt models end-to-end from ingestion through marts to consumption layers.
• Collaborate with analysts, clinicians, and finance stakeholders to ensure correct marts and timely insights.
• Maintain data quality, observability, and security, including PHI handling and governance.

Conhecimentos

Data engineering

SQL proficiency

Python programming

Documentation & mentoring

Data governance awareness

Ferramentas

Databricks (Unity Catalog, Delta)

dbt for transformation

Prefect

Git & PR-based CI/CD

CircleCI or GitHub Actions

Terraform

Docker

Postgres serving layer

Descrição da oferta de emprego

Job Description

We are looking for a Data Engineer to build and operate the data platform that Herself Health runs on. Reporting to the Director of Information Technology, you will own dbt models end to end — from source ingestion through the marts that power Databricks BI dashboards, payor reporting, quality measures, and risk adjustment analytics.

This role is hands‑on and delivery‑focused. You should already be productive in dbt and comfortable working the way a software team works: feature branch, pull request, automated tests and CI checks, review, then a controlled promotion through development, staging, and production. We are looking for someone who treats data pipelines as production software — versioned, tested, reviewed, observable, and reversible.

Our stack is Databricks (Unity Catalog, Delta), dbt for transformation, Prefect for orchestration, Bitbucket based CI/CD (CircleCI), and databricks and a custom reporting solution as the consumption layer. You will work alongside analysts who depend on your marts being correct, and clinical and finance stakeholders whose revenue and quality reporting depend on them being on time.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [e-mail] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• 3–6 years of professional data engineering or analytics engineering experience, with at least 2 years building and owning dbt projects in production
• Strong SQL, including window functions, complex joins, set operations, and query performance tuning on large datasets
• Demonstrated command of dbt beyond the basics: incremental strategies, materializations, snapshots, macros, packages, tests, and project structure and naming conventions
• Practical experience with Git and a pull‑request‑based CI/CD process, and a clear understanding of promoting data changes from development through staging to production
• Experience with a CI platform such as CircleCI, GitHub Actions, GitLab CI, or Azure DevOps, including configuring automated checks for a dbt project
• Hands‑on experience with a cloud lakehouse or warehouse — Databricks strongly preferred (Unity Catalog, Delta Lake, Spark SQL); Snowflake or BigQuery experience translates
• Proficiency in Python for ingestion, orchestration, and tooling
• Experience with a workflow orchestrator (Prefect, Airflow, Dagster, or Databricks Workflows)
• Working knowledge of dimensional modeling and when to depart from it
• Familiarity with data governance, access control, security, and HIPAA‑compliant handling of PHI
• Clear written communication — you can explain a modeling decision or an incident to both an engineer and a clinical operations leader
• Comfort working in a fast‑paced, ambiguous, and evolving environment with limited process scaffolding · Experience with Postgres as a serving layer, including indexing and query tuning
• Data quality and observability tooling (dbt artifacts‑based monitoring, Elementary, Monte Carlo, or similar)
• Infrastructure as code (Terraform) and containerization (Docker)
• Experience with identity resolution or master data management (EMPI or similar)
• Exposure to streaming or near‑real‑time ingestion patterns
• Experience mentoring analysts or junior engineers on SQL, dbt, and code review