Work From Home Senior Data Quality Engineer - Remote Work / Ref. 0071E

BairesDev; Brasil; Teletrabalho; BRL 461 000 - 666 000; Tempo integral

Resumo da oferta

BairesDev, a global remote-first technology company, seeks a Senior Data Quality Engineer to build automated data quality validation for pipelines and data products in a Databricks lakehouse. You will ensure data quality by catching issues early through regression testing and modern validation frameworks.

The ideal candidate has 5+ years in data quality engineering, with hands-on experience automating DQ in a Databricks environment, detecting schema drift, and enforcing completeness SLAs.

Qualificações

• 5+ years of experience in data quality engineering.
• Experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.
• Advanced proficiency in English.

Responsabilidades

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using frameworks such as Great Expectations or Deequ.

Conhecimentos

Data quality engineering

Schema drift detection

Regression testing

English language proficiency

Ferramentas

Databricks lakehouse

Great Expectations

Deequ

Descrição da oferta de emprego

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Quality Engineer - Remote Work at BairesDev

In this role, you'll build automated data quality validation for pipelines and data products within a Databricks lakehouse environment. You'll ensure data quality issues are caught early through regression testing and modern validation frameworks. This is your opportunity to apply rigorous engineering discipline to data quality, building the automated guardrails that keep a lakehouse platform trustworthy.

What You'll Do:

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using frameworks such as Great Expectations or Deequ.

What we are looking for:

• 5+ years of experience in data quality engineering.
• Strong experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.
• Advanced proficiency in English.

Nice to have:

• Experience with BAU parity testing.
• Background building performance test harnesses.
• Familiarity with lineage or observability tooling.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred.
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.