Senior Data Quality Engineer - Remote Work | REF#305339

BairesDev; Rio de Janeiro; Remote; BRL 602,000 - 903,000; Full time

Benefits offered by this job

100% remote work

Competitive USD pay or local currency

Flexible hours

Parental leave and vacations

Job summary

BairesDev is seeking a Senior Data Quality Engineer to design and implement automated validation for data pipelines and data products within a Databricks lakehouse. You will help catch quality issues early via regression testing and modern validation frameworks, ensuring lakehouse trustworthiness.

The role emphasizes data quality discipline, with opportunities to work on globally impactful projects across our remote teams and diverse tech stack at scale.

Qualifications

• 5+ years in data quality engineering.
• Strong experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.

Responsibilities

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using frameworks such as Great Expectations or Deequ.

Skills

5+ years exp

Databricks lakehouse

DQ automation

Schema drift detection

Completeness SLAs

Regression testing

English proficiency

Tools

Databricks

Great Expectations

Deequ

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Quality Engineer at BairesDev

In this role, you'll build automated data quality validation for pipelines and data products within a Databricks lakehouse environment. You'll ensure data quality issues are caught early through regression testing and modern validation frameworks. This is your opportunity to apply rigorous engineering discipline to data quality, building the automated guardrails that keep a lakehouse platform trustworthy.

What You'll Do

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using frameworks such as Great Expectations or Deequ.

What We Are Looking For

• 5+ years of experience in data quality engineering.
• Strong experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.
• Advanced proficiency in English.

Nice To Have

• Experience with BAU parity testing.
• Background building performance test harnesses.
• Familiarity with lineage or observability tooling.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!