Senior Data Quality Engineer - Remote Work | REF#305333

BairesDev; Antioquia; Remote; COP 286,670,000 - 477,783,000; Full time

Benefits offered by this job

Remote work

USD pay option

Home setup provided

Flexible hours

Parental leave

Mentorship & growth

Diverse, multicultural team

Job summary

BairesDev is seeking a Senior Data Quality Engineer to build automated data quality validation for pipelines and data products in a Databricks lakehouse environment.

You will ensure data quality issues are caught early through regression testing and modern validation frameworks, applying rigorous engineering discipline to keep a trustworthy data platform.

This fully remote role offers international opportunities and a culture of mentorship and growth.

Qualifications

• 5+ years of experience in data quality engineering.
• Strong experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.
• Advanced proficiency in English.

Responsibilities

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using Great Expectations or Deequ.

Skills

5+ years experience

Databricks lakehouse

data quality automation

schema drift detection

completeness SLAs

regression testing

Great Expectations

Deequ

English proficiency

Tools

Databricks

Great Expectations

Deequ

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Quality Engineer at BairesDev

In this role, you'll build automated data quality validation for pipelines and data products within a Databricks lakehouse environment. You'll ensure data quality issues are caught early through regression testing and modern validation frameworks. This is your opportunity to apply rigorous engineering discipline to data quality, building the automated guardrails that keep a lakehouse platform trustworthy.

What You'll Do

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using frameworks such as Great Expectations or Deequ.

What We Are Looking For

• 5+ years of experience in data quality engineering.
• Strong experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.
• Advanced proficiency in English.

Nice To Have

• Experience with BAU parity testing.
• Background building performance test harnesses.
• Familiarity with lineage or observability tooling.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!