Senior Data Quality Engineer - Remote Work | REF#305333

BairesDev; Antioquia; Remote; COP 356,022,000 - 550,215,000; Full time

Benefits offered by this job

Remote work

Competitive USD pay

Flexible hours

Parental leave

Growth opportunities

Job summary

BairesDev is seeking a Senior Data Quality Engineer to build automated data quality validation for pipelines and data products within a Databricks lakehouse environment. Your work will guard data quality across evolving pipelines, detect schema drift, enforce completeness SLAs, and implement regression tests using Great Expectations or Deequ in a highly collaborative, 100% remote setting.

Join a globally distributed team delivering impact for top tech partners, with flexible hours and strong

Qualifications

• 5+ years of experience in data quality engineering.
• Strong experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.
• Advanced proficiency in English.

Responsibilities

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using frameworks such as Great Expectations or Deequ.

Skills

Data quality engineering

English proficiency

Tools

Databricks

Great Expectations

Deequ

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior Data Quality Engineer at BairesDev

In this role, you'll build automated data quality validation for pipelines and data products within a Databricks lakehouse environment. You'll ensure data quality issues are caught early through regression testing and modern validation frameworks. This is your opportunity to apply rigorous engineering discipline to data quality, building the automated guardrails that keep a lakehouse platform trustworthy.

What You'll Do

• Build automated data quality validation for pipelines and data products in Databricks.
• Detect schema drift across evolving data pipelines.
• Enforce completeness SLAs across critical data products.
• Implement regression testing using frameworks such as Great Expectations or Deequ.

What We Are Looking For

• 5+ years of experience in data quality engineering.
• Strong experience with data quality automation in a Databricks lakehouse environment.
• Proven experience building automated DQ validation for pipelines and data products.
• Experience with schema drift detection.
• Background implementing completeness SLAs.
• Experience with regression testing using Great Expectations or Deequ-style frameworks.
• Advanced proficiency in English.

Nice To Have

• Experience with BAU parity testing.
• Background building performance test harnesses.
• Familiarity with lineage or observability tooling.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!