Senior Data Quality Engineer - Pipelines & Analytics (Remote)

Capital-Technology-Group; Washington (District of Columbia); Hybrid; USD 75,000 - 110,000; Full time

Benefits offered by this job

Remote work options (hybrid)

Medical, dental & vision

Life Insurance

Short/Long-term disability

401(k) with 4% match

Generous PTO

Continued education budget

Wellness budget

Bonus incentives

Job summary

Capital Technology Group seeks a Quality Engineer to join a data engineering team supporting a program that manages financial and regulatory data. This role develops quality assurance strategies, testing methodologies, and automation that keep data accurate across pipelines and analytics platforms.

You will collaborate with Data Engineers, Data Scientists, Analysts, and stakeholders to translate requirements into quality controls, implementing automated tests with Python, PySpark, SQL, and

Qualifications

• Bachelor's degree in CS, IS, Engineering, or related field.
• 7+ years in software quality assurance, testing, or quality engineering.
• Strong Python programming and automated tests experience.
• Deep knowledge of data quality principles.
• Experience with SQL and relational databases.
• Experience testing data pipelines and ETL/ELT processes.
• Experience with Spark/PySpark.
• Familiarity with Airflow.
• Experience with AWS.
• Experience supporting Agile teams.
• Strong communication and problem-solving skills.

Responsibilities

• Develop and implement data quality strategies for data pipelines and datasets.
• Design and execute automated and manual tests covering data quality aspects.
• Build automated quality checks and integration tests using Python, PySpark, SQL, and Airflow.
• Validate data transformations across Spark, Python, AWS services.
• Develop reusable testing frameworks for CI/CD and data pipelines.
• Implement quality validation across raw to analytics-ready data.
• Investigate data anomalies and collaborate with Data Engineers to resolve.
• Conduct code/product reviews ensuring unit/integration/data quality tests.
• Monitor data quality metrics and support automated regression testing.
• Collaborate with Data Engineers, Scientists, Analysts, and stakeholders to translate requirements into quality controls.

Skills

Python programming

Analytical thinking

Communication skills

Team collaboration

Problem solving

Attention to detail

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Tools

PySpark

SQL

Apache Spark

Apache Airflow

AWS

dbt

Pytest

CI/CD

Data quality testing

Job description

Capital Technology Group seeks a Quality Engineer to join a data engineering team supporting a program that manages financial and regulatory data. This role develops quality assurance strategies, testing methodologies, and automation that keep data accurate across pipelines and analytics platforms.

You will collaborate with Data Engineers, Data Scientists, Analysts, and stakeholders to translate requirements into quality controls, implementing automated tests with Python, PySpark, SQL, and