Data Quality Engineer - Spark, Kafka & AWS (Hybrid Dallas)

Select Minds LLC; Dallas (TX); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

W2 Opportunity

Competitive salary

Opportunity for advancement

Job summary

Select Minds LLC is seeking a Data Quality Engineer to ensure the reliability and correctness of data pipelines. This hands-on role focuses on validating data across platforms like Databricks and AWS. Candidates must have 7+ years of experience, with specific expertise in data validation, SQL, Python, and streaming platforms like Kafka. The position offers a competitive salary and the opportunity for advancement in a hybrid work environment in Dallas, TX.

Qualifications

• 7+ years of total experience in QA, SDET, or Data Quality Engineering.
• Minimum 4–6 years of hands-on experience with data platforms.
• 3+ years of hands-on experience with Databricks and Apache Spark.
• Strong SQL skills for data validation.
• Proficiency in Python for automation.

Responsibilities

• Validate data pipelines for accuracy, completeness, consistency, and timeliness.
• Build SQL-based validations for business rules.
• Test pipelines built on AWS services.
• Validate data integrity and delivery guarantees in Kafka.
• Develop reusable validation utilities and synthetic datasets.

Skills

Data Quality Engineering

Validation Testing

Databricks

AWS

SQL

Python

Kafka

ETL/ELT

Apache Spark

Job description

Select Minds LLC is seeking a Data Quality Engineer to ensure the reliability and correctness of data pipelines. This hands-on role focuses on validating data across platforms like Databricks and AWS. Candidates must have 7+ years of experience, with specific expertise in data validation, SQL, Python, and streaming platforms like Kafka. The position offers a competitive salary and the opportunity for advancement in a hybrid work environment in Dallas, TX.