Senior Data Platform QA Engineer: Validation & Automation

Millennium Global Technologies; Dallas (TX); On-site; USD 110,000 - 160,000; Full time

Job summary

Millennium Global Technologies seeks a seasoned Python-focused QA Automation Engineer to design and maintain scalable test automation for complex data platforms. You will build reusable frameworks, validate REST APIs, ETL/ELT pipelines, and cloud/kubernetes deployments, ensuring data quality and release readiness.

Collaborating with data consumers, platform engineers, and software teams, you will drive test strategies, mentor engineers, and embed automated quality gates into CI/CD pipelines

Qualifications

• Strong Python development experience and pytest-based testing.
• Experience with unit, integration, regression, and end-to-end tests.
• Proficiency in SQL data validation and data reconciliation.
• Hands-on with Apache Spark / PySpark.
• Experience with Airflow and workflow orchestration.
• Kubernetes and cloud-native platforms (AWS/Azure).
• Git, CI/CD, DevOps practices.
• Knowledge of data modeling, data warehousing, ETL/ELT.
• Ability to diagnose defects and perform root-cause analysis.
• Lead validation of cross-component changes and guide other QE engineers.

Responsibilities

• Design, develop, and maintain production-quality Python test automation.
• Create reusable frameworks, templates, and fixtures for validation.
• Lead unit, regression, integration, and end-to-end validation.
• Collaborate with data consumers and engineers to translate requirements into tests.
• Analyze defects, performance bottlenecks, and data quality issues.
• Validate cloud and Kubernetes configurations and recovery scenarios.
• Embed automated quality gates into CI/CD pipelines.
• Mentor Quality Engineers and contribute documentation.
• Apply AI-assisted tooling responsibly with human review.
• Deliver test strategies and evidence across releases.

Skills

Python programming

Testing frameworks

REST API testing

Data validation

SQL data validation

Spark / PySpark

Airflow

Kubernetes

Git / CI/CD

Observability & logging

Root-cause analysis

Tools

PySpark

Airflow

Kubernetes

Git

CI/CD tooling

Docker

Spark

Job description

Millennium Global Technologies seeks a seasoned Python-focused QA Automation Engineer to design and maintain scalable test automation for complex data platforms. You will build reusable frameworks, validate REST APIs, ETL/ELT pipelines, and cloud/kubernetes deployments, ensuring data quality and release readiness.

Collaborating with data consumers, platform engineers, and software teams, you will drive test strategies, mentor engineers, and embed automated quality gates into CI/CD pipelines