Data Test Automation Engineer

JSG (Johnson Service Group, Inc.); Remote; USD 85,000 - 110,000; Full time

Job summary

A leading staffing agency is seeking a Data Test Automation Engineer to define and enhance the automated testing strategies for data ingestion and analytics. This fully remote role requires 5-7 years of experience and expertise in tools like Databricks, Azure Data Factory, SQL, and PySpark. Responsibilities include establishing test strategies, enhancing frameworks, and monitoring automation metrics. Join a dynamic team focused on quality and improvement.

Qualifications

• 5–7 years of experience in automation testing.
• Strong experience in PySpark/Python for test frameworks.
• Ability to establish and maintain test strategy.

Responsibilities

• Establish and maintain an automation test strategy for data ingestion pipelines.
• Enhance existing test automation framework.
• Monitor test automation metrics and improve the framework.
• Identify gaps and implement improvements.

Skills

Databricks (Data Engineering)

Azure Data Factory

Azure (Data Analytics)

SQL

Testing methodology

PySpark

Azure DevOps

Relational Database

Azure Test plans

Experience with building Hybrid/Data/Test driven Test Automation frameworks

Job description

Our client is seeking a Data Test Automation Engineer (5–7 years) responsible for defining and enhancing automated testing strategy and frameworks for data ingestion, analytics warehouses, and master data management platforms. (Remote, USA)

Must Have skills (Skills Needed)

• Databricks (Data Engineering)
• Azure Data Factory
• Azure (Data Analytics)
• SQL
• Testing methodology
• PySpark
• Azure DevOps
• Relational Database
• Azure Test plans
• Experince with building Hybrid/Data/Test driven Test Automation frameworks

Responsibilities

• Establish and maintain an automation test strategy for data ingestion pipelines, analytical warehouse validation, and master data management.
• Enhance the existing test automation framework using PySpark/Python, including regression suites and reusable utilities for generic test functions/methods.
• Monitor test automation metrics and continuously refine/improve the automation framework for quality, stability, and coverage.
• Identify framework gaps/shortcomings and implement improvements to address scalability, maintainability, and robustness.

Other information

• Primary platforms/tools: Databricks, Azure Data Factory, Azure Data Analytics services, SQL, PySpark, Azure DevOps, Azure Test Plans, relational databases.
• Experience: 5–7 years (overall).