Big Data Quality Engineer – ETL, Hadoop, SQL, Python

krg technology inc; Detroit (MI); On-site; USD 80,000 - 100,000; Full time

Job summary

A data solutions company in Detroit seeks a Test Development Engineer to create and maintain test plans, collaborating closely with data analysts and developers. The ideal candidate has over four years of experience in BI/DW, is proficient in SQL, PL/SQL, and has hands-on experience with Hadoop and its tools. This role also emphasizes writing and troubleshooting SQL queries, and implementing scalable automation processes. Join a dynamic team focused on quality and data integrity in an agile environment.

Qualifications

• Four or more years of test development experience in Business Intelligence or Data Warehousing.
• Hands-on experience with Hadoop and tools such as Hive, Sqoop, Pig, Impala, and Spark.
• Demonstrated experience implementing automation frameworks using scripting languages like Shell, Java, and Python.

Responsibilities

• Create test plans, test data, data validation SQL scripts and analyze test results.
• Setup and maintain test environments.
• Collaborate with Data Analysts, ETL developers, and other stakeholders on requirements and design.

Skills

Data analysis

Data migration

Business intelligence solutions

SQL

PL/SQL

ETL processes

Automation frameworks

Hadoop

Agile methodologies

Scripting languages

Tools

Informatica

SQL Server

Tableau

Jenkins CI

Hive

Sqoop

Pig

Impala

Spark

Python

Job description

A data solutions company in Detroit seeks a Test Development Engineer to create and maintain test plans, collaborating closely with data analysts and developers. The ideal candidate has over four years of experience in BI/DW, is proficient in SQL, PL/SQL, and has hands-on experience with Hadoop and its tools. This role also emphasizes writing and troubleshooting SQL queries, and implementing scalable automation processes. Join a dynamic team focused on quality and data integrity in an agile environment.