Data Quality & ETL Automation Engineer

Compunnel Inc.; Philadelphia (Philadelphia County); On-site; USD 90,000 - 120,000; Full time

Job summary

A leading tech company is seeking an Automation Engineer in Philadelphia to implement and improve data validation and quality assurance for modern data platforms. This position involves designing comprehensive data verification processes and automating data testing solutions. The ideal candidate has strong SQL and Python skills, along with experience in data lakes and pipelines. Join a collaborative team committed to continuous improvement in the banking industry.

Qualifications

• Strong SQL and Python skills focused on ETL/data testing.
• Experience with data lakes, warehouses, and pipelines.
• Exposure to Databricks, Snowflake, or PySpark.

Responsibilities

• Design and execute comprehensive data verification/validation.
• Implement automated data testing solutions using CI/CD.
• Explore new tools to improve data testing processes.

Skills

SQL

Python

ETL/Data Testing

Analytical Skills

Communication Skills

Time Management

Tools

Databricks

Snowflake

PySpark

Job description

A leading tech company is seeking an Automation Engineer in Philadelphia to implement and improve data validation and quality assurance for modern data platforms. This position involves designing comprehensive data verification processes and automating data testing solutions. The ideal candidate has strong SQL and Python skills, along with experience in data lakes and pipelines. Join a collaborative team committed to continuous improvement in the banking industry.