Remote Data Quality Engineer (Contract)

PLATO; Stati Uniti; Remoto; USD 55.000 - 96.000; Tempo pieno

Descrizione del lavoro

PLATO is seeking an intermediate contract role focused on data quality and pipeline testing. You will help ensure data remains accurate, complete, and traceable as it moves through Bronze, Silver, and Gold layers, testing ingestion, transformations, and movement across cloud data platforms.

Responsibilities include validating data across layered environments, verifying mappings and processing modes, and collaborating with engineering and business teams to plan tests and report defects.

Competenze

• Experience testing data pipelines, ETL/ELT processes, warehouses, lakes, or lakehouses.
• Strong understanding of data validation, quality controls, and source-to-target mapping for structured and semi-structured data.
• Advanced SQL skills for analysis, reconciliation, and defect investigation.
• Working knowledge of Python and PySpark for data validation.
• Experience with Azure Databricks, ADLS, Azure Data Factory, Delta Lake, Kafka or Event Hub, and Azure DevOps.
• Strong analytical and troubleshooting skills, attention to detail, and familiarity with data profiling or quality tools.
• Current Secret-level security clearance at the time of application.

Mansioni

• Validate data ingestion, transformation, and movement across layered data environments.
• Check completeness, accuracy, conformity, lineage, business rules, and exception handling.
• Test ETL/ELT processes, warehouses, data lakes, and lakehouse solutions.
• Verify source-to-target mappings, schema updates, transformation logic, and batch, incremental, or CDC processing.
• Reconcile large data volumes and investigate defects using SQL and analysis tools.
• Work with engineering and business teams on quality needs, test planning, defect tracking, and reporting.

Conoscenze

Data pipelines

ETL testing

SQL

Python

PySpark

Data validation

Data profiling

Azure Databricks

ADLS

Azure Data Factory

Delta Lake

Kafka

Event Hub

Azure DevOps

Security clearance

Strumenti

Azure Databricks

ADLS

Azure Data Factory

Delta Lake

Kafka

Event Hub

Azure DevOps

Descrizione del lavoro

PLATO is seeking an intermediate contract role focused on data quality and pipeline testing. You will help ensure data remains accurate, complete, and traceable as it moves through Bronze, Silver, and Gold layers, testing ingestion, transformations, and movement across cloud data platforms.

Responsibilities include validating data across layered environments, verifying mappings and processing modes, and collaborating with engineering and business teams to plan tests and report defects.