Data Quality Engineer: SQL, Python & Spark Specialist

Indsafri India Private Limited

South Africa

Remote

ZAR 480.000 - 720.000

Vollzeit

14 Tage+

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Indsafri India Private Limited seeks a Data Quality Engineer with 3-6 years of experience to ensure accuracy, completeness, and consistency across data assets. You will develop validation strategies, resolve quality issues, and contribute to a comprehensive data governance framework.

You will write SQL queries, use Python for automation, and work with Spark to validate large datasets. Collaboration with data engineers and stakeholders is essential to maintain data quality across enterprise

Qualifikationen

  • 3-6 years of experience in data quality, data analysis, or a related role.
  • Proficiency in SQL for data querying, analysis, and manipulation.
  • Strong programming skills in Python, including data analysis libraries.
  • Experience with data validation techniques and tools.
  • Familiarity with big data technologies like Spark.
  • Excellent analytical and problem-solving skills.
  • Strong attention to detail and commitment to data accuracy.
  • Effective communication and collaboration skills.

Aufgaben

  • Develop, implement, and maintain data quality checks and validation rules.
  • Analyze data to identify discrepancies, anomalies, and quality issues.
  • Collaborate with data engineers, analysts, and business stakeholders to understand data requirements and quality standards.
  • Write and execute SQL queries to profile, audit, and validate data.
  • Utilize Python for data manipulation, automation of data quality tasks, and development of data quality scripts.
  • Work with big data technologies such as Spark to process and validate large datasets.
  • Document data quality issues, root causes, and resolutions.
  • Monitor data quality metrics and report on the overall health of data.
  • Participate in data governance initiatives and contribute to the improvement of data management practices.

Kenntnisse

Analytical skills
Problem-solving
Communication
Collaboration
Attention to detail

Tools

SQL
Python
Spark
AWS
Azure
GCP
ETL tools
Data Cataloging

Jobbeschreibung

Indsafri India Private Limited seeks a Data Quality Engineer with 3-6 years of experience to ensure accuracy, completeness, and consistency across data assets. You will develop validation strategies, resolve quality issues, and contribute to a comprehensive data governance framework.

You will write SQL queries, use Python for automation, and work with Spark to validate large datasets. Collaboration with data engineers and stakeholders is essential to maintain data quality across enterprise

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Intermediate Data Quality Engineer
Intermediate Data Quality Engineer

Indsafri India Private Limited • Südafrika

Remote
ZAR 480.000 - 720.000
Senior Data QA & ETL Testing Specialist
Senior Data QA & ETL Testing Specialist

Indsafri India Private Limited • Südafrika

Hybrid
ZAR 600.000 - 900.000
Senior Data Quality & Validation Engineer
Senior Data Quality & Validation Engineer

Boardroom Appointments • Randburg

Vor Ort
ZAR 600.000 - 1.200.000
AI-Driven Data QA Engineer — ETL & BI Testing
AI-Driven Data QA Engineer — ETL & BI Testing

Indsafri • Südafrika

Hybrid
ZAR 900.000 - 1.300.000
Senior Data Engineer - Migration & Governance
Senior Data Engineer - Migration & Governance

Indsafri • Südafrika

Vor Ort
ZAR 700.000 - 1.200.000
Senior Data Engineer - AI-Driven Pipelines & AWS Lead
Senior Data Engineer - AI-Driven Pipelines & AWS Lead

Indsafri • Südafrika

Vor Ort
ZAR 900.000 - 1.500.000
Senior Data Migration Engineer - ETL & Data Quality
Senior Data Migration Engineer - ETL & Data Quality

Indsafri • Südafrika

Vor Ort
ZAR 650.000 - 1.100.000
Data Engineer: Cloud Pipelines & AI-Ready Data
Data Engineer: Cloud Pipelines & AI-Ready Data

Indsafri • Südafrika

Hybrid
ZAR 600.000 - 900.000
Senior Quality Assurance & AI-Enabled Testing
Senior Quality Assurance & AI-Enabled Testing

Indsafri • Südafrika

Vor Ort
ZAR 520.000 - 760.000
Senior Spark Engineer - Cloudera Data Platform
Senior Spark Engineer - Cloudera Data Platform

Indsafri India Private Limited • Südafrika

Remote
ZAR 1.200.000 - 1.800.000