Data Architect -RR

Quest Global; Bengaluru; On-site; INR 2,800,000 - 4,800,000; Full time

Job summary

Quest Global in Bengaluru is seeking a Data Architect to lead complex data projects, standardize data models, and collaborate with product managers and developers to ensure data products meet quality standards.

You will mentor junior analysts, design canonical data models, and validate data through end-to-end tests, with emphasis on data governance and scalable architectures in Azure environments.

Qualifications

• 10+ years in data management and/or data quality roles with at least 3+ years leading a data team
• Experience documenting, planning, designing and executing data engineering and data quality verification processes in complex Data Engineering & Analytics projects
• Strong experience with SQL, Python, PySpark for data analysis and data reconciliation, preferably in Azure Data Platform setup
• Experience in agile environments and managing small teams of data analysts/testers
• Familiarity with DevOps practices and modern data integration/engineering tools

Responsibilities

• Understand data product requirements and document data specifications including business rules for data acquisition, processing and presentation
• Design data architecture and canonical data models enabling data product/service standardization
• Collaborate with supplier teams to build and deliver the data products
• Design, build and execute data validation plans for complex data management solutions across traditional and modern processing frameworks
• Identify errors and communicate them to delivery teams to achieve data quality
• Understand data lineage and prepare data test cases to validate data during processing
• Collaborate with DevOps/Infra to build data quality regression suite
• Develop SQL/No-SQL/Python scripts for verification of data at ETL stages
• Mentor junior data analysts to achieve product delivery and data quality objectives
• Participate in Scrum meetings and provide testing feedback
• Collaborate with Product Manager to improve product testing through regression tests and UAT
• Own data product and quality strategy from requirements through test coverage to delivery with focus on quality and continuous improvement

Skills

Data quality

Leadership

Agile

Education

Degree in Mathematics/Computing/Engineering

Tools

SQL

Python

PySpark

Azure Data Platform

Azure DevOps

Job description

Data Architect

A Data Architect works in complex data projects with a focus on.

• Collating data requirements from data consumer teams, standardizing the data architecture and working with data supply teams to implement data products
• Building data product validation plans and executing them to ensure the delivery of quality data products

You will work with product managers, solution business analysts, data developers & testers, architects and data platform stakeholders to understand the customer business cases, their data needs and confirming the data product quality across multiple dimensions to support improved decision making for the customer.

Key Accountabilities

• Understand data product requirements and document data specifications including business rules for data acquisition, processing and presentation
• Design data architecture and canonical data models enabling data product/service standardization
• Collaborate with supplier teams to build and deliver the data products
• Design, build and execute data validation plans for complex data management solutions built on traditional and modern data processing frameworks.
• Identify errors, document & communicate them to delivery teams, and collaborate with them to achieve an acceptable data quality standard
• Understand the data lineage and prepare data test cases to validate the data during every stage of the data processing journey.
• Collaborate with DevOps and Infra team members to build data quality regression suite
• Develop database (SQL/No-SQL/Python) scripts for verification of data at extraction, transformation and loading phases by verifying the data mapping & transformation rules.
• Manage and mentor junior data analysts to achieve product delivery and data quality objectives
• Participate actively in Scrum meetings with the development team, Product Owner, Architects and Scrum Master and provide up-to-date testing feedback.
• Collaborate with Product Manager to improve product testing through regression testing and User Acceptance Test (UAT) processes.
• Responsible for overall data product and quality strategy for Data Management from requirement through test coverage planning to product delivery with relentless focus on quality and continuous improvement for compliance.

Key Experience And Qualifications

• Degree level education in Mathematics, Computing or Engineering discipline or equivalent experience.
• 10+ years of experience at various levels of Data management and/or data quality roles with at least 3+ years leading a data team
• Experience in documenting, planning, designing and executing data engineering and data quality verification processes in the context of complex Data Engineering & Analytics projects.
• Strong experience with SQL, Python, PySpark for data analysis, validation against product specification and data reconciliation, preferably in Azure Data Platform setup
• Experience of working in an agile environment, within a self-organizing team, managing small teams of data analysts and/or data testers

Desirable

• Experienced in DevOps methodology, preferably using Azure DevOps.
• Experience with modern data integration/engineering tools is a plus.
• Exposure to test methodologies and developing test plans using Microsoft based test tools like MTM, Azure Test Plans
• Exposure to planning non-functional testing in a large Data Processing environment including performance, load and integration testing