Senior Data Architect

Quantiphi; Bengaluru; On-site; INR 3,600,000 - 6,000,000; Full time

Job summary

Quantiphi in Bengaluru is seeking a Senior Architect - Data with 10+ years in technical, solutioning and analytical roles. You will lead data engagements on GCP cloud for data lakes, data migration, data warehouse and BI.

You will interface with IT and business stakeholders, design scalable data pipelines, ensure data quality, and work with tools like Spark, Dataflow, and Looker across cloud platforms.

Qualifications

• More than 10 years of experience in Technical, Solutioning, and Analytical roles.
• 5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and BI/AI solutions on Cloud GCP.
• Ability to translate business requirements into functional and non-functional areas, define boundaries for availability, scalability, performance, security, and resilience.
• Experience in architecting end-to-end data pipelines and integration for varied data sources and targets.
• Experience with distributed computing and enterprise environments like Hadoop and GCP.
• Proficiency with ETL technologies on Cloud and traditional tools like Informatica/DataStage/OWB/Talend.
• Deep knowledge of cloud and on-premise databases (Cloud SQL, BigQuery, Spanner, MySQL, Oracle, etc.).
• Exposure to No-SQL databases like MongoDB, Cassandra, etc.

Responsibilities

• Lead multiple data engagements on GCP Cloud for data lakes, data engineering, data migration, data warehouse and BI.
• Interface with IT and business stakeholders to understand data requirements.
• Take responsibility for delivery on schedule, quality, and customer satisfaction.
• Design and develop distributed, high-volume batch, real-time, and event processing systems.
• Implement data validation and monitoring to ensure production data accuracy and availability.

Skills

Data lakes

Data warehousing

Data integration

Cloud GCP

ETL

Hadoop

Distributed computing

Tools

Spark

Pyspark/Scala

Dataflow

DataProc

EMR

Informatica

DataStage

OWB

Talend

Looker

Job description

Role & Responsibilities:

• More than 10 years of experience in Technical, Solutioning, and Analytical roles.
• 5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on Cloud GCP
• Ability to understand business requirements, translate them into functional and non-functional areas,define non-functional boundaries in terms of Availability, Scalability, Performance, Security, Resilience etc.
• Experience in architecting, designing, and implementing end to end data pipelines and data integration solutions for varied structured and unstructured data sources and targets.
• Experience of having worked in distributed computing and enterprise environments like Hadoop, GCP Cloud.
• Well versed with various Data Integration, and ETL technologies on Cloud like Spark, Pyspark/Scala,Dataflow, DataProc, EMR, etc. on various Cloud.
• Experience of having worked with traditional ETL tools like Informatica/DataStage/OWB/Talend, etc.
• Deep knowledge of one or more Cloud and On-Premise Databases like Cloud SQL, Cloud Spanner, Big Table, RDS, Aurora, DynamoDB, Oracle, Teradata, MySQL, DB2, SQL Server, etc.
• Exposure to any of the No-SQL databases like MongodB, CouchDB, Cassandra, Graph dB, etc.

Senior Architect - Data

• Experience in architecting and designing scalable data warehouse solutions on cloud on Big Query or Redshift.
• Experience in having worked on one or more data integration, storage, and data pipeline tool sets like S3,
• Preferred experience of having worked on Machine Learning Frameworks like TensorFlow, Pytorch, etc.
• Good understanding of Cloud solutions for Iaas, PaaS, SaaS, Containers and Microservices Architecture and Design.
• Ability to compare products and tools across technology stacks on Google, AWS, and Azure Cloud.
• Good understanding of BI Reporting and Dashboarding and one or more tool sets associated with it like Looker.
• Understanding of Security features and Policies in one or more Cloud environments like GCP.
• Experience of having worked in business transformation projects for movement of On-Premise data solutions to Clouds like GCP.

Role:

• Lead multiple data engagements on GCP Cloud for data lakes, data engineering, data migration, data warehouse, and business intelligence.
• Interface with multiple stakeholders within IT and business to understand the data requirements.
• Take complete responsibility for the successful delivery of all allocated projects on the parameters of Schedule, Quality, and Customer Satisfaction.
• Responsible for design and development of distributed, high volume multi-thread batch, real-time, and event processing systems.
• Implement processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.