Associate Architect - Data

Quantiphi; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading data solutions firm in Bengaluru is seeking an experienced data engineering professional to lead cloud-based data projects. The ideal candidate will have over 6 years of experience in data lakes and warehouses, with strong skills in GCP/AWS/Azure environments. Responsibilities include managing teams, interfacing with stakeholders, and ensuring high-quality project delivery. This is a full-time position offering a great opportunity to work on advanced data solutions.

Qualifications

• 6+ years of experience in relevant data engineering roles.
• Ability to manage data lakes and engineering projects.
• Experience with cloud data pipelines and integration.

Responsibilities

• Lead multiple data engagements on GCP for data lakes.
• Interface with stakeholders to understand data requirements.
• Ensure successful delivery of projects focusing on quality.
• Mentor team members and monitor their growth.

Skills

Data Lakes management

Data Warehousing

Data Integration

GCP/AWS/Azure

ETL technologies

Machine Learning Frameworks

BI Reporting and Dashboarding

Communication skills

Tools

Spark

Pyspark/Scala

Informatica/DataStage

BigQuery

Tableau

Job description

Role & Responsibilities

• 6+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on Google Cloud Platform
• Ability to understand business requirements, translate them into functional and non-functional areas, and define non-functional boundaries in terms of Availability, Scalability, Performance, Security, Resilience etc.
• Experience in architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied structured and unstructured data sources and targets.
• Experience of having worked in distributed computing and enterprise environments like Hadoop, GCP/AWS/Azure Cloud.
• Well-versed with various Data Integration, and ETL technologies on Cloud like Spark, Pyspark/Scala, Dataflow, DataProc, EMR, etc. on various Cloud.
• Experience of having worked with traditional ETL tools like Informatica/DataStage/OWB/Talend, etc.
• Deep knowledge of one or more Cloud and On-Premise Databases like Cloud SQL, Cloud Spanner, Big Table, RDS, Aurora, DynamoDB, Oracle, Teradata, MySQL, DB2, SQL Server, etc.
• Exposure to any of the No-SQL databases like Mongo dB, CouchDB, Cassandra, Graph dB, etc.
• Experience in architecting and designing scalable data warehouse solutions on cloud on Big Query or Redshift.
• Experience in having worked on one or more data integration, storage, and data pipeline toolsets like S3, Cloud Storage, Athena, Glue, Sqoop, Flume, Hive, Kafka, Pub-Sub, Kinesis, Dataflow, DataProc, Airflow, Composer, Spark SQL, Presto, EMRFS, etc.
• Preferred experience of having worked on Machine Learning Frameworks like TensorFlow, Pytorch, etc.
• Good understanding of Cloud solutions for IaaS, PaaS, SaaS, Containers and Microservices, Architecture and Design.
• Ability to compare products and tools across technology stacks on Google, AWS, and Azure Cloud.
• Good understanding of BI Reposting and Dashboarding and one or more toolsets associated with it like Looker, Tableau, Power BI, SAP BO, Cognos, Superset, etc.
• Understanding of Security features and Policies in one or more Cloud environments like GCP/AWS/Azure.
• Experience working in business transformation projects for the movement of On-Premise data solutions to Clouds like GCP/AWS/Azure.

Role

• Lead multiple data engagements on GCP Cloud for data lakes, data engineering, data migration, data warehouse, and business intelligence.
• Interface with multiple stakeholders within IT and business to understand the data requirements.
• Take complete responsibility for the successful delivery of all allocated projects on the parameters of Schedule, Quality, and Customer Satisfaction.
• Responsible for design and development of distributed, high volume multi-thread batch, real-time, and event processing systems.
• Implement processes and systems to validate data, and monitor data quality, ensure production data is always accurate and available for key stakeholders and business processes that depend on it.
• Work with the Pre-Sales team on RFPs, and RFIs and help them by creating solutions for data.
• Mentor Young Talent within the Team and define and track their growth parameters.
• Contribute to building Assets and Accelerators.

Other Skills

• Strong Communication and Articulation Skills.
• Should be a good team player.
• Good Analytical and Problem-solving skills.

Seniority level

• Associate

Employment type

• Full-time

Job function

• Information Technology