Principal Architect- AWS Data

Quantiphi; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Quantiphi in Bengaluru is seeking a highly experienced Technical Leader to drive AWS Data Engineering strategy, architect scalable enterprise data solutions on AWS, and lead multi‑region data projects, ensuring performance, security, and governance.

You will mentor engineers, partner with sales and solution teams, design data lakes and data warehouses, optimize pipelines, automate tasks, and maintain data quality across the lifecycle.

Qualifications

• Bachelor's or Master's degree in Engineering or Technology (B.E./M.E./B.Tech/M.Tech).
• 15+ years of hands-on experience in Data space.
• At least 4 end-to-end implementations of large-scale data projects.
• Experience working on projects across multiple geographic regions.
• Extensive experience with AWS data services such as AWS Glue, Redshift, S3, Athena, EMR, Lambda, and RDS.
• Proficiency in SQL and Python for data processing and transformation.
• Strong understanding of data warehousing concepts, ETL/ELT processes and data modeling.

Responsibilities

• Act as a visionary leader capable of steering, motivating, and driving exceptional performance in data engagements.
• Conduct proof-of-concept projects to explore strategic opportunities and future-oriented data processing and integration capabilities.
• Make informed architectural decisions with the customer's needs and priorities at the forefront.
• Guide and mentor engineers, actively participating in code reviews to ensure high standards of code quality.
• Collaborate closely with the sales/pre‑sales/solution team to develop proposals and strategies that align with and meet performance objectives.
• Partner with the marketing team to create collateral and assist recruitment in expanding the practice.
• Design and implement data lakes, cloud data warehouses, master data management solutions, data models, and data quality assessments.
• Lead the development and management of data infrastructure, including tools, dashboards, queries, reports, and scripts.

Skills

Technical leadership

Data engineering

AWS data services

Python

SQL

Data modeling

ETL/ELT

Spark

Hadoop

Kafka

Education

Bachelor's or Master's degree in Engineering or Technology

Tools

AWS Glue

Redshift

S3

Athena

EMR

Lambda

RDS

PowerBI

Tableau

Job description

We are seeking a highly skilled and experienced Technical Leader for our AWS Data Engineering practice. The ideal candidate will be responsible for driving Data Engineering strategy for the practice, architecting scalable enterprise level data solutions and driving the implementation of data projects on AWS. This role requires a deep understanding of AWS services and data engineering best practices.

In this role, you will be responsible for establishing and enhancing the company's Data Engineering Services Practice. You will work closely with senior stakeholders to understand business needs and deliver technical solutions. The role is well-suited for a technically proficient individual looking to thrive in a dynamic and fast-paced environment.

Responsibilities

Technical Leadership

• Act as a visionary leader capable of steering, motivating, and driving exceptional performance in data engagements.
• Conduct proof-of-concept projects to explore strategic opportunities and future-oriented data processing and integration capabilities, aiming to recommend scalable, flexible, and sustainable solutions that offer a high return on investment.
• Make informed architectural decisions with the customer's needs and priorities at the forefront.
• Guide and mentor engineers, actively participating in code reviews to ensure high standards of code quality.
• Collaborate closely with the sales/pre‑sales/solution team to develop proposals and strategies that align with and meet the company's performance objectives.
• Partner with the marketing team to create collateral and assist recruitment teams in identifying and attracting the right talent to expand the practice.
• Design and implement data lakes, cloud data warehouses, master data management solutions, data models, and data quality assessments as part of the data engineering scope.
• Lead the development and management of data infrastructure, including tools, dashboards, queries, reports, and scripts, ensuring automation of recurring tasks while maintaining data quality and integrity.

Architecture and Design

• Design and architect scalable and robust data solutions using AWS services.
• Ensure data architecture aligns with business requirements and best practices.
• Evaluate and select appropriate AWS services for data storage, processing, and analytics.

Project Implementation

• Oversee the implementation of data engineering projects from inception to completion.
• Engage in strategic discussions with customers and offer thought leadership to guide their decisions.
• Ensure data quality, integrity, and security throughout the data lifecycle.

Technical Innovation

• Stay updated with the latest trends and advancements in data engineering and AWS technologies.
• Drive continuous improvement initiatives to enhance data engineering practices and processes.
• Experiment with new tools and technologies to improve data processing efficiency and effectiveness.

What is Required

• Bachelor's or Master's degree in Engineering or Technology (B.E. / M.E. / B.Tech / M.Tech)
• 15+ years of technical hands‑on experience in Data space.
• At least 4 end-to-end implementations of large-scale data projects
• Experience working on projects across multiple geographic regions
• Extensive experience with a variety of projects, including on‑premises to AWS migration, modernization, greenfield implementations and cloud‑to‑cloud migrations.
• Proficiency with AWS data services such as AWS Glue, Redshift, S3, Athena, EMR, Lambda, and RDS.
• Strong understanding of AWS architecture and best practices for data engineering.
• Proficiency with AWS IAM roles, policies, and permissions.
• Proficient in SQL and Python for data processing and transformation.
• Strong understanding of data warehousing concepts, ETL/ELT processes and data modeling.
• Experience with data integration from various sources including batch and real-time data streams.
• Familiarity with data serialization formats such as Avro, Parquet etc.
• Expertise in optimizing data pipelines and query performance.
• Experience with monitoring and troubleshooting data pipelines.
• Proficiency in performance tuning and optimization of distributed computing environments.
• Experience with data governance frameworks and practices.
• Understanding of data lifecycle management and data retention policies.
• Ability to implement and manage data quality frameworks and processes.
• Hands‑on experience with big data processing frameworks like Apache Spark, Hadoop, and Kafka.
• Knowledge of stream processing technologies and frameworks.
• Experience with data visualization tools such as PowerBI or Tableau.

What’s in it for you?

The experience of working in a category defining high growth startups in the transformational AI, Decision Science and Big Data Domain.

The opportunity of getting on boarded to the phenomenal growth journey and helping the customers take the next big leap in digital transformation.

The opportunity to work with a diverse, lively and proactive group of techies who are constantly raising the bar on the art of translating mounds of data into tangible business value for clients. Flexible working options available to foster productivity and work/life balance.