Associate Architect - Data

Quantiphi; Bengaluru; On-site; INR 2,500,000 - 5,500,000; Full time

Job summary

Quantiphi is hiring for an Associate Architect - Data (Azure Cloud) to join our team in Mumbai, Bangalore, or Trivandrum. The role requires 6+ years of experience and hands-on expertise with Spark, PySpark, SQL, Python/Java/Scala, and cloud data platforms (Azure, Databricks, Synapse, Snowflake).

The candidate will design and implement data pipelines, modernize data solutions, and lead distributed ML workflows in a scalable environment.

Qualifications

• ],

Responsibilities

• Support data flow design planning and sizing.
• Assist Architects on Azure data transformations and modernization projects.
• Write production-quality code to deploy ML workflows.
• Design and build Azure data pipelines and streams across hybrid environments.
• Diagnose and troubleshoot distributed systems at scale; build terabyte-scale data ingest processes.
• Communicate with product owners, analysts, architects, and cloud vendors.
• Prepare design docs, specs, and test plans; manage tasks end-to-end.
• Coordinate testing and migration with business teams.

Skills

Spark/PySpark

SQL

Python

Java

Scala

Azure

Databricks

Architecture & design

Data Warehouse

Snowflake

Synapse

Azure DevOps

MLOps

Tools

Azure Data Factory

Databricks

Snowflake

Synapse

Azure DevOps

Job description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Job Description Role: Associate Architect - Data (Azure Cloud)

Experience Level: 6 + Years

Work location: Mumbai, Bangalore & Trivandrum

Notice Period : Looking for immediate joiners.

Role & Responsibilities

• Support the planning and implementation of data flow design, provide sizing and configuration assistance.
• Assisting the Solution Architects on programs for transformations and modernizations of data solutions using Azure cloud data technologies.
• Write production quality code to deploy ML workflows in a distributed environment.
• Design and Build Azure Data Pipelines and Data StreamsDesign and build a hybrid data solution using a combination of on-premise and in-cloud services.
• Diagnose and troubleshoot complex distributed systems problems and develop solutions with a significant impact on our massive scale.
• Build tools to ingest and process terabyte-scale data on a daily basis.
• Communicate with a wide set of teams, including product owners, business analysts, data and enterprise architects, platform engineers, and cloud vendors, etc.
• Compilation of detailed design documents, technical specification documents, and test plans as required.
• Independently manage development tasks as per technical specification documents, prod deployment,post-prod support, etc
• Managing support to Unit Testing, SIT & UAT.
• Coordinate with business and support teams on testing and migration activities.

Skills Expectation

• A strong hands-on knowledge of Spark/Pyspark.
• Expertise in writing SQL queries and performance optimization.
• Strong hands-on experience with a programming language like Python(preferred), java, or scala.
• Prior experience with working on cloud platforms like Azure(preferred) , AWS or GCP
• Azure cloud exposure is good to have, Databricks experience is a must have
• Architecture and solution design experience is required
• Data Warehouse: Snowflake or Synapse
• Design Dimensional Models for Data Warehouse and Data Marts.
• Knowledge of version control systems and build automation tools like Azure DevOps and/or MLOps
• Experience with operating system internals, file systems, disk/storage technologies, and storage Protocol

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!