Associate Technical Architect - Databricks Job

YASH Technologies, Inc.; Pune District; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

YASH Technologies, Inc. seeks an Associate Technical Architect specialized in Databricks to design, develop, and optimize scalable data pipelines in an AWS-based Lakehouse environment.

You will build modern data architectures leveraging Delta Lake, Iceberg, and Unity Catalog, while implementing data governance and security across enterprise datasets. You will lead ETL/ELT solutions using Python, PySpark, and SQL, and design GenAI-driven capabilities including RAG-based chatbots and AI agents.

Qualifications

• 10+ years of experience in data engineering, data architecture, or enterprise analytics.
• Proficient in Python, PySpark, and SQL.
• Hands-on experience with AWS analytics services (S3, Glue, Redshift) and lakehouse architectures.
• Experience with GenAI, RAG, semantic search, and AI agents.

Responsibilities

• Design, develop, and optimize scalable data pipelines on Databricks.
• Build and manage Lakehouse architectures using Delta Lake, Iceberg, and Unity Catalog.
• Implement data governance: data quality, lineage, metadata, security.
• Develop ETL/ELT solutions with Python, PySpark, and SQL.
• Design and deploy GenAI solutions, including RAG chatbots and AI agents.
• Implement Context Engineering and semantic search to improve AI outcomes.
• Collaborate with architects, data scientists, and stakeholders to deliver enterprise data solutions.
• Ensure platform scalability, performance, reliability, and cost optimization.

Skills

AWS Data Analytics

Python/PySpark/SQL

Data Engineering

GenAI & AI Agents

Tools

Databricks

Delta Lake

Unity Catalog

Job description

Select how often (in days) to receive an alert: Create Alert

Associate Technical Architect - Databricks Job

Date: Sep 26, 2026

Job Requisition Id: 66495

Location: Pune, IN

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hireDatabricks Professionals in the following areas :

• Design, develop, and optimize scalable data pipelines using AWS and Databricks.
• Build and manage modern Lakehouse architectures leveraging Delta Lake, Iceberg and Unity Catalog.
• Implement data governance capabilities including data quality, data lineage, metadata management, and data security.
• Develop ETL/ELT solutions using Python, PySpark, and SQL.
• Design and deploy GenAI solutions, including RAG-based chatbots and AI agents.
• Implement Context Engineering and semantic search frameworks to improve AI outcomes.
• Collaborate with architects, data scientists, and business stakeholders to deliver enterprise data solutions.
• Ensure platform scalability, performance, reliability, and cost optimization.

Key Skills

• AWS Data Analytics: S3, Glue, Athena, Redshift, Lake Formation, Lambda, DataZone, DynamoDB
• Programming: Python, PySpark, SQL
• Data Engineering: ETL/ELT, Data Modeling, Data Warehousing, Lakehouse Architecture, Medallion Architecture
• AI & GenAI: AWS Bedrock, SageMaker, RAG, Context Engineering, Semantic Search, AI Agents, LLM Orchestration

Experience: 10+ Years

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture