Databricks Architect-AI and Data Solutions Engineer

Deloitte Development LLC; Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Deloitte Development LLC seeks an AI and Data Solutions Engineer to design, develop, and deploy enterprise-scale software pipelines. You will lead cross-functional teams, translate requirements into scalable data architectures, and ensure timely delivery of solutions.

Responsibilities include architecture design, automation, and mentoring of junior engineers, with a focus on Azure-based data platforms and analytics capabilities across multi-region environments.

Qualifications

• Experience designing and deploying enterprise-scale data/AI pipelines.
• Hands-on Azure cloud deployment and end-to-end BI solutions.
• Strong SQL, data warehousing, and governance knowledge.

Responsibilities

• Lead discussions with analysts to understand requirements and design solutions.
• Develop robust data pipelines and automate deployments across environments.
• Mentor junior team members and guide architectural decisions.

Skills

Azure

Data pipelines

ETL

Python

SQL

Azure Databricks

Azure Data Factory

PowerShell

Cloud strategy

Agile

Education

BE/B.Tech/M.C.A./M.Sc

Tools

Azure

Azure Databricks

Azure Data Factory

Azure Cosmos DB

Azure Synapse Analytics

Power BI

SQL Server/Azure SQL

Data Lake

ETL tools

Job description

Artificial Intelligence & Engineering

AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations.

Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical to businesses.

Level: AI and Data Solutions Engineer

As an AI and Data Solutions Engineer at Deloitte Consulting, you will design, develop, and deploy enterprise-scale software solutions, lead the creation of robust pipelines and manage code deployment across environments. You will collaborate with cross-functional, global teams to translate functional requirements into effective deliverables, independently guiding and mentoring junior team members. Your role spans the full project lifecycle, including estimation, planning, execution, and tracking key metrics for analysis, ensuring high-quality and timely delivery of solutions

Work you’ll do:

Lead discussions with business and functional analysts to understand requirements and assess integration impacts on business architecture. Prepare technical architecture and design, clarify requirements, and resolve ambiguities. Develop solutions in line with established technical designs, integration standards, and quality processes. Create and enforce technical design and development guides, templates, and standards. Facilitate daily scrum meetings, manage deliverables, and prepare weekly status reports for leadership review. Conduct detailed deliverable reviews and provide technical guidance to team members. Collaborate with onsite clients, coordinators, analysts, and cross-functional teams. Design templates or scripts to automate routine development or operational tasks.

The team:

AI & Data offers a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offering helps clients innovate, and enhance their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

AI & Data professionals will work with our clients to:

• Design and modernize large-scale data and analytics platforms including data management, governance and the integration of structured and unstructured data to generate insights leveraging cloud, edge and AI/ML technologies, platforms and methodologies for storage, processing
• Leverage automation, cognitive and AI based solutions to manage data, predict scenarios and prescribe actions
• Drive operational efficiency by managing and upgrading their data ecosystems and application platforms, utilizing analytics expertise and providing As-a-Service models to ensure continuous insights and enhancements.

Location: Bengaluru/Hyderabad/Pune/Chennai

Qualifications

Required:

• 6-9 years of experience in architecture, design, implementation, and/or support of highly distributed applications
• Hands on experience with Microsoft Azure and a strong understanding of Azure capabilities and limitations with demonstrated experience in end-to-end deployment of MS Azure BI solution(s)
• Experience in migrating physical or virtualized workloads to the cloud.
• Experience in defining highly available, DR solutions in Azure or any other cloud platform
• Experience in assessing applications for cloud adoption and define Cloud strategy for enterprise.
• Experience in using agile methodologies in implementing Azure solutions.
• Hands-on experience with Tools for system management, monitoring, automation, and agile development
• Experience in designing E2E ETL solutions and well versed with SQL, Data warehousing concepts
• Experience on implementing data lake with batch and streaming data using Unity Catalog and aware about governance across the same
• Design and develop robust, scalable solutions for collecting, analyzing large data sets, creating, and maintaining data pipelines, data structures and/or support of highly distributed applications
• Exposure to Microsoft Azure data platform, including Azure Data Factory (ADF),Azure Databricks, Azure Data Flow, Azure Cosmos DB, Azure Storage, Azure Synapse Analytics / erstwhile Azure Data Warehouse (SQLDW), Event Hubs, Stream Analytics, Data Lake Store, Data Lake Analytics, U-SQL, HDInsight, Azure Analysis Services, Azure Purview, Power Apps, Power BI and PowerShell Scripting
• Configure large database solutions in Azure using SQL Server / Azure SQL DWH / Synapse and optimize the existing or new solutions as and when needed for optimum performance.
• Build data lake from multiple data sources with ingestion, data governance and auditing capabilities
• Experience in any of Programming/Scripting languages - Bash, PySpark, Scala, Python, PowerShell, Ruby
• Experience in defining cloud strategy for enterprise for but not limited to migrating physical or virtualized workloads to the cloud.
• Intuitively identify a customer’s strategic business objectives and articulate the solution vision in both its business value context and a technical architecture that leverages Microsoft Azure.
• Lead architecture development focused on delivering strategic, value-driven, system designs
• Deliver solution architectures to execution teams, communicating their value, and ensuring implementation success
• Contribute to architecture and configuration management boards to ensure solutions are aligned with architecture and business objectives
• Define cloud architecture, design and implementation for hosting large, complex applications in Azure

Preferred:

• Experience in Cloud Computing (Public/Private/Hybrid) specifically on Cloud first application development
• Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
• Experience maintaining internet facing production-grade applications in virtualized environments in Cloud Platform.
• Certified Associate or Professional

Education:

• BE/B.Tech/M.C.A./M.Sc degree or equivalent from accredited university