AWS Databricks Consultant - Pan India

Tech Mahindra; Hyderabad, Chennai District, Bengaluru; Hybrid; INR 1,200,000 - 2,400,000; Full time

Job summary

Tech Mahindra seeks an experienced AWS Databricks Consultant to join as a Technical Architect. The role demands 7-10 years in data engineering and analytics with a strong focus on Databricks and AWS.

You will lead architectural discussions, design scalable data solutions, and guide teams in implementing efficient ETL pipelines. You will collaborate with cross-functional groups, stay updated with cloud and analytics trends, and mentor junior staff on Databricks and AWS services.

Qualifications

• 7-10 years of experience in data engineering/analytics.
• Proven Databricks experience with Delta Lake and Spark.
• Strong AWS knowledge (S3, EC2, Lambda, Redshift).
• Proficient in Python, Scala, or SQL.
• Solid data modeling, warehousing, and governance basics.

Responsibilities

• Design and implement scalable data solutions on AWS and Databricks.
• Lead architecture discussions and guide development teams.
• Collaborate with cross-functional teams to gather requirements.
• Optimize data pipelines for cost and performance.
• Review code and ensure data engineering best practices.
• Mentor junior team members on Databricks and AWS.

Skills

Databricks

AWS

ETL design

Python/Scala/SQL

Data modeling

Cloud architecture

Leadership

Education

Bachelor’s degree in CS/IT

7-10 years data engineering/analytics

AWS/Databricks certifications

Tools

Delta Lake

Spark

Tableau/Power BI

Docker

Kubernetes

Job description

Job location - Pan India

Job Description

Job Title: AWS Databricks Consultant - Technical Architect

Location: PAN India

Years of Experience: 7-10 Years

Job Summary

We are seeking an experienced AWS Databricks Consultant to join our team as a Technical Architect. The ideal candidate will have 7-10 years of experience in data engineering and analytics, with a strong focus on Databricks and AWS technologies. This role requires a deep understanding of cloud architecture, data processing, and analytics solutions, as well as the ability to lead technical discussions and design scalable data solutions.

Responsibilities

• Design and implement data solutions using AWS and Databricks, ensuring scalability, reliability, and performance.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Lead architecture discussions and provide technical guidance to development teams.
• Optimize existing data pipelines and workflows for efficiency and cost-effectiveness.
• Conduct code reviews and ensure best practices in data engineering and analytics.
• Stay updated with the latest trends and technologies in cloud computing and data analytics.
• Provide training and mentorship to junior team members on Databricks and AWS services.

Mandatory Skills

• Proven experience with Databricks, including Delta Lake and Spark.
• Strong knowledge of AWS services, particularly S3, EC2, Lambda, and Redshift.
• Experience in designing and implementing ETL processes and data pipelines.
• Proficiency in programming languages such as Python, Scala, or SQL.
• Solid understanding of data modeling, data warehousing, and data governance principles.

Preferred Skills

• Experience with data visualization tools such as Tableau or Power BI.
• Familiarity with machine learning frameworks and libraries.
• Knowledge of containerization technologies like Docker and orchestration tools like Kubernetes.
• Experience with Agile methodologies and project management tools.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 7-10 years of experience in data engineering, analytics, or a related field.
• Relevant certifications in AWS and Databricks are a plus.
• Excellent communication and interpersonal skills.
• Strong problem-solving abilities and a proactive approach to challenges.