Databricks AWS Manager

Careernet; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Careernet Bengaluru is seeking an experienced Data Engineer/Architect to lead the architecture and delivery of enterprise data engineering solutions on Databricks and AWS. You will design scalable data platforms and analytical workloads across AWS environments, and mentor data engineering teams.

The role emphasizes collaboration with business owners to translate requirements into analytical plans and data-driven solutions, leveraging EC2, Lambda, Redshift, Athena, and S3.

Qualifications

• 10–15 years of relevant experience with Databricks on AWS and data architecture.
• Strong experience with Databricks, AWS cloud services, data engineering, Python, and SQL.
• Hands-on expertise with EC2, Lambda, Redshift, Athena, and S3.
• Experience designing scalable data architectures and analytical platforms on AWS.
• Ability to develop data solutions, analytical models, and root cause analyses based on business requirements.

Responsibilities

• Lead the architecture and delivery of enterprise data engineering solutions using Databricks and AWS.
• Design scalable data platforms, analytical workloads, and data processing services across AWS environments.
• Develop and review solutions using Amazon EC2, AWS Lambda, Amazon Redshift, Amazon Athena, and Amazon S3.
• Manage technical delivery, establish engineering standards, and mentor data engineering teams.
• Partner with business owners to define requirements, develop analytical plans, and deliver data-driven solutions for business problems.

Skills

Databricks on AWS

Python

AWS Lambda

Data Engineering

Amazon Redshift

ETL

SQL

Kafka

Data Modeling

Amazon Athena

AWS S3

AWS EC2

Education

Bachelor's or master's degree in Computer Science, Data Science, Engineering, Mathematics, Information Systems, or related technical discipline

Tools

Databricks

AWS

Amazon EC2

Amazon Redshift

Amazon Athena

Amazon S3

Kafka

Job description

Key Skills:

AWS Cloud, Python, AWS Lambda, Data Bricks, Data Engineering, Redshift, ETL, SQL, Kafka, Data Modeling, Athena, AWS S3

Roles & Responsibilities:

• Lead the architecture and delivery of enterprise data engineering solutions using Databricks and AWS.
• Design scalable data platforms, analytical workloads, and data processing services across AWS environments.
• Develop and review solutions using Amazon EC2, AWS Lambda, Amazon Redshift, Amazon Athena, and Amazon S3.
• Manage technical delivery, establish engineering standards, and mentor data engineering teams.
• Partner with business owners to define requirements, develop analytical plans, and deliver data-driven solutions for business problems.

Skills Required:

• 10 - 15 years of relevant experience, including substantial experience with Databricks on AWS and data architecture.
• Strong experience with Databricks, AWS cloud services, data engineering, Python, and SQL.
• Hands‑on expertise with Amazon EC2, AWS Lambda, Amazon Redshift, Amazon Athena, and Amazon S3.
• Experience designing scalable data architectures and analytical platforms on AWS.
• Ability to develop data solutions, analytical models, and root cause analyses based on business requirements.

Good to Have:

• Experience with ETL, Kafka, and data modeling.

Education:

• Bachelor's or master's degree in Computer Science, Data Science, Engineering, Mathematics, Information Systems, or a related technical discipline