Data Bricks Expert

eSolutionsFirst; Hyderabad; On-site; INR 4,500,000 - 7,000,000; Full time

Job summary

eSolutionsFirst in Hyderabad, India, is seeking a Senior Databricks Expert / Solution Engineer to design and implement scalable data engineering solutions on-site. The role focuses on Databricks, Delta Lake, and Lakehouse architectures across Azure, AWS, or Google Cloud.

You will lead ETL/ELT pipelines, optimize Spark-based workloads, and collaborate with stakeholders to deliver robust, secure data platforms while advancing CI/CD practices and operational documentation.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.

Responsibilities

• Design, develop, and maintain scalable data engineering solutions using Databricks.
• Build and optimize ETL/ELT pipelines using Apache Spark, PySpark, and SQL.
• Develop and manage Delta Lake architectures for reliable and efficient data processing.
• Collaborate with business stakeholders, data scientists, and application teams to understand requirements and deliver robust solutions.
• Design and implement Lakehouse architectures on cloud platforms such as Azure, AWS, or Google Cloud.
• Optimize Databricks workloads for performance, scalability, and cost efficiency.
• Implement data governance, security, and access controls.
• Troubleshoot production issues and provide technical support for data platforms.
• Develop CI/CD pipelines and automate deployment of Databricks assets.
• Create technical documentation, architecture diagrams, and operational procedures.
• Stay current with Databricks features, cloud services, and industry best practices.

Skills

Databricks

Apache Spark

PySpark

SQL

Python

Delta Lake

Unity Catalog

Azure

AWS

Google Cloud

Data Warehousing

Lakehouse Architecture

Git

CI/CD

Education

Bachelor's or Master's degree in Computer Science/Engineering/IT

Tools

GitHub Actions

Azure DevOps

Terraform

Job description

Hello ,

Greetings from eSolutionsFirst.

Job Description:

Mode: Work from Office 5 days

Job Title: Databricks Expert / Solution Engineer

Location: Hyderabad, India (100% On-site)

Employment Type: Full-time

Experience Level: Senior (10+ years)

Key Responsibilities:

• Design, develop, and maintain scalable data engineering solutions using Databricks.
• Build and optimize ETL/ELT pipelines using Apache Spark, PySpark, and SQL.
• Develop and manage Deta Lake architectures for reliable and efficient data processing.
• Collaborate with business stakeholders, data scientists, and application teams to understand requirements and deliver robust solutions.
• Design and implement Lakehouse architectures on cloud platforms such as Azure, AWS, or Google Cloud.
• Optimize Databricks workloads for performance, scalability, and cost efficiency.
• Implement data governance, security, and access controls.
• Troubleshoot production issues and provide technical support for data platforms.
• Develop CI/CD pipelines and automate deployment of Databricks assets.
• Create technical documentation, architecture diagrams, and operational procedures.
• Stay current with Databricks features, cloud services, and industry best practices.

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of experience in Data Engineering or Analytics Engineering.
• 5+ years of hands‑on experience with Databricks.
• Strong expertise in Apache Spark, PySpark, SQL, and Python.
• Experience with Delta Lake, Unity Catalog, and Databricks Workflows.
• Strong understanding of data warehousing and modern Lakehouse architecture.
• Experience working with Azure Databricks, AWS Databricks, or Google Cloud Databricks.
• Knowledge of data modeling, ETL/ELT processes, and performance optimization.
• Experience with Git, Azure DevOps, GitHub Actions, or similar CI/CD tools.
• Strong analytical, troubleshooting, and problem‑solving skills.
• Excellent verbal and written communication skills.

Preferred Qualifications:

• Databricks Certified Data Engineer Associate or Professional certification.
• Experience with Azure Data Factory, Azure Synapse, AWS Glue, or similar data integration tools.
• Knowledge of streaming technologies such as Structured Streaming or Apache Kafka.
• Familiarity with Infrastructure as Code tools such as Terraform.
• Experience working in Agile/Scrum environments.

Technical Skills:

• Databricks
• Apache Spark
• PySpark
• SQL
• Python
• Delta Lake
• Unity Catalog
• Azure, AWS, or Google Cloud
• Data Engineering
• ETL/ELT
• Git
• CI/CD
• Data Warehousing
• Lakehouse Architecture.