DataBricks – Senior Programmer Analyst (Exp: 3+ Yrs to 5 Yrs)

Keka Inc.; Hyderabad; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

DataBricks in Hyderabad, India is seeking a Senior Programmer Analyst to design and build scalable data pipelines using Spark and Databricks. You will optimize large datasets with PySpark, implement Delta Lake architecture, and collaborate with data teams across the business.

The role requires 3–5 years of hands-on data engineering experience, strong communication, and familiarity with cloud platforms like Azure or AWS. A proactive team player and agile mindset are essential.

Qualifications

• 3–5 years hands-on experience in data engineering or cloud data platforms.
• Expert PySpark, strong SQL, and Python for automation.
• Experience with cloud platforms (Azure or AWS).
• Familiarity with Databricks Workflows and Delta Lake.
• Knowledge of IaC (Terraform) and containerization (Docker/Kubernetes).
• Excellent communication and stakeholder collaboration.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines with Databricks and Spark.
• Transform and optimize large datasets using PySpark and SQL.
• Implement Delta Lake and lakehouse architecture across layers (bronze-silver-gold).
• Collaborate with data analysts/scientists and business stakeholders to define data needs.
• Implement DevOps practices, Git versioning, and deployment automation for pipelines.
• Apply data governance and access controls using Unity Catalog.

Skills

Data engineering

Spark PySpark

SQL

Python

Azure

AWS

Databricks Workflows

Delta Lake

Airflow

Terraform

Docker

Kubernetes

Git + DevOps

Agile SDLC

Communication

Education

Bachelor's or Master's in CS/Engineering

Tools

Databricks

Git

Unity Catalog

Terraform

Docker

Kubernetes

Job description

DataBricks – Senior Programmer Analyst (Exp: 3+ Yrs to 5 Yrs)

3+ Yrs to 5 Yrs

Full-Time

Job Description: DataBricks – Senior Programmer Analyst (Exp: 3+ Yrs to 5 Yrs)

We are seeking a talented and motivated DataBricks expert to join our team as a Senior Programmer Analyst.

Required Skills & Qualifications:

• 3 to 5 years of hands‑on experience in data engineering, software development, or cloud data platform delivery.
• Expert-level Apache Spark (PySpark) skills.
• Strong proficiency in SQL.
• Solid programming skills in Python for automation and data processing.
• Hands‑on experience with a major cloud platform such as Microsoft Azure (Azure Data Factory, ADLS) or AWS.
• Experience with workflow orchestration tools like Databricks Workflows, Delta Live Tables (DLT), or Apache Airflow.
• Experience with Infrastructure-as-Code (Terraform).
• Experience with containerization tools (Docker / Kubernetes).
• Build and support Databricks data pipelines for enterprise analytics.
• Understanding of the SDLC and Agile methodologies.
• Communication with the customer and producing the daily status report.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• Databricks Certified Data Engineer Associate or Professional certification.
• Should have good oral and written communication.
• Should be a good team player and able to work with business stakeholders.
• Should be proactive and adaptive.

Key Responsibilities:

• Design, build, and maintain scalable ETL/ELT data pipelines using Databricks and Apache Spark to support enterprise analytics.
• Transform, validate, and optimize large datasets using PySpark and advanced SQL.
• Implement and maintain Delta Lake and the lakehouse/medallion architecture (bronze, silver, gold layers).
• Work with data analysts, data scientists, and business stakeholders to define data requirements and deliver trusted datasets.
• Implement DevOps practices, version control (Git), and deployment automation for data pipelines.
• Apply access controls, data quality frameworks, and data governance using tools like Unity Catalog.