DataBricks Senior Programmer Analyst Exp 3 Yrs To 5 Yrs

Bilvantis Technologies; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Bilvantis Technologies in Hyderabad is seeking a Senior Programmer Analyst to design and implement Databricks-based data pipelines. The role requires hands-on data engineering, Spark (PySpark), and cloud platform experience to deliver scalable enterprise analytics.

You will collaborate with data scientists and business stakeholders, follow SDLC and Agile practices, and apply DevOps concepts to automate deployments with Terraform, Docker, and Kubernetes.

Qualifications

• 3 to 5 years of hands-on data engineering or cloud data platform delivery.
• Expert-level PySpark and strong SQL.
• Python skills for automation and data processing.
• Experience with Azure Data Factory/ADLS or AWS.
• Experience with Databricks Workflows, Delta Live Tables or Airflow.
• Terraform, Docker, and Kubernetes experience.
• Databricks Data Engineer certification.
• Bachelor's or Master's in CS/Engineering.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines using Databricks and Spark to support enterprise analytics.
• Transform, validate, and optimize large datasets using PySpark and advanced SQL.
• Implement and maintain Delta Lake and the lakehouse/medallion architecture (bronze, silver, gold layers).
• Work with data analysts, data scientists, and business stakeholders to define data requirements and deliver trusted datasets.
• Implement DevOps practices, version control (Git), and deployment automation for data pipelines.
• Apply access controls, data quality frameworks, and data governance using tools like Unity Catalog.

Skills

PySpark

SQL

Python

Cloud platforms

Databricks

Agile/SDLC

Communication

Team player

Proactive/Adaptive

Education

Bachelor's or Master's in CS/Engineering

Tools

Databricks

Spark

Airflow

Terraform

Docker

Kubernetes

Unity Catalog/Data governance

Job description

Job Description: DataBricks – Senior Programmer Analyst (Exp: 3+ Yrs to 5 Yrs)

We are seeking a talented and motivated DataBricks expert to join our team as a Senior Programmer Analyst.

Required Skills & Qualifications

• 3 to 5 years of hands-on experience in data engineering, software development, or cloud data platform delivery.
• Expert-level Apache Spark (PySpark) skills.
• Strong proficiency in SQL.
• Solid programming skills in Python for automation and data processing.
• Hands-on experience with a major cloud platform such as Microsoft Azure (Azure Data Factory, ADLS) or AWS.
• Experience with workflow orchestration tools like Databricks Workflows, Delta Live Tables (DLT), or Apache Airflow.
• Experience with Infrastructure-as-Code (Terraform).
• Experience with containerization tools (Docker / Kubernetes).
• Build and support Databricks data pipelines for enterprise analytics.
• Understanding of the SDLC and Agile methodologies.
• Communication with the customer and producing the daily status report.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• Databricks Certified Data Engineer Associate or Professional certification.
• Should have good oral and written communication.
• Should be a good team player and able to work with business stakeholders.
• Should be proactive and adaptive.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines using Databricks and Apache Spark to support enterprise analytics.
• Transform, validate, and optimize large datasets using PySpark and advanced SQL.
• Implement and maintain Delta Lake and the lakehouse/medallion architecture (bronze, silver, gold layers).
• Work with data analysts, data scientists, and business stakeholders to define data requirements and deliver trusted datasets.
• Implement DevOps practices, version control (Git), and deployment automation for data pipelines.
• Apply access controls, data quality frameworks, and data governance using tools like Unity Catalog.