Senior Database Administrator

Epsilon Data Management; Bengaluru; On-site; INR 3,000,000 - 4,200,000; Full time

Job summary

Epsilon Data Management is seeking an experienced Senior Databricks Engineer to design, implement, automate, and support enterprise-scale Databricks platforms across AWS, Azure, and GCP. You will focus on Databricks workspace management, Lakehouse architecture, cloud migrations, platform automation, governance, security, cost optimization, and operational excellence.

You will work closely with Data Engineering, Decision Science, Product Engineering, Cloud Infrastructure and Security teams to

Qualifications

• 6+ years IT experience with 3+ years in Databricks.
• Proficient with Spark, PySpark, SQL, and Delta Lake.
• Experience with AWS, Azure, and/or GCP.
• Strong Python scripting and automation.
• Knowledge of Unity Catalog and Workflows.
• Experience with Terraform and IaC.
• Hands-on CI/CD and Git deployments.
• Understanding of networking, SSO, SAML/OIDC, security concepts.
• Experience with PostgreSQL, SQL Server, Oracle or cloud-native DBs.
• Databricks certification a plus.

Responsibilities

• Own the design, deployment, administration, and lifecycle of enterprise Databricks workspaces across AWS/Azure/GCP.
• Enable secure connectivity and integration between Databricks and enterprise cloud platforms and databases.
• Lead migration of legacy data platforms to the Databricks Lakehouse architecture.
• Drive Infrastructure-as-Code, CI/CD, and operational automation.
• Implement enterprise-grade security, access controls, compliance, auditing, and data governance.
• Continuously optimize Databricks workloads, storage layouts, and compute resources.
• Establish proactive monitoring, incident management, troubleshooting, and reliability practices.
• Evaluate and implement Databricks AI, GenAI, and automation capabilities.
• Partner with architects, engineering teams, security teams, and business partners while mentoring engineers.

Skills

Databricks

Spark & PySpark

SQL & Delta Lake

Unity Catalog

Python scripting

Terraform

CI/CD pipelines

Git deployments

Security concepts

Education

Bachelor's degree in a related field

Tools

Terraform

Git

Job description

Job Summary

Overview About Business Unit: A consolidated team of database technology professionals, we deliver expert insights across all major database engines and Big Data solutions to support Epsilon products and platforms. The team has a one-of-a-kind alignment that combines a horizontal organizational structure with vertically aligned sub-groups dedicated to our clients. By adhering to consistent standards and methodologies, the team ensures operational excellence and has close ties with product teams at Oracle, IBM, Cloudera, Amazon and Microsoft.

We are seeking an experienced Senior Databricks Engineer to design, implement, automate, and support enterprise-scale Databricks platforms across AWS, Azure, and GCP. The role will focus on Databricks workspace management, Lakehouse architecture, cloud migrations, platform automation, governance, security, cost optimization, and operational excellence. The candidate will work closely with Data Engineering, Decision Science, Product Engineering, Cloud Infrastructure, and Security teams to deliver scalable and secure data platforms.

Responsibilities

• Databricks Platform Engineering - Own the design, deployment, administration, and lifecycle management of enterprise Databricks workspaces across AWS, Azure, and GCP.
• Cloud Infrastructure Integration - Enable secure connectivity, authentication, networking, and integration between Databricks and enterprise cloud platforms and databases.
• Migration Modernization - Lead migration of legacy data platforms, analytics workloads, and databases to the Databricks Lakehouse architecture.
• Automation DevOps - Drive Infrastructure-as-Code, CI/CD, and operational automation to improve platform scalability, consistency, and efficiency.
• Security Governance - Implement enterprise-grade security, access controls, compliance, auditing, and data governance using Unity Catalog and identity integrations.
• Performance Cost Optimization - Continuously optimize Databricks workloads, storage layouts, and compute resources to improve performance and reduce cloud spend.
• Monitoring Operational Support - Establish proactive monitoring, incident management, troubleshooting, and platform reliability practices for business-critical workloads.
• AI Innovation - Evaluate and implement Databricks AI, GenAI, and automation capabilities to enhance platform operations and business value.
• Stakeholder - Partner with architects, engineering teams, security teams, and business partners while mentoring engineers and driving platform standards.

Qualifications

• 6+ years overall IT experience with 3+ years in Databricks.
• Solid experience with Databricks administration and platform engineering.
• Expertise in Spark, PySpark, SQL, Delta Lake, Unity Catalog, and Workflows.
• Experience with AWS, Azure, and/or GCP.
• Strong Python scripting and automation experience.
• Experience with Terraform and Infrastructure as Code.
• Hands-on experience with CI/CD pipelines and Git-based deployments.
• Good understanding of networking, private link connectivity, SSO, SAML/OIDC, and security concepts.
• Experience with PostgreSQL, SQL Server, Oracle, or cloud-native databases.
• Knowledge of data governance, metadata management, and compliance controls.
• Preferred Skills: Databricks Certified Professional Data Engineer and Cloud certifications (AWS/Azure/GCP)
• Experience with Lakehouse migrations.
• Knowledge of Kafka, ELK, Prometheus, Grafana, and cloud observability tools.
• Experience with MLflow, Databricks Genie, and GenAI solutions.
• Experience supporting large-scale enterprise analytics platforms.
• Exposure to multi-cloud environments and global data platforms.
• Education/Certification: B.S./B.E in related field or equivalent work experience required.
• Databrick/AWS certification is a plus.

Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.