AWS Databricks Platform Engineer

Qualcomm; Hyderabad; On-site; INR 2,300,000 - 3,000,000; Full time

Job summary

Qualcomm is hiring a Data Platform Engineer in Hyderabad, India. This senior role involves designing and building a modern data platform based on AWS Databricks, focusing on system design, reliability, security, and cost optimization.

The ideal candidate will have over 12 years of IT experience, deep expertise in AWS, and strong mentoring skills. Responsibilities include developing end-to-end data pipelines and optimizing platform architecture.

Qualifications

• 12+ years of IT-related work experience in Data Platform build-out.
• 10+ years of Platform engineering experience with AWS Databricks.
• 3+ years of programming experience, preferably in Java and Python.
• Strong understanding of cloud security best practices.

Responsibilities

• Design and build scalable, distributed data platform systems.
• Implement infrastructure as code using Terraform/Terramate.
• Develop and maintain CI/CD pipelines for data and ML artifacts.
• Mentor engineers and lead incident response and on-call rotations.

Skills

AWS Databricks

Terraform

CI/CD Pipelines

Java

Python

SQL

NoSQL

Amazon EKS

Data Structures

Education

Bachelor’s degree in Computer Engineering, Computer Science, or Information Systems

Tools

GitHub Actions

Jenkins

Helm

Databricks Lakehouse

Job description

General Summary

We are hiring a Data Platform Engineer to design, build, and operate a modern data platform with AWS Databricks Lakehouse as a core foundation. This senior role focuses on system design, platform innovation, hands‑on execution, reliability, security, and cost optimization while mentoring engineers and collaborating with data scientists, analysts, and application teams.

Key Responsibilities

• Design and build scalable, distributed data platform systems
• Own Databricks workspace architecture, governance, and lifecycle management
• Implement infrastructure as code using Terraform/Terramate
• Build and support end‑to‑end data pipelines, from ingestion to analytics and ML
• Develop and maintain CI/CD pipelines for infrastructure, data pipelines, notebooks, SQL, and ML artifacts
• Operate and optimize Amazon EKS clusters supporting data workloads
• Define and monitor SLIs/SLOs for platform reliability and data quality
• Drive innovation and continuous improvement across platform architecture and tooling
• Lead incident response, on‑call rotations, and blameless post‑mortems
• Implement strong security, compliance, and governance controls
• Mentor engineers and influence platform standards and best practices

Minimum Qualifications

• 12+ years of IT‑related work experience in Data Platform build‑out with a Bachelor’s degree
• 10+ years of Platform engineering experience building and operating AWS Databricks platforms
• 5+ years of IT‑related work experience with a Bachelor’s degree in Computer Engineering, Computer Science, Information Systems, or a related field (or 7+ years without a bachelor’s degree)
• 3+ years of programming experience (e.g., Java, Python)
• 3+ years of experience with SQL or NoSQL databases
• 3+ years of experience with Data Structures and algorithms

System Design & Innovation

• Proven experience designing complex, distributed data systems end to end
• Strong system design skills across cloud infrastructure, data pipelines, storage, governance, and observability
• Ability to evaluate and communicate architectural trade‑offs (scalability, reliability, cost, security, operability)
• Demonstrated innovation mindset: modernizing legacy platforms, introducing new patterns, improving reliability, performance, or developer experience

Cloud & Data Platform Expertise

• Large‑scale cloud platform experience with DevOps, SRE, or DataOps roles
• Expert level experience with AWS (networking, IAM, security, multi‑account environments)
• Hands‑on experience with Databricks Lakehouse Platform (Unity Catalog, Delta Lake, MLflow)
• Experience owning Databricks workspace architecture and governance

Infrastructure, Automation & Reliability

• Deep experience with Terraform/Terramate (or similar IaC tools)
• Proven experience building CI/CD pipelines (GitHub Actions, Jenkins)
• Advanced Python and Bash scripting skills
• Hands‑on experience managing Amazon EKS clusters and Helm deployments
• Experience defining and operating SLIs/SLOs for platform reliability and data quality

Security & Leadership

• Strong understanding of cloud security best practices
• Experience supporting SOX, GDPR, or regulated environments
• AWS Certified DevOps Engineer – Professional (or equivalent experience)
• Ability to work independently and mentor team members
• Strong communication skills to explain complex system designs to technical and non‑technical stakeholders

Preferred Experience

• Acceldata, OpenTelemetry, or data observability tools
• Fivetran Hybrid / HVR or enterprise ingestion tools
• Hashicorp Vault or similar secret‑management tools
• Policy as code (OPA)
• Static code analysis tools (Sonar)
• Data lineage or metadata management tools
• Databricks serverless compute optimization and cost management
• Driving platform strategy across multiple distributed teams

Equal Opportunity

Qualcomm is an equal opportunity employer. If you are an individual with a disability and need accommodations during the application/hiring process, Qualcomm is committed to providing an accessible process. Contact [e-mail] or call Qualcomm's toll‑free number to request reasonable accommodations.