Databricks Architect

Tekgence Inc; New Jersey; On-site; USD 140,000 - 220,000; Full time

Job summary

Tekgence Inc in the United States is seeking a Databricks Architect to design and lead enterprise-scale Lakehouse data platforms, focusing on scalability, security, governance, performance, and cost optimization.

You will work across cloud environments (AWS/Azure/GCP), implement Delta Lake, Unity Catalog, Medallion Architecture, and CI/CD pipelines, driving best practices in data security and governance.

Qualifications

• Experience designing enterprise-scale Lakehouse data platforms.
• Hands-on with Databricks, Delta Lake, and Unity Catalog.
• Proficient in Python, SQL, and Spark/PySpark.
• Experience across AWS, Azure, or GCP.
• Strong governance, security, and cost-optimization skills.

Responsibilities

• Design and lead enterprise-scale Lakehouse data platforms.
• Drive scalability, performance, and cost optimization.
• Implement security, governance, and data access controls.

Skills

Databricks

Delta Lake

Unity Catalog

Medallion Architecture

Python

SQL

Spark/PySpark

AWS/Azure/GCP

Structured Streaming

CI/CD

Terraform / IaC

Airflow

Security & Governance

Job description

We are seeking a Databricks Architect to design and lead enterprise-scale Lakehouse data platforms with a focus on scalability, security, governance, performance, and cost optimization.

Must-Have Skills:

• Strong Databricks, Delta Lake, Unity Catalog, and Medallion Architecture
• Advanced Python, SQL, Spark/PySpark
• Experience with AWS, Azure, or GCP
• Batch & real-time Structured Streaming
• CI/CD – Azure DevOps, Jenkins, or GitHub Actions
• Terraform / IaC and Airflow or equivalent
• Strong performance tuning, governance, security, and cost optimization experience

Good to Have:

Databricks certification, MLflow, Kafka, Databricks SQL, and Finance/Retail/Healthcare domain experience.