Senior AI & Data Platform Engineer

Enable Data Incorporated; United States; Hybrid; USD 31,000 - 62,000; Full time

Job summary

Databricks in Bengaluru is seeking an experienced data/AI engineer to design and implement scalable data pipelines, build Databricks Apps, and collaborate with cloud/security teams. You will leverage PySpark, PySQL, and FastAPI to deliver robust data and AI solutions.

You will work in a hybrid/remote setup, using Databricks Unity Catalog, Genie, Claude models, and CI/CD practices to deploy secure, scalable data applications.

Qualifications

• 10+ years of experience in data engineering or AI engineering.
• Experience with Databricks pipelines and Unity Catalog.
• Strong proficiency in PySpark and PySQL, and building APIs with FastAPI.

Responsibilities

• Design and build pipelines to ingest data into Databricks from multiple sources.
• Develop and deploy Databricks Apps using VS Code and Databricks tooling.
• Implement AI/ML features using Claude models and ensure safety guardrails.
• Collaborate with Azure cloud resources, reviews, and security teams.

Skills

PySpark

PySQL

FastAPI

React

Prompt engineering

Graph analysis

AI safety

Claude models/apis

Databricks Unity Catalog

Tools

Databricks

Claude Code

Genie

VS Code

Service Principals

AD0/CI-CD tools (ADO)

Snyk

Linting

Job description

Databricks in Bengaluru is seeking an experienced data/AI engineer to design and implement scalable data pipelines, build Databricks Apps, and collaborate with cloud/security teams. You will leverage PySpark, PySQL, and FastAPI to deliver robust data and AI solutions.

You will work in a hybrid/remote setup, using Databricks Unity Catalog, Genie, Claude models, and CI/CD practices to deploy secure, scalable data applications.