Senior Data & AI Observability Engineer

Alion; Day (FL); On-site; USD 150,000 - 230,000; Full time

Job summary

Databricks is seeking a Senior Software Engineer for the Customer Foresight Team to lead development of products that provide insights on AI and data workloads. You will build data infrastructure processing billions of entries daily, deploy to 65+ cloud regions, and enable major cloud and AI workloads across large enterprises.

You will mentor engineers, drive milestones from refinement through operation, and partner with cross-functional teams to ensure product success and cost optimization.

Qualifications

• 6+ years of production level experience in one of: Java, Scala, Python, C++, or similar language.
• Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, Kubernetes.
• Proven track record in architecting, developing, deploying, and operating components of large scale distributed systems.
• Strong software engineering maturity: security, correctness, engineering excellence, operational excellence.
• Platform mindset: effective building platforms for other software teams, iterating quickly to reduce friction to adoption, advocating for platform use.
• Cross-functional skills: we have platform customers internal at Databricks as well as external customers, which requires strong cross-functional skills.

Responsibilities

• Lead the technical development of product milestones from requirements refinement to execution and iteration.
• Develop data infrastructure that processes billions of entries daily and supports observability.
• Deploy to 65+ cloud regions and enable DevOps, FinOps, SecOps, and AIOps workloads.
• Mentor engineers and drive scalability, cost optimization, and platform integrations.

Skills

Java

Scala

Python

C++

AWS

Azure

GCP

Docker

Kubernetes

Job description

Databricks is seeking a Senior Software Engineer for the Customer Foresight Team to lead development of products that provide insights on AI and data workloads. You will build data infrastructure processing billions of entries daily, deploy to 65+ cloud regions, and enable major cloud and AI workloads across large enterprises.

You will mentor engineers, drive milestones from refinement through operation, and partner with cross-functional teams to ensure product success and cost optimization.