Senior Databricks Data Engineer - Lakehouse & Cloud Analytics

Datavail Corp.; Boulder (CO); Hybrid; USD 120,000 - 190,000; Full time

Job summary

Datavail is seeking a senior data engineering/architecture professional to design and deliver Databricks-based data solutions. You will work with modern data platforms, model data, and integrate data with applications using APIs and event-driven patterns.

You will engage with clients in consulting environments, communicating effectively with technical and business stakeholders, and building scalable cloud data architectures using Azure, AWS, or GCP Databricks platforms.

Qualifications

• Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, or related field.
• 4+ years experience in cloud/infrastructure technologies, information technology consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting.
• Deep hands on experience with Databricks Lakehouse Platform and Apache Spark
• Strong proficiency in PySpark, SQL, Delta Lake, Databricks SQL
• Experience implementing Unity Catalog, data governance, and enterprise security controls
• Cloud experience with Azure Databricks, AWS Databricks, or GCP Databricks
• Familiarity with CI/CD, DevOps, and automation for Databricks workloads
• 8–12+ years in data engineering or architecture, with 4–5+ years delivering Databricks solutions
• Proven experience in client facing consulting roles, including requirements discovery, solution design, and executive communication.

Responsibilities

• Work with Databricks Lakehouse Platform and Apache Spark to design and implement data solutions.
• Collaborate on enterprise data warehouses and lakehouse patterns and integration with applications.
• Engage with clients, translating business needs into technical solutions.
• Contribute to security, governance, and data management best practices.
• Support and guide clients in cloud architecture concepts, scalability, and cost management.

Skills

Databricks

PySpark

SQL

Delta Lake

Databricks SQL

Azure Databricks

AWS Databricks

GCP Databricks

CI/CD

DevOps

Automation

Education

Bachelor's Degree in Computer Science/IT/Engineering/Business

Tools

Apache Spark

Unity Catalog

Delta Lake

Job description

Datavail is seeking a senior data engineering/architecture professional to design and deliver Databricks-based data solutions. You will work with modern data platforms, model data, and integrate data with applications using APIs and event-driven patterns.

You will engage with clients in consulting environments, communicating effectively with technical and business stakeholders, and building scalable cloud data architectures using Azure, AWS, or GCP Databricks platforms.