Senior Databricks Engineer - Healthcare Analytics (Remote)

EXL Talent Acquisition Team; Austin (TX); Remote; USD 120,000 - 180,000; Full time

Job summary

Databricks is seeking an experienced Databricks Data Engineer to join a remote, USA-based healthcare analytics team. The role focuses on designing and implementing scalable data platforms on Databricks and cloud platforms, delivering analytics, reporting, and operational decisions.

The candidate should have hands-on Databricks experience, strong PySpark/Python/SQL skills, and knowledge of data governance and modern data architecture.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
• Minimum 5 years of experience in data engineering, data architecture, or related technical roles.
• Hands-on experience with Databricks in enterprise environments.
• Strong knowledge of PySpark, Spark SQL, Python, and SQL.
• Experience designing and implementing Lakehouse architectures.
• Experience building scalable ETL/ELT data pipelines.
• Strong understanding of data modeling, data warehousing, and analytics platforms.
• Experience working with structured and unstructured data.
• Strong problem-solving and communication skills.
• Ability to work independently in a remote environment.
• Experience implementing data governance and security frameworks.

Responsibilities

• Design and implement scalable data solutions using Databricks Lakehouse architecture.
• Develop and optimize batch and real-time data pipelines for large-scale data processing.
• Lead technical solution design for data integration, transformation, and analytics workloads.
• Collaborate with business stakeholders, data engineers, analysts, and product teams to translate requirements into technical solutions.
• Implement data governance, security, and data quality best practices using Unity Catalog and related technologies.
• Optimize performance, reliability, and cost efficiency of Databricks workloads.
• Support data warehouse modernization and cloud migration initiatives.
• Create architecture documentation, technical standards, and design guidelines.
• Troubleshoot complex data platform issues and provide technical recommendations.
• Stay current with Databricks and cloud platform capabilities and drive adoption of best practices.

Skills

Databricks

PySpark

Spark SQL

Python

SQL

Lakehouse architectures

ETL/ELT pipelines

Data modeling

Data warehousing

Analytics platforms

Education

Bachelor's degree in Computer Science/Information Systems/Engineering/related field

Tools

Databricks

Unity Catalog

Azure

AWS

GCP

Job description

Databricks is seeking an experienced Databricks Data Engineer to join a remote, USA-based healthcare analytics team. The role focuses on designing and implementing scalable data platforms on Databricks and cloud platforms, delivering analytics, reporting, and operational decisions.

The candidate should have hands-on Databricks experience, strong PySpark/Python/SQL skills, and knowledge of data governance and modern data architecture.