Databricks Data Engineer - Remote Flexible Work

Coherent Solutions; Town of Poland (NY); Hybrid; USD 32,000 - 48,000; Full time

Benefits offered by this job

Health insurance

Remote/hybrid options

Conferences and meetups

Mentorship program

Vacation days

Job summary

Coherent Solutions is seeking a DataBricks Developer to support and extend a production Databricks-based data platform used for life insurance programs. You will collaborate with a small team to design data workflows, manage data access, and troubleshoot production pipelines.

The ideal candidate has 3+ years of data engineering experience with Databricks, SQL, Python, and Azure services, and enjoys working with stakeholders to deliver reliable data solutions.

Qualifications

• 3+ years of professional data engineering experience.
• Strong communication and collaboration with both technical and non-technical stakeholders.
• Hands-on Databricks development including Unity Catalog, Delta Lake, and notebooks.

Responsibilities

• Collaborate with a team of three engineers to develop and support data solutions in Databricks;
• Develop and maintain data processing workflows using Databricks, SQL, Python, and Delta Lake;
• Work with Unity Catalog to manage data access permissions, data lineage, and governance;
• Support the existing production system and participate in the implementation of new features and enhancements;
• Investigate and troubleshoot issues in Databricks data workflows and production processes;
• Collaborate with team members and stakeholders to deliver reliable data engineering solutions.

Skills

Databricks

SQL

Python

Azure

Team collaboration

Education

Bachelor’s degree in Computer Science or related field

Tools

Unity Catalog

Delta Lake

Databricks Genie

Job description

Coherent Solutions is seeking a DataBricks Developer to support and extend a production Databricks-based data platform used for life insurance programs. You will collaborate with a small team to design data workflows, manage data access, and troubleshoot production pipelines.

The ideal candidate has 3+ years of data engineering experience with Databricks, SQL, Python, and Azure services, and enjoys working with stakeholders to deliver reliable data solutions.