Senior Databricks Data Engineer (Fully Remote)

Jobgether; United States; A distancia; USD 110.000 - 160.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare coverage

Meal vouchers

Life insurance

Employee referral program

Mental health support

Fitness membership

Extended parental leave

Descripción de la vacante

Jobgether is seeking a data engineer in the United States to design, develop, and deploy data solutions using the Databricks Lakehouse and Medallion architectures. You will build and manage data pipelines with PySpark, Spark SQL, and Delta Lake, mentor teammates, and establish engineering best practices across the team.

Experience with Delta Live Tables, Unity Catalog, and CI/CD is required. The role emphasizes governance, secure data access, and scalable pipelines.

Formación

• Experience delivering production-grade data engineering solutions with Databricks.
• Strong proficiency in PySpark, Spark SQL, and Delta Lake.
• Hands-on knowledge of Delta Live Tables, Unity Catalog, Auto Loader.
• Experience with CI/CD and governance/security in data platforms.

Responsabilidades

• Design, develop, and implement data engineering solutions using the Databricks ecosystem with Lakehouse and Medallion architectures.
• Build and manage data pipelines with Databricks, PySpark, Spark SQL, and Delta Lake, including CDC and Structured Streaming.
• Act as a technical reference, mentoring team members and establishing engineering best practices.

Conocimientos

Data pipelines design

Mentoring

ETL orchestration

Cloud data engineering

Databricks

PySpark

Spark SQL

Delta Lake

Delta Live Tables

Unity Catalog

Auto Loader

Liquid Clustering

Azure Data Factory

CI/CD

Herramientas

Databricks

PySpark

Spark SQL

Delta Lake

Delta Live Tables

Unity Catalog

Auto Loader

Liquid Clustering

Azure Data Factory

Descripción del empleo

• Design, develop, and implement data engineering solutions using the Databricks ecosystem with Lakehouse and Medallion architectures.
• Build and manage data pipelines with Databricks, PySpark, Spark SQL, and Delta Lake, including CDC and Structured Streaming.
• Act as a technical reference, mentoring team members and establishing engineering best practices.

Requirements:

• Extensive experience delivering production-grade data engineering solutions with Databricks and advanced proficiency in PySpark, Spark SQL, and Delta Lake.
• Hands-on knowledge of Delta Live Tables, Liquid Clustering, Auto Loader, and Unity Catalog for governance and security.
• Strong expertise in Spark performance tuning, CI/CD, and Azure Data Factory integration.
• Comprehensive healthcare coverage including medical and dental insurance.
• Financial support through meal vouchers, life insurance, and an employee referral program.
• Wellness benefits including mental health support, fitness membership, and extended parental leave.