Databricks Data Engineer: Pipelines, Lakehouse & Medallion

Compunnel, Inc.; Spring (TX); On-site; USD 110,000 - 140,000; Full time

Job summary

Compunnel, Inc. is looking for a Databricks Data Engineer to design, develop, and maintain data pipelines in a Lakehouse environment. The successful candidate will have over 6 years of Data Engineering experience, with expertise in Databricks, Spark, and strong programming skills in Python and SQL.

Responsibilities include optimizing ETL/ELT pipelines, ensuring data quality, and collaborating with stakeholders to meet analytics requirements. Join us to elevate data engineering practices!

Qualifications

• 6+ years of experience in Data Engineering.
• Hands-on experience with Databricks and Apache Spark.
• Strong programming experience with Python.
• Strong SQL development and query optimization skills.

Responsibilities

• Develop and maintain data ingestion pipelines.
• Design, build, and optimize ETL/ELT pipelines using Databricks, PySpark, and SQL.
• Implement and support Medallion Architecture layers.
• Monitor, troubleshoot, and resolve data pipeline execution issues.

Skills

Databricks

Apache Spark

Python

SQL

ETL/ELT pipelines

Delta Lake architectures

Data governance

Data quality

Job description

Compunnel, Inc. is looking for a Databricks Data Engineer to design, develop, and maintain data pipelines in a Lakehouse environment. The successful candidate will have over 6 years of Data Engineering experience, with expertise in Databricks, Spark, and strong programming skills in Python and SQL.

Responsibilities include optimizing ETL/ELT pipelines, ensuring data quality, and collaborating with stakeholders to meet analytics requirements. Join us to elevate data engineering practices!