Senior Databricks Data Engineer - Lakehouse & Pipelines

HTEC Group; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

HTEC Group is seeking an experienced Data Engineer to enhance their data infrastructure. The ideal candidate will have over 7 years of relevant experience, strong hands-on capabilities with Databricks and Apache Spark, and proficiency in Python or Scala. Responsibilities include designing and maintaining data pipelines, ensuring data quality, and collaborating with business stakeholders on analytics. This position is critical to building scalable data solutions that facilitate insights and data-driven decision-making.

Qualifications

• 7+ years of relevant experience as a Data Engineer.
• Strong hands-on experience with Databricks and Apache Spark.
• Proficiency in Python or Scala, both preferred.
• Very good knowledge of SQL and relational databases.
• Experience with ETL/ELT principles.

Responsibilities

• Take ownership of data engineering features and code quality.
• Design, implement, and maintain Databricks-based data pipelines.
• Build and optimize ETL/ELT processes using Apache Spark.
• Ensure high data quality and accuracy across the platform.
• Collaborate with stakeholders to support data-driven products.

Skills

Data Engineering

Databricks

Apache Spark

Python

SQL

Tools

ETL/ELT tools

Cloud platforms (AWS, Azure, GCP)

Unix-like operating systems

Job description

HTEC Group is seeking an experienced Data Engineer to enhance their data infrastructure. The ideal candidate will have over 7 years of relevant experience, strong hands-on capabilities with Databricks and Apache Spark, and proficiency in Python or Scala. Responsibilities include designing and maintaining data pipelines, ensuring data quality, and collaborating with business stakeholders on analytics. This position is critical to building scalable data solutions that facilitate insights and data-driven decision-making.