Senior Data Engineer: Databricks Lakehouse & Pipelines

Bitful Consulting; Lorida (FL); On-site; USD 120,000 - 170,000; Full time

Job summary

Bitful Consulting is seeking a senior data engineer to design and maintain scalable data pipelines in a Databricks lakehouse environment across finance, sales, and marketing.

You will ingest and transform data using Python, PySpark and SQL, and build data models for BI tools like Tableau and Spotfire, while mentoring junior engineers in a fast-moving data platform team based in Florida.

Qualifications

• Design and maintain scalable data pipelines in a Databricks lakehouse.
• Ingest and transform data using Python, PySpark, and SQL.
• Build data models for BI tools like Tableau and Spotfire.
• Collaborate with analysts and stakeholders to ensure data quality.
• Mentor junior engineers in a fast-moving data platform team.

Responsibilities

• Design and maintain scalable data pipelines in Databricks lakehouse.
• Ingest and transform data using Python, PySpark and SQL.
• Build data models for BI tools such as Tableau and Spotfire.
• Collaborate with analysts and stakeholders.
• Implement CI/CD practices for data pipelines.

Skills

Mentoring

Collaboration

Data modeling

CI/CD practices

Problem solving

Tools

Databricks

Python

PySpark

SQL

Tableau

Spotfire

CI/CD

Job description

Bitful Consulting is seeking a senior data engineer to design and maintain scalable data pipelines in a Databricks lakehouse environment across finance, sales, and marketing.

You will ingest and transform data using Python, PySpark and SQL, and build data models for BI tools like Tableau and Spotfire, while mentoring junior engineers in a fast-moving data platform team based in Florida.