Senior Data Engineer (Python) - Remote

Bitful Consulting; Tallahassee (FL); Remote; USD 110,000 - 160,000; Full time

Job summary

Bitful Consulting in Tallahassee, FL seeks a senior Data Engineer to build and maintain scalable data pipelines and datasets supporting reporting, analytics, and ML across finance, sales, and operations.

You'll work in a Databricks lakehouse, ingesting and transforming data with Python, PySpark and SQL, model data for Tableau and other BI tools, ensure quality and CI/CD practices, and mentor other engineers.

Qualifications

• 7+ years of experience in data engineering or a closely related field.

Responsibilities

• Build and maintain scalable data pipelines and datasets to support reporting, visualization, ML, and data-driven decision making across business functions.

Skills

Strong SQL

Data modeling

Database design

Data warehousing

ETL/ELT pipelines

CI/CD practices

Troubleshooting data issues

Tools

Databricks

Apache Spark

Python

PySpark

Tableau

Spotfire

Oracle

Informatica

R

Job description

You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across finance, sales, supply chain, marketing and other business functions. Developing and maintaining scalable data pipelines and reusable datasets within a Databricks lakehouse environment Ingesting, validating, cleaning and transforming structured and unstructured data from multiple sources using Python, PySpark and SQL Building data models and reporting datasets that support Tableau and established analytics tools such as Spotfire Integrating established data warehouse and reporting systems with modern cloud analytics platforms Improving pipeline reliability, data quality and processing performance Implementing automated testing, monitoring, documentation and CI/CD practices Partnering with analysts, architects, developers and business stakeholders to deliver practical data solutions Providing technical guidance, reviewing code and mentoring other data engineer

7+ years of experience in data engineering, including building and supporting production data pipelines

• ~ Strong SQL skills and a solid understanding of data modeling, database design and data warehousing
• ~ Hands-on experience with Databricks, Apache Spark and cloud data platforms
• ~ Strong proficiency in Python and PySpark
• ~ Experience developing ETL/ELT pipelines and integrating data from multiple source systems
• ~ Experience preparing reliable datasets for Tableau or comparable business intelligence tools
• ~ Familiarity with source control, automated testing and CI/CD practices
• ~ Ability to troubleshoot complex data issues and optimize pipeline performance
• ~ Experience with Spotfire, Oracle, Informatica, R or data virtualization preferred
• ~ Databricks certification preferred