Data Engineer: Cloud Pipelines & Databricks (Remote)

Bixal Solutions, Inc.; Northern (KY); Hybrid; USD 95,000 - 115,000; Full time

Benefits offered by this job

Flex hours

401K with matching

Parental Leave

Medical/dental/vision benefits

Paid Time Off (PTO)

11 Paid holidays

Job summary

Bixal is seeking a skilled Data Engineer to build and optimize data pipelines using PySpark, Databricks, and AWS. You will ensure scalability, reliability, and alignment with enterprise architecture while working across cross-functional teams on a current contract.

The role emphasizes Python data engineering, Databricks expertise, and IaC practices, with a focus on collaboration and impactful data solutions for clients.

Qualifications

• Bachelor’s degree required.
• 4+ years of relevant Data Engineering experience.
• Proficiency in Python for data engineering tasks at scale.
• Hands-on experience with Databricks Intelligence Platform (Notebooks, Lakeflow Jobs, Unity Catalog, Delta Share).
• Experience with AWS services (S3, IAM roles and policies).
• Strong knowledge of data pipeline design, data modeling, storage optimization, and data security best practices.
• Git version control and Agile collaboration experience.
• Terraform or similar IaC tools for automation.

Responsibilities

• Lead complex data ingestion pipelines using PySpark, Databricks, and AWS services.
• Provide technical guidance and mentorship across the team.
• Apply engineering standards including CI/CD and infrastructure as code.
• Document architecture decisions and runbooks for autonomy and reliability.
• Optimize data ingestion, transformation, and storage across pipelines.
• Troubleshoot complex pipeline failures across multi-system dependencies.
• Collaborate with data scientists, analysts, DevOps, and client teams to deliver integrated solutions.

Skills

Python

SQL

Cross-functional collaboration

Education

Bachelor’s degree

Tools

Databricks Intelligence Platform

AWS

Terraform

Job description

Bixal is seeking a skilled Data Engineer to build and optimize data pipelines using PySpark, Databricks, and AWS. You will ensure scalability, reliability, and alignment with enterprise architecture while working across cross-functional teams on a current contract.

The role emphasizes Python data engineering, Databricks expertise, and IaC practices, with a focus on collaboration and impactful data solutions for clients.