Remote Data Engineer: PySpark, Databricks & AWS

Bixal; United States; On-site; USD 95,000 - 115,000; Full time

Benefits offered by this job

Flex hours

401K with matching

Parental Leave

Medical/dental/vision benefits

Flex Spending Account

Short‑term disability and life保险

Commuter benefits

PTO

11 Paid holidays

Job summary

Bixal is seeking a skilled Data Engineer to join our team and build robust data pipelines using PySpark, Databricks, AWS, and streaming architectures. The role focuses on platform reliability, scalability, and evolution across programs, with a fixed-term contract that supports ongoing project needs.

Ideal candidates will bring 4+ years of data engineering experience, strong Python and SQL skills, and experience with Databricks and AWS.

Qualifications

• Bachelor’s degree required.
• Minimum 4 years of Data Engineering experience.
• Proficiency in Python for data engineering tasks.
• Hands-on experience with Databricks Intelligence Platform (Notebooks, Lakeflow Jobs, Unity Catalog, Delta Share).
• Experience with AWS services such as S3 and IAM roles and policies.
• Strong knowledge of data pipeline design, data transformation, data modeling, and data security best practices.
• Proficiency with Git and collaboration on Agile projects.
• Familiarity with Terraform or other infrastructure as code tools.

Responsibilities

• Lead implementation of complex data ingestion pipelines using PySpark, Databricks Intelligence Platform, and AWS services (S3, IAM roles and policies).
• Provide technical guidance and mentorship to engineers and represent data engineering in cross-functional discussions.
• Apply engineering standards including CI/CD, testing, and infrastructure as code patterns using Terraform.
• Document architecture decisions and operational runbooks to enable team autonomy.
• Identify optimization opportunities across ingestion, transformation, and storage layers.
• Troubleshoot complex pipeline failures across multi-system dependencies.
• Collaborate with data scientists, analysts, DevOps, and client teams to deliver integrated solutions.
• Perform other duties as qualified and trained.

Skills

Python

SQL

Data pipeline design

Root cause analysis

Cross-functional collaboration

Communication

Education

Bachelor’s degree

Tools

Databricks Intelligence Platform

AWS (S3, IAM)

Terraform

Linux

Git

Job description

Bixal is seeking a skilled Data Engineer to join our team and build robust data pipelines using PySpark, Databricks, AWS, and streaming architectures. The role focuses on platform reliability, scalability, and evolution across programs, with a fixed-term contract that supports ongoing project needs.

Ideal candidates will bring 4+ years of data engineering experience, strong Python and SQL skills, and experience with Databricks and AWS.