Senior Data Engineer – Big Data Platform Team

Jobtailor; Alabama; On-site; USD 120,000 - 150,000; Full time

Job summary

Jobtailor is seeking a Data Warehouse Engineer to design, develop, and maintain scalable data warehouses in a BI-focused environment. You will analyze BI data, recommend solutions, and guide IT and business users in warehouse architecture.

You will lead implementations and ensure alignment with organizational standards. The role calls for extensive experience with Spark, SQL, ETL/ELT frameworks, and containerized environments, plus strong collaboration with stakeholders and mentoring of junior

Qualifications

• 5+ years of industry-relevant experience.
• Design, develop, and maintain scalable data pipelines using Spark, SQL, and distributed data platforms.
• Build robust ETL/ELT frameworks supporting batch and real-time processing.
• Ensure code quality, modularity, and reusability across pipelines.
• Work with containerized environments (Docker, Kubernetes/OCP).
• Optimize Spark jobs for performance, memory, and compute efficiency.
• Partner with business stakeholders and product teams to define data requirements.
• Provide technical leadership and mentor junior engineers.
• Ensure adherence to enterprise data governance, security, and compliance standards.
• Bachelor's degree in a relevant field.

Responsibilities

• Design, develop and maintain data warehouses with scalable architectures to support BI applications
• Analyze business intelligence data and recommend solutions
• Support and guide IT and business customers in designing data warehouse architecture
• Lead and consult on the implementation of data warehouses
• Ensure the solutions align with organizational standards

Skills

Data pipeline design

Spark

SQL

ETL/ELT frameworks

Docker

Kubernetes

Code quality

Stakeholder collaboration

Mentoring

Data governance

Education

Bachelor's degree in a relevant field

Tools

Docker

Kubernetes

OCP

Job description

Responsibilities

• Design, develop and maintain data warehouses with scalable architectures to support BI applications
• Analyze business intelligence data and recommend solutions
• Support and guide IT and business customers in designing data warehouse architecture
• Lead and consult on the implementation of data warehouses
• Ensure the solutions align with organizational standards

Requirements

• 5+ years of industry-relevant experience
• Design, develop, and maintain scalable data pipelines using Spark, SQL, and distributed data platforms
• Build robust ETL/ELT frameworks supporting batch and real-time processing
• Ensure code quality, modularity, and reusability across pipelines
• Work with containerized environments (Docker, Kubernetes/OCP)
• Optimize Spark jobs for performance, memory, and compute efficiency
• Partner with business stakeholders and product teams to define data requirements
• Provide technical leadership and mentor junior engineers
• Ensure adherence to enterprise data governance, security, and compliance standards
• Bachelors degree in a relevant field