Senior Data Engineer: Real-Time Data Pipelines

Jobtailor; California (MO); On-site; USD 140,000 - 190,000; Full time

Job summary

Jobtailor is seeking a senior data engineer to design, build, and maintain robust data pipelines and data lake architecture for batch and real-time workloads. You will optimize ETL/ELT processes, improve observability, and contribute to scalable data products in a fast-paced environment.

You will collaborate with analytics, product, and ML teams, implement dbt workflows, and help ensure platform reliability, testing, and high-quality code across cloud-based data platforms.

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• 5+ years in data engineering, platform engineering, or backend development.
• Strong SQL and Python skills for building data solutions.
• dbt experience building and maintaining dbt projects is required.
• Experience with CI/CD pipelines and infrastructure-as-code tools is a plus.

Responsibilities

• Design, build, and maintain robust data pipelines and data lake architecture for batch and real-time use cases.
• Improve observability, alerting, and SLOs across data systems to catch issues early.
• Optimize ETL/ELT workflows for performance and fault tolerance.
• Develop dbt workflows to onboard Evaluation Partners and create end-of-day reports.
• Build and support event-driven architectures and scalable platform components.
• Collaborate with analytics, product, and ML engineers to develop data products.
• Work on feature pipelines and model-ready data to support ML engineers.
• Promote high standards in code quality, testing, and platform reliability.
• Participate in Agile ceremonies and foster a collaborative team culture.

Skills

SQL

Python

Education

Bachelor's degree in Computer Science

Bachelor's degree in Engineering

Tools

dbt

Airflow

Prefect

Job description

Jobtailor is seeking a senior data engineer to design, build, and maintain robust data pipelines and data lake architecture for batch and real-time workloads. You will optimize ETL/ELT processes, improve observability, and contribute to scalable data products in a fast-paced environment.

You will collaborate with analytics, product, and ML teams, implement dbt workflows, and help ensure platform reliability, testing, and high-quality code across cloud-based data platforms.