Senior Data Engineer

Jobtailor; California (MO); On-site; USD 140,000 - 190,000; Full time

Job summary

Jobtailor is seeking a senior data engineer to design, build, and maintain robust data pipelines and data lake architecture for batch and real-time workloads. You will optimize ETL/ELT processes, improve observability, and contribute to scalable data products in a fast-paced environment.

You will collaborate with analytics, product, and ML teams, implement dbt workflows, and help ensure platform reliability, testing, and high-quality code across cloud-based data platforms.

Qualifications

• Bachelor's degree in Computer Science, Engineering or related field.
• 5+ years in data engineering, platform engineering, or backend development.
• Strong SQL and Python skills for building data solutions.
• dbt experience building and maintaining dbt projects is required.
• Experience with CI/CD pipelines and infrastructure-as-code tools is a plus.

Responsibilities

• Design, build, and maintain robust data pipelines and data lake architecture for batch and real-time use cases.
• Improve observability, alerting, and SLOs across data systems to catch issues early.
• Optimize ETL/ELT workflows for performance and fault tolerance.
• Develop dbt workflows to onboard Evaluation Partners and create end-of-day reports.
• Build and support event-driven architectures and scalable platform components.
• Collaborate with analytics, product, and ML engineers to develop data products.
• Work on feature pipelines and model-ready data to support ML engineers.
• Promote high standards in code quality, testing, and platform reliability.
• Participate in Agile ceremonies and foster a collaborative team culture.

Skills

SQL

Python

Education

Bachelor's degree in Computer Science

Bachelor's degree in Engineering

Tools

dbt

Airflow

Prefect

Job description

Responsibilities

• Design, build, and maintain robust data pipelines and data lake architecture for both batch and real‑time streaming use cases, including high‑volume, low‑latency data processing
• Improve observability, alerting, and SLOs across data systems so pipelines are easier to monitor and issues are caught early
• Optimize ETL/ELT workflows for performance, scalability, and fault tolerance
• Develop dbt workflows to onboard Evaluation Partners and create end‑of‑day reporting for partner analysis
• Build and support event‑driven architectures and scalable platform components
• Contribute to the orchestration and automation of workflows
• Integrate complex financial APIs and third‑party data sources into internal systems
• Collaborate with analytics, product, and ML engineers to develop and deploy reliable data products
• Work on feature pipelines and model‑ready data to support ML engineers
• Promote high standards in code quality, testing, and platform reliability
• Participate in Agile ceremonies and foster a collaborative, growth‑oriented team culture

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field
• 5+ years of experience in data engineering, platform engineering, or backend development
• Strong skills in SQL and Python for building and testing data solutions
• Hands‑on experience with GCP and GCP data products (BigQuery, Cloud SQL, Cloud Storage, etc.)
• Experience with AWS cloud services (S3, Glue, Athena, Kinesis) in addition to GCP; bonus for EMR
• Experience with CI/CD pipelines, infrastructure‑as‑code, and version‑controlled deployment workflows (e.g., Terraform, GitOps)
• Hands‑on dbt experience building and maintaining dbt projects (models, tests, macros, documentation, CI)
• Proficiency with workflow orchestration tools (e.g., Airflow, Prefect)
• Knowledge of data lake architecture, including file formats (Parquet, Avro) and open table formats (Apache Iceberg)
• Familiarity with event‑driven and service‑oriented architecture
• A track record of building automated, well‑tested, and observable data systems
• Comfortable working both independently and collaboratively in a fast‑paced Agile environment

Certifications & Qualifications

• Bachelor's degree in Computer Science
• Bachelor's degree in Engineering