Senior Data Engineer — Real-Time Data Platform Architect

Madison-Davis, LLC; Chicago (IL); On-site; USD 130,000 - 180,000; Full time

Job summary

Madison-Davis, LLC is seeking a Senior Data Engineer to join our Data & Analytics team. You will own data architecture, scalable workflows, and real-time solutions that support trading tools, product development, and ML work.

You will design, build, and maintain data pipelines across batch and real-time use cases, while strengthening observability and SLOs. Expect collaboration with analytics, product, and ML engineers in a fast-paced Agile environment.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 5+ years of experience in data engineering or backend development.
• Strong SQL and Python skills for building data solutions.
• Hands-on experience with GCP and AWS data products.
• Experience with CI/CD, IaC, and version-controlled deployment workflows (Terraform, GitOps).
• Hands-on dbt experience building projects, models, tests, and CI.
• Proficiency with orchestration tooling (Airflow, Prefect).
• Knowledge of data lake architectures and file formats.

Responsibilities

• Design, build, and maintain resilient data pipelines and data lake architecture.
• Strengthen observability, alerting, and SLOs across data systems.
• Optimize ETL/ELT workflows for performance and scalability.
• Build dbt workflows for onboarding and end-of-day reporting.
• Develop event-driven architectures and reusable platform components.
• Advance workflow orchestration and automation across the platform.
• Integrate financial APIs and third-party data sources.
• Collaborate with analytics, product, and ML teams to deploy data products.
• Create feature pipelines and model-ready datasets for ML work.
• Maintain high code quality and platform reliability.
• Participate in Agile ceremonies and team growth.

Skills

SQL

Python

Agile

Observability

Education

Bachelor’s degree in CS / Engineering

Tools

GCP (BigQuery)

AWS (S3, Glue, Athena, Kinesis)

dbt

Airflow

Terraform

Kubernetes

Job description

Madison-Davis, LLC is seeking a Senior Data Engineer to join our Data & Analytics team. You will own data architecture, scalable workflows, and real-time solutions that support trading tools, product development, and ML work.

You will design, build, and maintain data pipelines across batch and real-time use cases, while strengthening observability and SLOs. Expect collaboration with analytics, product, and ML engineers in a fast-paced Agile environment.