Senior Data Engineer — Lead Scalable Pipelines & AI Tools

Arrive Logistics; Chicago, Northern (IL, KY); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical benefits

401(k) matching

Employee Resource Groups

Casual dress code

Downtown Chicago office

Relocation assistance

Paid holidays

Parental leave

Life insurance

Job summary

Arrive Logistics in Chicago is seeking a Senior Data Engineer to own the data ecosystem powering analytics, BI, and data science. You will design and manage pipelines, data warehouses, and governance, partnering with data scientists, analysts, and product managers.

You will lead with technical vision, mentor engineers, and drive scalable cloud infrastructure using Snowflake, Azure, and Python, shaping the company’s data-driven product roadmap.

Qualifications

• 5+ years experience in data engineering.
• Expert proficiency in SQL and strong programming in Python.
• Proven experience building and orchestrating data pipelines with dbt and Airflow.
• Hands-on experience with major cloud environments, preferably Microsoft Azure.
• Solid understanding of BI tooling integrations with a cloud data warehouse, preferably PowerBI.
• Solid understanding of event-driven architecture and Kafka for real-time data flow.
• Experience with modern cloud data warehouses like Snowflake, Databricks, BigQuery, or Redshift.
• Familiarity with CI/CD, microservice architecture, domain driven design, data contracts.
• Strong data security/privacy practices and RBAC knowledge.
• Experience with machine learning concepts, frameworks, and infrastructure.
• Excellent written and oral communication and presentation skills.

Responsibilities

• Design, build, and optimize robust data pipelines ingesting data from diverse sources.
• Develop and maintain data warehousing solutions (Snowflake) with RBAC governance.
• Ensure data quality with validation, monitoring, and anomaly detection.
• Architect and manage cloud-based data infrastructure.
• Orchestrate batch ML pipelines with data scientists for product requirements.
• Collaborate with stakeholders to deliver actionable data solutions.
• Improve performance, efficiency, and cost of data systems.
• Weigh build-vs-buy tradeoffs with leadership for roadmap.
• Define architectures and best practices for data ingestion to the warehouse.
• Interact with vendors to adopt new technology and infrastructure.
• Develop AI agent tools and reusable skill libraries for developer productivity.
• Govern secure integrations between AI tools and the data warehouse with access controls.
• Participate in on-call rotations, define SLAs, and manage incidents.
• Create and improve technical documentation and standards.
• Mentor and lead the data engineering team and stakeholders.

Skills

SQL

Python

dbt

Airflow

Azure

Power BI

Kafka

Machine learning concepts

CI/CD

Microservice architecture

Domain-driven design

Data contracts

Data security/privacy

Education

Bachelor's degree in CS/Engineering or equivalent

Tools

Snowflake

Databricks

BigQuery

Redshift

Job description

Arrive Logistics in Chicago is seeking a Senior Data Engineer to own the data ecosystem powering analytics, BI, and data science. You will design and manage pipelines, data warehouses, and governance, partnering with data scientists, analysts, and product managers.

You will lead with technical vision, mentor engineers, and drive scalable cloud infrastructure using Snowflake, Azure, and Python, shaping the company’s data-driven product roadmap.