Senior Data Engineer: Data Pipelines, AI & Cloud

Arrivelogistics; Chicago (IL); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, vision, life, and dis

401(k) matching

Employee Resource Groups

Team events, happy hours

Casual dress code

Relocation assistance

Gym access with Peloton

Employee Assistance Program

Referral program

Paid holidays, vacation, wellness days

Paid parental leave

Job summary

Arrive Logistics is seeking a Senior Data Engineer to lead the data ecosystem powering analytics, BI, and data science. You will architect robust data pipelines, manage cloud infrastructure, and partner with data scientists to optimize data-driven decisions.

You will own data quality, governance, and security, collaborate with product managers, and drive efficiency and cost improvements across data platforms in a fast-growing team in Chicago.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
• 5+ years of data engineering experience.
• Expert proficiency in SQL and Python.
• Proven experience building and orchestrating data pipelines using dbt and Airflow.
• Hands-on experience with a major cloud environment, preferably Microsoft Azure.
• Solid understanding of BI-tooling integrations with a cloud data warehouse, with Power BI as a preference.
• Solid understanding of event-driven architecture and Kafka for real-time data flow.
• Experience with cloud data warehouses like Snowflake, Databricks, BigQuery, or Redshift.
• Familiarity with CI/CD, microservice architecture, domain-driven design, and data contracts.
• Strong data security/privacy practices and RBAC knowledge.
• Experience with machine learning concepts and related infrastructure.
• Excellent written and oral communication and presentation skills.

Responsibilities

• Design, build, and optimize robust, scalable data pipelines from diverse sources.
• Develop and maintain data warehousing solutions with advanced RBAC and governance.
• Ensure data quality with validation, monitoring, and anomaly detection frameworks.
• Architect and manage cloud-based data infrastructure.
• Orchestrate batch machine learning pipelines with data scientists.
• Collaborate with stakeholders to deliver data-driven solutions.
• Improve performance and reduce costs of data systems and processes.
• Lead build-versus-buy tradeoffs in data initiatives and guide architecture decisions.
• Define architectures and best practices for data ingestion and analytics delivery.
• Lead incident management, on-call SLAs, and documentation improvements.
• Mentor the team and foster a collaborative data engineering culture.

Skills

SQL

Python

5+ years experience

dbt

Airflow

Azure

Power BI

Kafka

data governance

CI/CD

microservice architecture

data contracts

Education

Bachelor's degree in CS/Engineering or related field

Tools

Snowflake

Databricks

BigQuery

Redshift

Snowflake Cortex AI

Job description

Arrive Logistics is seeking a Senior Data Engineer to lead the data ecosystem powering analytics, BI, and data science. You will architect robust data pipelines, manage cloud infrastructure, and partner with data scientists to optimize data-driven decisions.

You will own data quality, governance, and security, collaborate with product managers, and drive efficiency and cost improvements across data platforms in a fast-growing team in Chicago.