Senior Data Engineer & Cloud Lakehouse Architect

BioSpace; North Chicago (IL); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

Medical/dental/vision insurance

401(k) matching

Paid time off

Job summary

AbbVie seeks a Senior Data Engineer & Solution Architect to lead the Operations Data organization, shaping a cloud-native lakehouse for Supply Chain analytics. You will design end-to-end data pipelines on AWS, define data products, and embody data mesh principles across SAP and planning domains.

You will collaborate with business stakeholders and lead a data engineering team to deliver scalable, governed data and dashboards that empower analytics and AI use cases across the Supply Chain.

Qualifications

• 7+ years in data architecture and data engineering; advanced degree options.
• Hands-on with AWS Glue, Amazon S3, AWS EMR and related ingestion/transformation techs like Informatica.
• Experience with Apache Iceberg and lakehouse architectures.
• Proficiency with AWS Redshift or modern data warehousing platforms.
• Familiarity with Medallion Architecture and data mesh concepts.
• Strong Python, SQL, Spark/PySpark skills.
• Data governance, cataloging, lineage, quality practices.

Responsibilities

• Design, build, and maintain legacy ETL and cloud-native data pipelines on AWS.
• Architect data needs for Operations Supply Chain analytics using Iceberg and Medallion.
• Develop Redshift data warehouses for Supply Chain analytics.
• Define data product architecture and data mesh standards.
• Collaborate with SAP and planning systems to model critical data flows.
• Lead and mentor the data engineering team; drive delivery and excellence.

Skills

Data engineering

Python

SQL

ETL

Spark/PySpark

Data governance

Analytical thinking

Communication

Education

Bachelor's degree in CS/IS/Data Engineering

Master's degree

PhD

Tools

AWS Glue

Amazon S3

AWS EMR

Informatica

Apache Iceberg

AWS Redshift

Medallion Architecture

Job description

AbbVie seeks a Senior Data Engineer & Solution Architect to lead the Operations Data organization, shaping a cloud-native lakehouse for Supply Chain analytics. You will design end-to-end data pipelines on AWS, define data products, and embody data mesh principles across SAP and planning domains.

You will collaborate with business stakeholders and lead a data engineering team to deliver scalable, governed data and dashboards that empower analytics and AI use cases across the Supply Chain.