Senior Data Engineer: Cloud Data Pipelines & DW Architect

7Th Sky Tech; Chicago (IL); Hybrid; USD 140,000 - 200,000; Full time

Job summary

7Th Sky Tech is seeking a Senior Data Engineer in the Chicago area. You will design, implement, and maintain scalable data pipelines and data warehouses, enabling data-driven decisions across teams.

The role emphasizes Python/SQL proficiency, ETL/ELT expertise, and collaboration with data scientists, software engineers, and analysts. The position is full-time and hybrid, requiring hands-on experience with cloud data platforms, distributed processing, and modern data architectures.

Qualifications

• 8+ years of professional Data Engineering experience.
• Strong Python programming skills.
• Advanced SQL and query optimization.
• Hands-on ETL/ELT development and data pipelines.
• Experience with Spark/PySpark and distributed processing.
• Cloud data platforms (AWS/Azure/GCP) and data warehousing.
• Familiarity with data quality, governance, security, and metadata management.
• Experience with Airflow or similar orchestration tools.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines.
• Build and optimize data processing workflows with Python and SQL.
• Ingest data from databases, APIs, files, and other sources.
• Design and maintain data warehouses, lakes, and lakehouse architectures.
• Work with large datasets using distributed processing technologies like Spark.
• Develop data models and optimize complex SQL queries.
• Implement data quality, monitoring, and error handling frameworks.
• Collaborate with cross-functional teams on requirements.
• Mentor junior engineers and contribute to architecture decisions.
• Document data pipelines and technical solutions.

Skills

Python

SQL

ETL/ELT

Apache Spark

Data warehousing

Data modeling

Distributed processing

DevOps

Git

CI/CD

Education

Bachelor's or Master's in CS/Engineering

Tools

Databricks

Azure Data Factory

Synapse

AWS Glue

Snowflake

Airflow

Docker

Kubernetes

Redshift

BigQuery

Job description

7Th Sky Tech is seeking a Senior Data Engineer in the Chicago area. You will design, implement, and maintain scalable data pipelines and data warehouses, enabling data-driven decisions across teams.

The role emphasizes Python/SQL proficiency, ETL/ELT expertise, and collaboration with data scientists, software engineers, and analysts. The position is full-time and hybrid, requiring hands-on experience with cloud data platforms, distributed processing, and modern data architectures.