Hybrid Lead Data Engineer: Cloud, AI & Data Pipelines

Creative Financial Staffing, LLC; Chicago (IL); Hybrid; USD 180,000 - 220,000; Full time

Benefits offered by this job

Health

Dental

Vision

401K

PTO

Job summary

Creative Financial Staffing, LLC in Chicago, IL, is seeking a Lead Data Engineer to design, develop, and optimize a modern cloud-based data platform. The role blends hands-on engineering with technical leadership, focusing on scalable data solutions, AI-enabled applications, and cloud technologies.

The ideal candidate has strong Python expertise, 10+ years in data engineering, and a track record of leading initiatives while mentoring engineers.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field.
• 10+ years of data engineering experience required.
• Strong hands-on Python development experience.
• Experience building and supporting enterprise-scale data pipelines and architecture.
• Cloud platform experience, preferably AWS.
• Exposure to AI, machine learning, LLMs, or AI-enabled solutions.
• Strong SQL, data modeling, and database experience.
• Experience with Snowflake, DevOps practices, CI/CD, Docker, or similar modern technologies.
• Proven ability to learn new technologies quickly and solve complex technical challenges.
• Strong communication skills with experience working across technical and business teams.
• Previous technical leadership, mentoring, or project lead experience preferred.

Responsibilities

• Design, develop, and maintain scalable data pipelines, integrations, and data services.
• Lead the architecture and implementation of cloud-based data platforms and modern data solutions.
• Develop and support AI-driven and data-intensive applications.
• Partner with business and technical stakeholders to translate requirements into scalable solutions.
• Improve platform performance, reliability, security, and scalability.
• Establish engineering best practices, development standards, and technical governance.
• Mentor and guide engineers while providing leadership on complex technical initiatives.
• Drive projects through the full lifecycle from design and development to deployment and ongoing support.

Skills

Python

SQL & data modeling

Leadership/mentoring

Communication

Data pipelines design

Education

Bachelor’s or Master’s Degree in CS/Engineering/IS

Tools

AWS

Snowflake

Docker

CI/CD

DevOps practices

Job description

Creative Financial Staffing, LLC in Chicago, IL, is seeking a Lead Data Engineer to design, develop, and optimize a modern cloud-based data platform. The role blends hands-on engineering with technical leadership, focusing on scalable data solutions, AI-enabled applications, and cloud technologies.

The ideal candidate has strong Python expertise, 10+ years in data engineering, and a track record of leading initiatives while mentoring engineers.