Lead Data Engineer - Cloud ETL & Databricks (Hybrid/Remote)

Addison Group; Illinois; Hybrid; USD 130,000 - 150,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401(k)

Hybrid/Remote flexibility

Job summary

Addison Group in Chicago, IL is seeking a Lead Data Engineer on a contract-to-hire basis. You will design, build, and optimize enterprise data pipelines in a cloud environment, mentoring a team of engineers.

The role emphasizes Databricks, AWS and Delta Lake, with opportunities to influence data strategy and governance in an Agile setting. Hybrid work with onsite 3 days preferred; remote considered for strong candidates.

Qualifications

• 10+ years of experience in data engineering or related field.
• Hands-on Databricks/Spark/Delta Lake experience.
• Advanced SQL and Python programming.
• Experience with AWS cloud environments.
• Oracle database experience.
• Strong communication and collaboration skills.

Responsibilities

• Design, develop, and support scalable ETL/ELT pipelines for enterprise reporting and analytics.
• Build cloud-based data solutions utilizing Databricks and AWS technologies.
• Create reliable, high-performing data workflows for batch and streaming processes.
• Collaborate with business partners to understand reporting and data requirements.
• Establish and promote engineering standards, coding best practices, and data governance.
• Optimize data architecture for performance and scalability.
• Mentor junior team members and provide technical leadership.
• Troubleshoot production issues and drive continuous improvements across the data platform.

Skills

Databricks

Spark

Delta Lake

SQL

Python

AWS

Oracle

Agile

Communication

Leadership

Tools

SSIS

Job description

Addison Group in Chicago, IL is seeking a Lead Data Engineer on a contract-to-hire basis. You will design, build, and optimize enterprise data pipelines in a cloud environment, mentoring a team of engineers.

The role emphasizes Databricks, AWS and Delta Lake, with opportunities to influence data strategy and governance in an Agile setting. Hybrid work with onsite 3 days preferred; remote considered for strong candidates.