Staff Data Engineer / DBT / AWS

Motion Recruitment Partners LLC; Chicago (IL); On-site; USD 120,000 - 160,000; Full time

Job summary

A leading company in the Chicago suburbs is seeking a Lead Data Engineer to enhance data engineering practices across the organization. This role involves developing tools and frameworks using Python, Airflow, and DBT, with opportunities to impact ETL processes and collaborate with various teams. Comprehensive benefits, including performance bonuses and a strong 401(k) program, promote the well-being of employees in a dynamic work environment.

Benefits

Performance bonus eligibility

Medical, dental, vision, and life insurance

Paid time off (PTO) and company holidays

Automatic 401(k) contribution

Employee discounts and tuition reimbursement

Parental leave and donation matching

Wellbeing programs

Qualifications

• Lead contributor in data systems with Databricks and Snowflake.
• Experience in batch/streaming ETL processes is essential.
• Familiarity with containerization and CI/CD pipelines preferred.

Responsibilities

• Implement efficient, reusable, and scalable data processing systems.
• Ensure data reliability and accuracy through designed solutions.
• Educate teams on new data patterns and tools.

Skills

Data processing systems

Data reliability

Data modeling

Data analysis

Collaboration

Tools

Python

DBT

Airflow

Databricks

Snowflake

AWS

Jenkins

Github Actions

Docker

Kubernetes

Job description

We are looking for a Lead Data Engineer to join one of the 100 Best Companies to Work For, with offices in the Chicago suburbs as well as in the city. The role will be within their Data Engineering 'Center of Excellence' and will have the opportunity to impact and improve data engineering practices across the organization.

As a Lead Data Engineer, you will utilize Python, Airflow, and DBT to develop tools, frameworks, and services that enhance ETL/ELT processes organization-wide. You will also work within modern AWS and Databricks architectures, adhering to best practices.

Required Skills & Experience

• Lead contributor responsible for implementing efficient, reusable, and scalable data processing systems in Databricks and Snowflake.
• Design and implement solutions to ensure data reliability and accuracy.
• Develop data models, mappings, and build new data assets; perform exploratory data analysis.
• Educate teams on new data patterns and tools.
• Serve as SME when collaborating with AI, Platform, and Business Analytics teams.

Desired Skills & Experience

• Experience with batch and streaming ETL using Airflow, DBT, Python, Snowflake, or Databricks.
• Experience with workflow orchestration tools like Databricks Workflows, Apache Airflow, or Luigi.
• Experience preparing structured and unstructured data for data science models.
• Knowledge of containerization and orchestration technologies (Docker, Kubernetes) and shell scripting.
• Experience with CI/CD pipelines using Jenkins, Github Actions, or Gitlab CI/CD.
• Familiarity with AWS services like Glue, Athena, Lambda, S3, and DynamoDB.
• Experience with data management lifecycle functions such as standardization, transformation, and data quality.

The Offer

• Performance bonus eligibility.

You will receive comprehensive benefits including:

• Medical, dental, vision, and life insurance.
• Paid time off (PTO) and 6 company holidays annually.
• Automatic 6% 401(k) contribution per pay period.
• Employee discounts, parental leave, donation matching, and tuition reimbursement.
• Wellbeing programs addressing emotional, financial, physical, and social health.

Applicants must be authorized to work in the US on a full-time basis now and in the future.

#LI-EM1