Lead Data Engineer

TechDigital Group; Chicago (IL); On-site; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking an experienced Data Warehouse Lead to spearhead development activities and manage a talented team. In this pivotal role, you will leverage your advanced expertise in Snowflake SQL and Python to design and implement robust data solutions. Your responsibilities will include overseeing multiple projects, mentoring team members, and ensuring the quality and efficiency of data pipelines. This is an exciting opportunity to contribute to innovative data initiatives within a dynamic environment, where your leadership will directly impact the success of data-driven decision-making processes. If you are passionate about data and ready to take the lead, this position is perfect for you.

Qualifications

• 6-8 years of advanced SQL expertise in Snowflake SQL.
• Hands-on experience with data warehouse methodologies and ETL/ELT tools.

Responsibilities

• Lead data warehouse development activities and manage a team of developers.
• Design and build large scale datasets and efficient data pipelines.

Skills

Snowflake SQL

Data warehouse

Python

AWS-Lambda

ETL/ELT

Reporting and analytics

CICD

Query tuning

Tools

Informatica

Fivetran

DBT

Airflow

Atlassian Bitbucket

Bamboo

Job description

Job #: 406
Pay Rate: Not Specified
Job type: contractor
Location: Chicago, IL

Must have skill: Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL/ELT

Job Description:
Responsibilities:

1. Lead data warehouse development activities for a team, leading more than one project in parallel.
2. Assign data warehouse development tasks to a team of 1-6 developers (Onsite/Offshore).
3. Be a subject-matter expert (SME) in Data Warehouse domain and relevant business function.
4. Work with minimal supervision and provide status updates and escalation to leadership as appropriate.
5. Provide application support as part of an on-call rotation to work on resolving outages and user questions.
6. Review project objectives and determine best technology to apply.
7. Design and build large scale datasets for a wide range of consumer needs.
8. Build, test, and implement highly efficient data pipelines using a variety of technologies.
9. Develop best practice standards for solution design and data structures.
10. Analyze new data sources to understand quality, availability, and content.
11. Write technical design documentation.
12. Conduct peer code reviews.
13. Create and execute unit tests.
14. Support QA team during testing.
15. Mentor less experienced members of the development team.

Required Skills:

1. 6-8 years+ experience on Snowflake SQL – advanced SQL expertise
2. 6-8 years+ experience on data warehouse experiences – hands-on knowledge with the methods to identify, collect, manipulate, transform, normalize, clean, and validate data, star schema, normalization/denormalization, dimensions, aggregations etc.
3. 6-8 years+ experience working in reporting and analytics environments – development, data profiling, metric development, CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc.
4. 6 years+ on Python – advanced Python expertise
5. 6 years+ on any cloud platform – AWS preferred
6. Hands-on experience on AWS on Lambda, S3, SNS/SQS, EC2 is a bare minimum.
7. 6 years+ on any ETL/ELT tool – Informatica, Fivetran, DBT, Airflow etc. - Must
8. 6 years+ with developing functional metrics in any specific business.