Data Engineering Lead: BigQuery, Snowflake & Cloud Pipelines

Barkley; Illinois; On-site; USD 110,000 - 150,000; Full time

Job summary

The role emphasizes cross-functional collaboration, adherence to best practices, and ongoing learning of Snowflake and AWS services to support data delivery and analysis across Barkley’s teams.

Qualifications

• Bachelor's degree in Computer Science or Information Technology or equivalent.
• 3–4+ years of experience with SQL on large-scale datasets.
• Experience in Cloud-based data engineering, Snowflake design/implementation/operationalization.
• Proficiency in Python for data processing.
• Strong ETL pipeline development lifecycle experience; data warehousing with Python, BigQuery & GCP services.
• Experience in marketing/advertising data is a plus.
• Excellent problem-solving, communication and collaboration skills.
• Ability to work under pressure.

Responsibilities

• Design, develop, and maintain Google BigQuery data warehouse solutions.
• Implement data pipelines and ETL processes to support data integration and analytics.
• Collaborate with Data Suppliers (technical) for data feeds.
• Validate data delivery from Data Suppliers to ensure alignment with expectations; resolve issues.
• Work with cross-functional teams to gather requirements and deliver data solutions.
• Maintain operational documents to ensure currency and accuracy.
• Create and optimize data pipeline architecture; troubleshoot data integration and job scheduling issues.
• Stay current with trends in Snowflake and AWS technologies; provide training on best practices.

Skills

SQL

Python

ETL

Education

Bachelor's degree in Computer Science/Information Technology

Tools

Google BigQuery

Snowflake

AWS

GCP Services

Job description

The role emphasizes cross-functional collaboration, adherence to best practices, and ongoing learning of Snowflake and AWS services to support data delivery and analysis across Barkley’s teams.