Data Engineer – GCP Big Query Specialist

Infinite Computer Solutions; Dallas (TX); On-site; USD 80,000 - 120,000; Full time

Job summary

Join an innovative firm as a Data Engineer specializing in GCP BigQuery. In this exciting role, you will design and implement robust data pipelines, ensuring efficient ETL processes while optimizing SQL for performance. Work in a collaborative, multi-vendor environment where your expertise in Google Cloud Platform and data engineering will drive impactful results. If you're passionate about data and eager to tackle complex challenges, this opportunity offers a chance to make a significant difference in a forward-thinking organization.

Qualifications

• 5+ years of experience in data engineering and ETL pipeline development.
• Expertise in SQL optimization for BigQuery and relational databases.

Responsibilities

• Design and implement data pipelines for efficient ETL processes.
• Collaborate with cross-functional teams in a dynamic environment.

Skills

SQL optimization

ETL pipeline development

Data engineering

Python

Shell scripting

Java

Data quality frameworks

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

Google Cloud BigQuery

Cloud Composer (Apache Airflow)

Dataflow (Apache Beam)

BigQuery Transfer Service

Apache Airflow

GCP services

GitHub

Bitbucket

GitLab

Job description

Direct message the job poster from Infinite Computer Solutions

Senior Manager US TAG at Infinite Computer Solutions

Location: Miami/Tampa, FL /Irving, TX/New Jersey/Ashburn, VA

Job Summary:

The Data Engineer – GCP BigQuery Specialist will be responsible for designing and implementing efficient data pipelines that extract, transform, and load (ETL) data from various relational databases into Google Cloud BigQuery. The ideal candidate should have strong SQL optimization skills to ensure fast and efficient data processing and movement. They must be comfortable working in a multi-vendor, dynamic work environment and collaborating with cross-functional teams.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5+ years of experience in data engineering, ETL pipeline development, and SQL optimization.
• 3+ years of experience with Google Cloud Platform (GCP), specifically BigQuery.

Technical Skills:

• Expertise in SQL optimization for BigQuery and relational databases.
• Proficiency in ETL/ELT development using Cloud Composer (Apache Airflow), Dataflow (Apache Beam), and BigQuery Transfer Service.
• Experience with Python, Shell scripting, or Java for automation and data transformation.
• Strong knowledge of data partitioning, clustering, and materialized views in BigQuery.
• Familiarity with data orchestration tools like Apache Airflow, Cloud Composer, or dbt (Data Build Tool).
• Hands-on experience with GCP services such as Cloud Storage, Pub/Sub, Cloud Functions, and IAM.
• Understanding of data warehouse design, star schema modeling, and data normalization/denormalization.
• Experience with data quality frameworks and best practices for data validation and monitoring.
• Working knowledge of version control tools like GitHub, Bitbucket, or GitLab.

Preferred Qualifications (Must Have)

• GCP Professional Data Engineer Certification or BigQuery-related certifications.
• Experience with NoSQL databases (Bigtable, MongoDB, etc.).
• Knowledge of data streaming technologies (Kafka, Apache Flink, or Google Cloud Pub/Sub).

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Analyst
• Industries: Technology, Information and Media