GCP Architect

TechDigital Group; Secaucus (NJ); On-site; USD 90,000 - 140,000; Full time

Job summary

An established industry player is seeking a Data Engineer with over 8 years of experience in data analytics and engineering. This role involves designing and maintaining ETL pipelines, utilizing GCP data services, and collaborating with various teams to enhance data models for business intelligence tools. The ideal candidate will possess strong coding skills in SQL, Python, or Java and be proficient in managing data quality and integrations. Join a dynamic team that values innovation and collaboration, where your contributions will directly impact the company's data strategy and success.

Qualifications

• 8+ years of experience in Data Engineering or L3 support in data Analytics.
• Experience with Data Lake and ETL pipeline development and design.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines for seamless data flow.
• Collaborate with analytics and business teams to enhance data models.

Skills

Data Engineering

ETL Pipeline Development

GCP Data Services

SQL

Python

Java

Data Modelling

Version Control (GIT)

Data Quality Monitoring

API Integrations

Education

Bachelor's Degree in Computer Science

Tools

GCP BigQuery

Apache Kafka

DBT

Cloud DataProc

Cloud Dataflow

Cloud Dataprep

Apache Beam/Composer

Job description

General Description

• 8+ years of experience in Data Engineering or L3 level support in data Analytics
• Experience with Data Lake, data warehouse ETL pipeline development and design
• Hands-on experience with GCP data and analytics services such as Cloud DataProc, Cloud Dataflow, Cloud Dataprep, Apache Beam/Composer, Cloud BigQuery
• Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines for seamless data flow using DBT or GCP BigQuery
• Data Modelling: Implement and manage data models in BigQuery to support analytics and reporting
• Version Control: Use GIT for managing changes in data pipelines, schemas, and code
• Strong coding skills in SQL, Python, or Java

Technical Requirements

• Create and support data models and implement ETL processes based on business needs
• Monitor data quality to ensure accuracy and availability for stakeholders
• Maintain company data lake (UDP) and regional platforms data streaming from Apache Kafka
• Develop scalable data pipelines and API integrations for increasing data volumes
• Collaborate with analytics and business teams to enhance data models for BI tools
• Write unit/integration tests, document work, and contribute to engineering wiki
• Troubleshoot data issues through analysis
• Work with frontend/backend engineers, product managers, and analysts
• Design data integrations and data quality frameworks
• Evaluate open source and vendor tools for data lineage
• Develop long-term data platform strategies in collaboration with business units
• Plan and maintain data architectures aligned with business needs
• Support digital projects by understanding solutions and data structures
• Create reports, dashboards, and datasets for business users
• Maintain existing reports and dashboards

Soft Skills

• Excellent communication and presentation skills
• Problem-solving and critical thinking abilities
• Project management and organizational skills
• Team collaboration and leadership
• Market awareness and client focus

Certifications (Optional)

• Google Professional Data Engineer
• Google Professional Data Architect

Educational Qualifications

Bachelor's Degree in Computer Science, Computer Engineering, or related field