GCP Data Engineer: BigQuery & Dataflow Expert

Artifintech; Tampa (FL); In loco; USD 110.000 - 150.000; Tempo pieno

Descrizione del lavoro

Artifintech is seeking an experienced GCP Data Engineer to design and maintain scalable data pipelines on Google Cloud Platform. You will work with large datasets, build ETL/ELT workflows, and optimize data warehouses to support analytics and BI initiatives.

You will implement real-time ingestion with Pub/Sub, orchestrate workflows with Cloud Composer, and apply best practices for data modeling, security, and cost management while collaborating with analysts and ML teams.

Competenze

• Experience with ETL/ELT development and data quality validation.
• Strong SQL optimization and data warehousing concepts.
• Hands-on GCP experience across data services (BigQuery, Dataflow, Pub/Sub).
• Experience with Apache Beam, Airflow/Cloud Composer for orchestration.
• Security best practices: IAM, encryption, service accounts.
• Version control with Git; familiarity with CI/CD and IaC.

Mansioni

• Design scalable batch and streaming data pipelines on GCP.
• Ingest data from APIs, databases, files, and streams into BigQuery.
• Develop data transformation logic with SQL, Python, Beam, and Spark where applicable.
• Create and maintain BigQuery datasets, tables, and analytical models.
• Orchestrate workflows with Cloud Composer/Airflow DAGs.
• Implement real-time processing with Pub/Sub and Dataflow.
• Optimize queries, storage, and cloud costs.
• Build data quality checks and data lineage governance.
• Collaborate with analysts, BI developers, and ML teams.
• Maintain technical documentation and support production releases.

Conoscenze

BigQuery

Python

Advanced SQL

Apache Beam

Cloud Dataflow

Cloud Composer

Pub/Sub

Data Modeling

ETL/ELT

IAM/Security

Git/CI/CD

Spark

Formazione

Bachelors or higher in CS/IS or related field

Descrizione del lavoro

Artifintech is seeking an experienced GCP Data Engineer to design and maintain scalable data pipelines on Google Cloud Platform. You will work with large datasets, build ETL/ELT workflows, and optimize data warehouses to support analytics and BI initiatives.

You will implement real-time ingestion with Pub/Sub, orchestrate workflows with Cloud Composer, and apply best practices for data modeling, security, and cost management while collaborating with analysts and ML teams.