GCP Data Architect: Scalable Analytics & ML Pipelines

Quantum Technologies. LLC; San Jose, Northern (CA, KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Quantum Technologies LLC in San Jose, CA seeks a data engineer to design, build, and maintain scalable data infrastructure that powers business intelligence, analytics, and machine learning initiatives. You will work autonomously in a dynamic cloud environment, driving projects from concept to production with a strong bias for reliability and performance.

The role emphasizes creating clean data models, building robust pipelines, and collaborating with product managers and business teams to

Qualifications

• Hands-on experience with Google Cloud Platform services, especially BigQuery and data ingestion.
• Strong SQL skills for complex querying and performance tuning.
• Proficiency in Python and data engineering libraries for data pipelines.
• Experience with data pipeline orchestration tools like Airflow or Cloud Composer.
• Familiarity with CI/CD practices and Git-based deployment workflows.

Responsibilities

• Design and optimize clean, scalable analytical datasets for reporting and model development.
• Architect, build, and maintain robust data pipelines for BI, analytics, and ML needs.
• Implement Big Data solutions for batch and real-time streaming analytics.
• Collaborate with product managers and business teams to translate data requirements into technical solutions.

Tools

BigQuery

Cloud Storage

Cloud Dataflow/Beam

Pub/Sub

Python

SQL

Airflow/Cloud Composer/Dagster

Git

CI/CD

Job description

Quantum Technologies LLC in San Jose, CA seeks a data engineer to design, build, and maintain scalable data infrastructure that powers business intelligence, analytics, and machine learning initiatives. You will work autonomously in a dynamic cloud environment, driving projects from concept to production with a strong bias for reliability and performance.

The role emphasizes creating clean data models, building robust pipelines, and collaborating with product managers and business teams to