GCP Data Engineer

CitiusTech Inc; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

CitiusTech is hiring a GCP Data Engineer to design and build an automated data discovery and lineage solution across multiple GCP projects. The role focuses on tracing data movement from sources through BigQuery, storing metadata centrally, and integrating lineage information with Collibra using OpenLineage APIs.

You will develop Python/SQL services to collect and validate metadata, implement secure cross-project access, and enable data quality checks with Dataplex.

Qualifications

• Strong hands-on experience with Python and SQL.
• Strong experience with Google BigQuery, including metadata and INFORMATION_SCHEMA.
• Experience with Dataflow and/or Cloud Data Fusion.
• Experience integrating with GCP APIs and REST APIs.
• Understanding of data lineage, metadata management, data quality, and data governance.
• Experience with GCP IAM, service accounts, and cross-project access.
• Experience designing and supporting production-grade data pipelines.

Responsibilities

• Build programmatic upstream and downstream data lineage across multiple GCP projects and BigQuery datasets.
• Discover datasets, tables, views, stored procedures, jobs, and other relevant data assets.
• Trace data movement and intermediate processing through BigQuery, Dataflow, Cloud Data Fusion, stored procedures, Cloud Storage, and related GCP services.
• Use GCP Data Lineage/Dataplex APIs, BigQuery INFORMATION_SCHEMA, job metadata, and other GCP APIs to collect and enrich lineage information.
• Capture available table-level and column-level lineage transformation details, and pipeline execution metadata.
• Extract data quality rules, scans, and results using Dataplex and related metadata services.
• Develop Python/SQL-based services and pipelines to collect, normalize, validate, and store metadata in BigQuery.
• Generate standardized OpenLineage JSON/events and integrate lineage metadata with Collibra.
• Implement secure cross-project access using GCP service accounts, IAM roles, and least-privilege principles.
• Build monitoring, logging, error handling, and audit capabilities for metadata and lineage processing.
• Support AI/agentic workflows for metadata analysis, lineage enrichment, and identification of lineage or data quality gaps.

Skills

Python

SQL

BigQuery

Dataflow

GCP APIs

Data lineage

IAM cross-project access

Production-grade pipelines

Education

Engineering Degree BE/ME/BTech/MTech/BSc/MSc

Tools

Dataplex

Collibra

OpenLineage

Cloud Run

Terraform

Job description

Contract to Hire with the Client (Visa Independent only)

Who we are: -

At CitiusTech, we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 healthcare technology professionals worldwide, CitiusTech powers healthcare digital innovation, business transformation, and industry-wide convergence for over 140 organizations through next-generation technologies, solutions, and products. We aim to accelerate the transition to a human-first, sustainable, and digital healthcare ecosystem with the world's leading Healthcare and life sciences organizations and our partners.

Here is an opportunity for you to make a difference and collaborate with global leaders to shape the future of healthcare and positively impact human lives.

Our vision: -

To inspire new possibilities for the health ecosystem with technology and human ingenuity.

What is in it for you?

As a GCP Data Engineer, you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards .

Summary:

We are looking for an experienced GCP Data Engineer to design and build an automated solution for data discovery, end-to-end lineage, metadata management, and data quality across multiple GCP projects. The solution will trace data movement from source systems through GCP processing layers, store metadata centrally in BigQuery, and integrate lineage information with Collibra using OpenLineage APIs

Responsibilities: -

• Build programmatic upstream and downstream data lineage across multiple GCP projects and BigQuery datasets.
• Discover datasets, tables, views, stored procedures, jobs, and other relevant data assets.
• Trace data movement and intermediate processing through BigQuery, Dataflow, Cloud Data Fusion, stored procedures, Cloud Storage, and related GCP services.
• Use GCP Data Lineage/Dataplex APIs, BigQuery INFORMATION_SCHEMA, job metadata, and other GCP APIs to collect and enrich lineage information.
• Capture available table-level and column-level lineage transformation details, and pipeline execution metadata.
• Extract data quality rules, scans, and results using Dataplex and related metadata services.
• Develop Python/SQL-based services and pipelines to collect, normalize, validate, and store metadata in BigQuery.
• Generate standardized OpenLineage JSON/events and integrate lineage metadata with Collibra.
• Implement secure cross-project access using GCP service accounts, IAM roles, and least-privilege principles.
• Build monitoring, logging, error handling, and audit capabilities for metadata and lineage processing.
• Support AI/agentic workflows for metadata analysis, lineage enrichment, and identification of lineage or data quality gaps.

Experience: -

Location: -

Educational Qualifications: -

• Engineering Degree - BE/ME/BTech/MTech/BSc/MSc.
• Technical certification in multiple technologies is desirable.

Mandatory skills: -

• Strong hands-on experience with Python and SQL
• Strong experience with Google BigQuery, including metadata and INFORMATION_SCHEMA`
• Experience with Dataflow and/or Cloud Data Fusion
• Experience integrating with GCP APIs and REST APIs
• Understanding of data lineage, metadata management, data quality, and data governance
• Experience with GCP IAM, service accounts, and cross-project access
• Experience designing and supporting production-grade data pipelines

Good to have:

• Dataplex / GCP Data Lineage API
• Collibra and OpenLineage
• Cloud Run and Cloud Storage
• Terraform / Infrastructure as Code
• Vertex AI / agentic or LLM-based workflows
• SQL parsing and transformation dependency analysis
• Enterprise data governance and metadata platforms

Life at CitiusTech

We focus on building highly motivated engineering teams and thought leaders with an entrepreneurial mindset, centered on our core values of Passion, Respect, Openness, Unity, and Depth (PROUD) of knowledge. Our success lies in creating a fun, transparent, non-hierarchical, diverse work culture that focuses on continuous learning and work-life balance.

Rated by our employees as the "Great Place to Work for" according to the Great Place to Work survey. We offer you a comprehensive set of benefits to ensure that you have a long and rewarding career with us.

Our EVP

Be You Be Awesome is our EVP and it reflects our continuing efforts to create CitiusTech as a great place to work where our employees can thrive, both personally and professionally. It encompasses the unique benefits and opportunities we offer to support your growth, well‑being, and success throughout your journey with us and beyond. Together with our clients, we are solving some of the greatest healthcare challenges and positively impacting human lives. Welcome to the world of Faster Growth, Higher Learning, and Stronger Impact.