Systems Manager, Data Engineering, Enterprise Data & Analytics

Vertex Solutions Inc.; New York (NY); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Hybrid work

Salary + bonus

Benefits

Job summary

Vertex Solutions Inc. in New York, NY, seeks an experienced Systems Manager, GCP Data Engineering, to lead a hands-on team responsible for enterprise‑scale data pipelines powering the EDAP platform.

You will guide architecture, implement data lifecycle stages on GCP (Bronze–Gold), and partner with governance, FinOps, and business stakeholders in a hybrid work model.

Qualifications

• Master's or Bachelor's degree with relevant full‑time experience as specified.
• Experience leading data engineering teams in enterprise data platforms.
• Deep hands‑on knowledge of GCP data services and pipeline design.

Responsibilities

• Lead, mentor, and develop a high‑performing GCP data engineering team.
• Guide architecture, review code, and assist with prototyping and debugging.
• Oversee ingestion, transformation, and curation across Bronze–Gold layers.
• Deliver secure exposure layers (views, datasets, APIs) for business use.
• Ensure pipeline reliability, cost efficiency, and FinOps collaboration.
• Define metrics, SLAs, KPIs for enterprise data platforms.
• Collaborate with stakeholders across data, ops, and migration workstreams.

Education

Master's Degree in Computer Science, Engineering, Math, Business, or a technology-centric field AND 6+ years

Bachelor's Degree in Computer Science, Engineering, Math, Business, or a technology-centric field AND 8+ years

Master's Degree in Computer Science, Engineering, Math, Business, or a technology-centric field AND 6+ years (Preferred)

Tools

BigQuery

Dataflow

Dataproc

Pub/Sub

Dataplex

Cloud Storage

SQL

Python

Spark

Airflow

Composer

Terraform

Azure DevOps

Job description

Immediate FT opening with our direct client in NYC

This is a hybrid role offering salary plus bonus and benefits

3 days a week on site required

The Systems Manager, GCP Data Engineering, Enterprise Data & Analytics, leads the hands-on technical team responsible for designing, building, and maintaining the enterprise-grade data pipelines that power the Enterprise Data & Analytics Platform (EDAP). This role manages a highly skilled team of engineers who own the core stages of the data lifecycle on Google Cloud Platform (GCP)—including data transfer, ingestion, transformation, curation, exposure, and activation.

Responsibilities

• Team Leadership & Development: Lead, mentor, and develop a technical, high-performing team of GCP data engineers (Band 2 & 3), establishing work plans, setting performance metrics, and managing day-to-day agile execution.
• Hands-on Technical Leadership: Maintain deep technical expertise to guide architecture, review code, and directly assist with prototyping, troubleshooting, and unblocking complex pipeline issues.
• Data Ingestion & Transfer: Oversee the secure onboarding of diverse batch and streaming datasets from legacy on-premises systems and cloud sources into the landing zone of the platform.
• Data Transformation & Curation: Drive the design and development of performant, automated data transformations, establishing trusted, clean datasets via a structured medallion architecture (Bronze, Silver, Gold layers) using tools such as SQL, Python, and Dataform.
• Data Exposure & Activation: Lead the delivery of secure exposure layers (views, authorized datasets, APIs) that surface curated data products to business consumers, dashboard interfaces, and advanced AI systems (Enterprise Gemini/Vertex AI / Model & Agent Garden).
• Pipeline Reliability & FinOps: Establish monitoring, alerting, and performance-tuning frameworks to ensure data pipelines are resilient, highly available, and cost-efficient. Coordinate closely with FinOps to identify spend anomalies and optimize GCP query and storage costs.
• Governance & Compliance Alignment: Implement and operationalize data quality rules, data classification, lineage tracking, and access controls in tight integration with the Data Governance team, ensuring compliance with privacy rules (PII, NERC CIP).
• Collaborative Partnering: Act as the key liaison between data engineering, platform operations, legacy migration workstreams, and business stakeholders to align platform capabilities with immediate use cases.

Qualifications

• Required Education/Experience: Master's Degree in Computer Science, Engineering, Math, Business, or a technology-centric field AND a minimum of 6 years of relevant full-time work experience; OR Bachelor's Degree in Computer Science, Engineering, Math, Business, or a technology-centric field AND a minimum of 8 years of relevant full-time work experience.
• Preferred Education/Experience: Master's Degree in Computer Science, Engineering, Math, Business, or a technology-centric field AND a minimum of 6 years of relevant full-time work experience.

Required Skills

• Demonstrated experience in hands-on data engineering, pipeline architecture, or data platform operations, including time spent leading and managing technical teams.
• Extensive hands-on experience designing, developing, and operating large-scale data pipelines on Google Cloud Platform, using services like BigQuery, Dataflow, Dataproc, Pub/Sub, Dataplex, and Cloud Storage.
• Proficient in SQL, Python, or Spark for large-scale data processing and data modeling.
• Solid experience with ETL/ELT pipeline design, workflow orchestration (e.g., Composer/Airflow), CI/CD pipelines (Azure DevOps preferred), and Infrastructure-as-Code (Terraform).
• Experience defining and managing operational metrics, SLAs, and KPIs for enterprise-level data integration platforms.

Preferred Skills

• Familiarity with implementing data governance frameworks, metadata management, and data quality testing tools (e.g., Great Expectations, Dataplex).
• Background in utilities, energy, or other regulated industries with exposure to NERC CIP compliance, security protocols, and data classification.
• Experience supporting migration initiatives moving data workloads off legacy ecosystems (such as Azure, Databricks, and C3.ai) onto GCP.

Vertex Solutions Inc. is an Equal Opportunity Employer and does not discriminate on the basis of race, color, creed, national origin, ancestry, religion, age, citizenship, sex, marital or veteran status, disability or handicap, sexual orientation or any other basis prohibited by applicable law.