Data Engineer, Expert

PG&E; Oakland (CA); Hybrid; USD 140.000 - 238.000; Vollzeit

Zusammenfassung

PG&E is seeking an Expert Data Engineer to lead the development of a modern, cloud-native data platform for vegetation management, regulatory compliance, and analytics. You will build robust ELT pipelines in Snowflake using Airflow, Informatica, and AWS services, integrating Salesforce, SAP, ArcGIS, and remote sensing data.

The role spans structured to unstructured data, with a hybrid work arrangement and location in PG&E's Service Territory.

Qualifikationen

• BA/BS in computer science, MIS or related field, or equivalent experience.
• 7 years of data engineering/ETL experience with tools like Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE.
• Experience with multiple data engineering/ETL ecosystems.
• Experience deploying ML models.

Aufgaben

• Design, build, and maintain scalable data pipelines using Airflow, Informatica, AWS services, and Snowflake.
• Collaborate with cross-functional teams to deliver analytics-ready datasets.
• Implement and optimize data lakehouse architectures across Bronze, Silver, and Gold in Snowflake.
• Support deployment of ML models with feature pipelines and data flows.
• Apply software engineering best practices: CI/CD, version control, unit testing, IaC.
• Monitor data pipelines for quality, lineage, and governance across environments.
• Mentor junior engineers and contribute to architecture decisions.
• Communicate technical concepts to technical and non-technical audiences.

Kenntnisse

SQL

Python/Scala/Java

ETL/ELT

Cloud AWS

Snowflake

Airflow

CI/CD

Data Lakehouse

Ausbildung

BA/BS in CS or MIS or related

Master's degree (Desired)

Tools

Snowflake

Airflow

Informatica

AWS (Step Functions, Fargate, Lambda, DynamoDB, S3)

SageMaker or Foundry

Salesforce (OneVM)

SAP

ArcGIS

Jobbeschreibung

Requisition ID# 175376

Job Category: Information Technology

Job Level: Individual Contributor

Business Unit: Energy Delivery

Work Type: Hybrid

Job Location: Oakland

Position Summary

PG&E is seeking an Expert Data Engineer to lead the development of a modern, cloud-native data platform that supports vegetation management operations, regulatory compliance, and advanced analytics. This role is central to transforming fragmented legacy systems into a unified, audit-ready Snowflake Data Lakehouse, enabling scalable, secure, and transparent data access across the organization.

The engineer will design and implement robust ELT pipelines using Snowflake, Airflow, Informatica, and a suite of AWS services including Step Functions, Fargate, Lambda, DynamoDB, and S3. The role spans structured, semi-structured, and unstructured data domains, integrating sources such as Salesforce (OneVM), SAP, SharePoint, ArcGIS, and remote sensing imagery (LiDAR, orthoimagery, surface reflectance, etc.).

This position is hybrid, working from your remote office and your assigned work location based on business need. The assigned work location will be within the PG&E Service Territory.

PG&E is providing the salary range that the company in good faith believes it might pay for this position at the time of the job posting. This compensation range is specific to the locality of the job. The actual salary paid to an individual will be based on multiple factors, including, but not limited to, specific skills, education, licenses or certifications, experience, market value, geographic location, collective bargaining agreements, and internal equity. Although we estimate the successful candidate hired into this role will be placed towards the middle or entry point of the range ($140,000 - $190,000), the decision will be made on a case-by-case basis related to these factors. This job is also eligible to participate in PG&E's discretionary incentive compensation programs.

Bay Area Minimum: $140,00

Bay Area Mid-Point: $189,000

Bay Area Maximum: $238,000

Job Responsibilities

• Design, build, and maintain scalable data pipelines using tools such as Airflow, Informatica, AWS services, and Snowflake to support ingestion, transformation, and curation of structured, semi-structured, and unstructured data.
• Collaborate with cross-functional teams - including data scientists, analysts, and business stakeholders - to understand data requirements and deliver high-quality, analytics-ready datasets.
• Implement and optimize data lakehouse architectures, ensuring efficient data flow across Bronze, Silver, and Gold layers in Snowflake.
• Support the deployment of machine learning models by enabling feature pipelines, model input/output data flows, and integration with platforms like SageMaker or Foundry.
• Apply software engineering best practices such as version control, CI/CD, unit testing, and infrastructure-as-code to ensure reliable and maintainable data workflows.
• Monitor and troubleshoot data pipelines, ensuring data quality, lineage, and governance standards are met across all environments.
• Mentor junior engineers and contribute to architectural decisions, code reviews, and knowledge sharing within the team.
• Communicate technical concepts and project updates clearly to both technical and non-technical audiences.

Background Qualifications

Minimum

• BA/BS in computer science, Management Information Systems or related field of study, or equivalent experience
• 7 years of experience with data engineering/ETL ecosystems such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE.
• Experience with multiple data engineering/ETL ecosystems.
• Experience with machine learning algorithm deployment.

Desired

• • Master's degree in Computer Science, Management Information Systems, or related field of study, or equivalent experience
  • Hands‑on experience in data engineering, including:
    • Designing and building scalable ETL/ELT pipelines for structures, semi‑structures, and unstructured data.
    • Working with cloud data platforms such as Snowflake Databricks, or AWS Redshift
    • Using data integration tools like Informatica or AWS Glue
    • Developing in distributed data processing frameworks such as Apache Spark
• Proficiency in SQL and at least one programming language such as: Python, Scala, or Java
• Ability to collaborate in cross-functional teams and communicate technical concepts to non‑technical stakeholders
• Strong understanding of software engineering best practices, including:
  • Unit testing and test‑driven development (TDD)
  • Continuous integration/Continuous Deployment (CI/CD)
  • Source control using tools like Git and platforms like GitHub
• Experience with cloud services (preferably AWS), including:
  • S3, Lambda, Step Functions, Fargate, DynamoDB, SNS/SQS, and CloudWatch.
• Experience with infrastructure‑as‑code tools (e.g., Terraform, CloudFormation).
• Experience deploying and operationalizing machine learning models in production environments]
• Familiarity with business intelligence tools such as PowerBI, Tableau, or Foundry for data visualization and reporting.
• Experience working with geospatial data and tools such as ArcGIS
• Experience with data cataloging, metadata management, and data lineage tools such as informatica and Collibra.