Data Engineering, Senior Advisor

Thomson Reuters Markets Espana SL.; Pomona (CA); Hybrid; USD 130,000 - 180,000; Full time

Job summary

Southern California Edison seeks a Data Engineering, Senior Advisor to design and maintain data pipelines, data warehouses, and governance across T&D. You will work with Palantir Foundry, Snowflake and cloud platforms to deliver scalable analytics solutions.

You will collaborate with data science and engineering teams, optimize ETL processes, and drive data quality and cost efficiency. This role requires strong Python/SQL skills and experience with large datasets in a utility context.

Qualifications

• Bachelor's degree required or equivalent; hands-on data engineering experience.
• 10+ years of experience processing large data sets, with transformation, aggregation and filtering.
• Experience in data governance, data architecture, and data quality across complex data systems.

Responsibilities

• Manages and scales data pipelines from internal and external data sources to support new product launches and drive data quality across data products.
• Facilitates data engineering activities covering data acquisition, extraction, normalization, transformation, management, and manipulation of large and complex data sets.
• Keeps abreast of new data engineering, big data and data science techniques; develops and promotes data engineering best practices, standards and guidelines.
• Works with subject matter experts to design front-end applications with data models and data pipelines.
• Provides governance and oversight of data assets and environments, with data asset naming conventions.

Skills

Python

SQL

ETL pipelines

Data governance

Data warehousing

Cloud platforms

APIs

Education

Bachelor's degree in Computer Science, Information Systems, Engineering or related field

Tools

Palantir Foundry

Snowflake

SAP Datasphere

Azure Data Factory

Apache Airflow

Job description

Join the Clean Energy Revolution

Become a Data Engineering, Senior Advisor at Southern California Edison (SCE) and build a better tomorrow. In this job, you’ll be responsible for developing data integration pipelines (ETL) sourcing from various databases and systems. The senior advisor will develop programs using coding languages (i.e. Python, SQL) and/or low-code environments (i.e., Palantir Foundry) to create analyses and applications for stakeholders throughout Transmission & Distribution (T&D). The candidate is therefore expected to work on data governance, data architecture, data engineering solutions, and best practices for analyzing very large datasets. Additionally, the candidate will perform data mining activities to derive insights, work with cloud OLAP systems (e.g., Snowflake), and keep abreast of new and current data engineering techniques.

As a Data Engineering, Senior Advisor, your work will help power our planet, reduce carbon emissions and create cleaner air for everyone. Are you ready to take on the challenge to help us build the future?

Day In The Job

• Manages and scales data pipelines from internal and external data sources to support new product launches and drive data quality across data products (Palantir Foundry, Snowflake, SAP Datasphere).
• Facilitates data engineering activities covering data acquisition, extraction, normalization, transformation, management, and manipulation of large and complex data sets.
• Keeps abreast of new and current data engineering, big data and data science techniques. Researches methods, techniques, and new practices; develops and promotes data engineering best practices, standards and guidelines.
• Works closely with subject matter experts to design and develop front-end applications with data models and data pipelines supporting the applications.
• Provides governance and oversight of data assets, data environments and relevant data procedures, with the proactive planning and enforcement of data asset naming conventions.
• Builds and maintains data pipelines using big data processing technologies to process and analyze large datasets; uses ETL processes on the internal cluster.
• Develops and maintains data warehouse schema and data models, ensuring data consistency and accuracy.
• Ensures ongoing alignment of technical and business strategies based on changing business and technology drivers and risks.
• Creates advanced visualizations and tools to provide insight, drives action, and supports work throughout the business.
• Identifies and designs Data-as-a-Service candidates for improved data availability and consumption.

Responsibilities

• Conceptualizes and owns the data architecture on behalf of the energy team in collaboration with data science and engineering teams.
• Improves performance by optimizing computing time to process the streaming data and saves cost to company by optimizing cluster run time.
• Identifies opportunities for building of value-added datasets to facilitate realization of enterprise use cases and for optimizing cloud costs.
• Establishes transactional data orchestration, data lake, reporting platform strategy and roadmap formulation for data intensive enterprise transformation programs.
• Delivers metadata management implementation to improve data governance maturity and data ownership. Oversees data platform to ensure that the service delivery is efficient and business SLAs around uptime, performance and capacity are met.
• Designs Enterprise Data Lake to provide support for various uses cases including Analytics, processing, storing, and reporting of voluminous, rapidly changing data.
• Designs and develops end-to-end data pipelines for the organization, resulting in improved data quality and reduced data processing time.
• Supports Data Scientists with their development of predictive and other models, with respect to large scale datasets to address various business problems through leveraging advanced statistical modeling, machine learning and deep learning.
• Contributes to data dictionary and data mapping from sources to the target in SCIM Data Model.
• A material job duty of all positions within the Company is ensuring the protection of all its physical, financial and cybersecurity assets, and properly accessing and managing private customer data, proprietary information, confidential medical records, and other types of highly sensitive information and data with the highest standards of conduct and integrity.

Minimum Qualifications

• Bachelor's Degree in Computer Science, Information Systems, Engineering, Statistics/ Mathematics or equivalent STEM major.
• Ten or more years of experience in data processing large data sets, hands-on with data transformation, aggregation, and filtering.

Preferred Qualifications

• Demonstrated experience building and maintaining APIs and ETL pipelines using tools like Python, SQL, Apache Airflow, Azure Data Factory, or similar platforms
• High competency with systems like Palantir Foundry, Snowflake,AWSor similar platforms
• Additional certifications such as Palantir Foundry Data Engineer, Azure Data Engineer, Certified Data Management Professional, SnowPro Advanced, etc.
• Understanding of cloud-based data storage and architecture
• Proven ability to implement data validation, metadata management, and ensure consistency and accuracy across systems
• Experience working in the electric utility industry or with infrastructure investment planning
• Experience working collaboratively with cross-function stakeholders such as IT, Engineering, Planning and business teams to gather requirements and deliver tailored data solutions.

Additional Information

• This position’s work mode ishybrid.The employee will report to an SCE facility for a set number of days with the option to work remotely on the remaining days. Unless otherwise noted, employees are required to work andreside in the state of California. Further details of this work mode will be discussed at the interview stage.The work mode can be changed based on business needs.
• Visit ourCandidate Resourcepage to get meaningful information related to benefits, perks, resources, testing information, hiring process, and more!
• Qualified applications with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
• Position will require up to 25% traveling and being out in the field throughout the SCE service territory.
• Relocation does not apply to this position.

About Southern California Edison

The people at SCE don't just keep the lights on. Our mission is so much bigger. We’re fueling the kind of innovation that’s changing an entire industry, and quite possibly the planet. Join us and create a future with cleaner energy, while providing our customers with the safety and reliability they demand. At SCE, you’ll have a chance to grow personally and professionally, making a real impact in Southern California and around the world.

Southern California Edison is a proud Equal Opportunity Employer, including disability and protected veteran status.

We are committed to ensuring that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodations at [e-mail] or [phone] and select option 2.