Operations Data Engineering Analyst

The Southern Company; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

The Southern Company is seeking an Operations Data Engineering Analyst to join the M&D Center. You will support PI/IP.21 historian environments and drive the data journey from raw sensor ingestion to AI-ready datasets for real-time monitoring and advanced analytics.

Collaborating with PI/IP.21 administrators, AI/ML analysts, and renewable operations, you will help deliver high-quality data, build dashboards, and enable downstream analytics across gas, solar, wind, and storage assets.

Qualifications

• PI System Hands-On: 2-3 years with AVEVA PI, AF, PI Vision, and interfaces/connectors.
• Python: Proficient in data extraction, transformation, and automation.
• SQL: Proficient in querying and data manipulation across relational DBs.
• Databricks: Familiar with ETL/ELT pipelines, Delta Lake, and feature stores.
• Data quality governance: Monitoring, validation, remediation, and surrogation.

Responsibilities

• Tag Management: create, modify, and decommission PI/IP.21 tags.
• AF Configuration: manage AF elements, attributes, templates, hierarchies.
• AF Analytics Deployment: develop and deploy AF Analytics in test/production.
• Data Quality Monitoring: monitor and remediate data quality issues.
• PI Vision Development: design and maintain real-time dashboards.
• Site Onboarding: integrate new sites into PI/IP.21 system.
• Data Query Support: enable self-service data access with PI DataLink, Python, SQL.
• Troubleshooting: diagnose data flow issues and escalate when needed.
• Dataset Curation: clean, deduplicate, align timestamps for AI-ready data in Databricks.
• ML data requirements engineering: translate model needs into data tasks.
• Model-ready validation: verify datasets against model inputs.
• Pipeline monitoring: ensure reliability and scalability of data pipelines.
• Collaboration: work with PI Admin, AI/ML team, engineers and plant personnel.
• Documentation: maintain configuration and SOP docs.
• Learning: stay current with PI, Databricks, AI/ML pipelines.

Skills

PI System

Python

SQL

Databricks

AF Analytics

PI Vision

Data Quality Monitoring

Power BI

Tableau

Education

Bachelor's degree in Engineering or related field

Master's degree in Engineering / Data Science or related field (preferred)

Tools

AVEVA PI System

AspenTech IP.21

PI DataLink

PI Web API

PI Connect

Databricks

Power BI

Job description

OPERATIONS DATA ENGINEERING ANALYST

JOB SUMMARY

This position will function as part of the Southern Power Monitoring & Diagnostics (M&D) Center, which provides remote monitoring and diagnostic support to the SPC fleet of gas, solar, wind, and energy storage assets.

The Operations Data Engineering Analyst supports both operational data infrastructure and AI/ML data readiness. The role assists the PI System Administrator with daily operation, maintenance, and expansion/migration of SPC’s AVEVA PI and AspenTech IP.21 historian environments, including tag management, Asset Framework (AF) configuration, analytics deployment, PI Vision development, data quality monitoring, and proactive remediation. The role also extracts, transforms, curates, and delivers clean, structured datasets from PI and IP.21 into downstream data engineering platforms such as Databricks to support M&D’s growing AI and machine learning portfolio, including iSight anomaly detection, predictive analytics models, and AI agents.

In short, this role owns the data journey from raw sensor ingestion in PI through curated, AI-ready datasets – ensuring the M&D team always has trusted, high-quality, well-engineered data to power both real-time monitoring and advanced analytics.

This position will closely interface with the Aveva PI/ AspenTech IP.21 System Administrator, M&D Analysts, AI/ML Analysts, Renewable Performance Engineers, Renewable, Gas, and Commercial Operations, the SPC Technology Organization, SCADA teams, and plant personnel.

MAJOR JOB RESPONSIBILITIES

PI/IP.21 System Support

• Tag Management — Support the PI/IP.21 Administrator in the creation, modification, scaling, and decommissioning of PI/IP.21 tags across gas, solar, wind, and energy storage assets. Ensure tag naming conventions, point types, and compression settings are consistent with fleet-wide standards.
• Asset Framework (AF) Configuration — Create, modify, and delete AF elements, attributes, templates, and hierarchies to reflect fleet changes (new sites, equipment swaps, decommissions). Maintain AF structure integrity across all OEMs (solar inverters, wind turbines, gas turbines, batteries, and BOP equipment).
• AF Analytics Deployment — Develop, test, and deploy PI AF Analytics (calculated attributes, rollup expressions, event frames) in test and production environments. Validate analytic outputs against expected results prior to production deployment.
• Data Quality Monitoring & Proactive Remediation — Continuously monitor data quality across PI and IP.21 platforms — identifying stale tags, flatlined signals, bad values, communication failures, scaling errors, and missing data. Proactively remediate issues before they impact downstream analytics, dashboards, or AI models. Support data surrogation processes where needed.
• PI Vision Development & Maintenance — Design, develop, and maintain real-time PI Vision screens and dashboards for fleet monitoring, equipment health, data quality, and KPI tracking. Update displays as new sites are onboarded or fleet configurations change.
• Site Onboarding Support — Assist the PI/IP.21 Administrator with integrating new generation and storage sites into the PI/IP.21 System, including interface/connector configuration, tag provisioning, AF buildout, initial data validation, and PI Vision screen creation.
• Data Query Support for Other Teams — Serve as a resource for operations, performance, and analytics teams who need to extract data from PI/IP.21. Provide support and guidance using PI DataLink, IP.21 Excel Connector, Python, SQL, PI Web API, and PI Connect to enable self-service data access and integration with downstream tools.
• Troubleshooting — Assist in diagnosing and resolving data flow issues, interface communication failures, archive gaps, and system errors within the PI and IP.21 environments. Escalate infrastructure-level issues to the PI/IP.21 Administrator or IT as appropriate.

Data Engineering & AI/ML Data Readiness

• Dataset Curation & Cleaning — Build and maintain repeatable data curation pipelines that clean, validate, deduplicate, align timestamps, handle missing values, and resolve data quality issues — producing trusted, well-documented datasets for AI/ML model training and inference in Databricks.
• AI/ML Data Requirements Engineering — Partner directly with the AI/ML Analyst to understand model input requirements, feature definitions, labeling schemas, data frequency needs, and quality thresholds. Translate these requirements into actionable data engineering tasks and deliver datasets that meet model specifications.
• Model-Ready Data Validation — Validate curated datasets against AI model input specifications — checking for completeness, balance, feature drift, outliers, and schema compliance in/outside Databricks. Flag and resolve data issues before they enter training or inference pipelines.
• Pipeline Monitoring & Maintenance — Monitor health and performance of data pipelines, alerting on failures, latency, or data quality degradation. Continuously improve pipeline efficiency, reliability, and scalability as the fleet and AI use cases grow.

Collaboration & Continuous Improvement

• Cross-Functional Collaboration — Build and maintain strong working relationships with the PI/IP.21 Administrator, AI/ML Analysts, M&D Analysts, Renewables Performance Engineers, Renewable, Gas, and Commercial Operations, SCADA teams, Technology Organization developers, and plant personnel.
• Documentation — Maintain thorough documentation of PI configurations, AF structures, tag inventories, data pipeline architectures, dataset catalogs, and standard operating procedures.
• Best Practices & Lessons Learned — Incorporate industry best practices, lessons learned, and feedback into daily operations. Participate in fleet-wide standardization efforts and data governance initiatives.
• Continuous Learning — Stay current on AVEVA PI System updates, data engineering best practices (Databricks), AI/ML pipeline methodologies, and relevant industry trends.

JOB REQUIREMENTS

Education

• Bachelor's degree in Engineering (Electrical, Computer, Instrumentations and Controls), Computer Science, Data Science, or a related technical field — required.
• Master's degree in Engineering (Electrical, Computer, Instrumentation & Controls), Computer Science, Data Science, or a related technical field - preferred.

Experience

Required

• PI System Hands-On: 2-3 years of hands-on experience with AVEVA PI System, including PI Data Archive, PI Asset Framework (AF), PI Vision, and PI Interfaces/Connectors.
• Python: Proficient in Python for data extraction, transformation, pipeline development, and automation (Pandas, NumPy, Web API calls, scripting).
• SQL: Proficient in SQL for data querying, integration, and manipulation across relational databases and data platforms.
• Data Engineering Platform: Familiar with Databricks, Apache Spark, or equivalent data engineering platforms — including ETL/ELT pipeline development, Delta Lake, and feature store concepts.
• Data Quality & Governance: Experience with data quality monitoring, validation, remediation, and surrogation in an operational/industrial context.

Preferred

• PI Data Access Tools: Working knowledge of PI DataLink, PI Web API, and PI Connect for data extraction and downstream integration.
• PI AF Analytics: Experience developing and deploying AF Analytics, calculated attributes, event frames, and notifications.
• AI/ML Pipeline Understanding: Foundational understanding of ML model deployment pipelines — including feature engineering, data labeling, model training data requirements, and inference data delivery.
• Data Visualization / BI: Experience with Power BI, Tableau, or similar BI tools for dashboard development and operational reporting.
• Energy Sector: Experience in power generation, renewables, or utilities operations.
• Other Data Historians: Experience with AspenTech IP.21, dataPARC, eDNA etc.
• SCADA Systems: Familiarity with Ignition/other SCADA systems.
• Communications Protocols: OPC DA/UA, DNP3, Modbus protocols and data acquisition architectures.
• PI Accreditation: AVEVA / OSIsoft PI System accreditation.

BEHAVIORAL ATTRIBUTES

• Must be able to make timely decisions, apply seasoned judgment, and display personal responsibility.
• Demonstrate Southern Company Values: Safety First, Intentional Inclusion, Act with Integrity, and Superior Performance.
• Be a team player — able to quickly build good, productive working relationships with the PI Administrator, AI/ML team, operations teams, and technology partners.
• Detail-oriented and proactive — anticipate data quality issues before they impact downstream consumers.
• Results-oriented self-starter that can work independently while contributing to team objectives.
• Creatively solve issues, think outside the box, and find innovative ways to bridge operational data and AI/ML requirements.
• Intellectually curious — eager to learn new tools, platforms, and methodologies across both PI System administration and data engineering domains.