Operations Data Engineering Analyst

southerncompany; Birmingham (AL); On-site; USD 110,000 - 160,000; Full time

Job summary

Southern Power Monitoring & Diagnostics Center in the United States seeks an Operations Data Engineering Analyst to manage PI/IP.21 environments, AF configuration, and real-time dashboards. You will curate AI-ready datasets for Databricks and support AI/ML analytics, ensuring high-quality data for monitoring and predictive models.

Responsibilities include tag management, AF analytics deployment, data quality monitoring, and cross-team collaboration with engineers and analysts to scale data

Qualifications

• Hands-on PI System experience including AF, PI Vision, and interfaces.
• Proficient in Python for data extraction, transformation, and automation.
• SQL proficiency for data querying across databases.
• Experience with Databricks and ETL/ELT pipelines.
• Understanding of data quality, governance, and surrogate data concepts.

Responsibilities

• Support PI/IP.21 system admin tasks: tags, AF, analytics, and vision screens.
• Curate datasets for AI/ML training and deployment in Databricks.
• Validate data quality, handle gaps, and ensure readiness for analytics.
• Collaborate with AI/ML teams and operations to deliver data solutions.
• Monitor pipelines and improve reliability, scalability, and documentation.

Skills

Python

SQL

AVEVA PI System

Databricks

AI/ML data readiness

Education

Bachelor's degree in Engineering, Computer Science, Data Science, or related field

Master's degree in Engineering, Computer Science, Data Science, preferred

Tools

PI DataLink

PI Web API

PI Connect

Databricks / Apache Spark

Job description

JOB SUMMARY

This position will function as part of the Southern Power Monitoring & Diagnostics (M&D) Center, which provides remote monitoring and diagnostic support to the SPC fleet of gas, solar, wind, and energy storage assets.

The Operations Data Engineering Analyst supports both operational data infrastructure and AI/ML data readiness. The role assists the PI System Administrator with daily operation, maintenance, and expansion/migration of SPC’s AVEVA PI and AspenTech IP.21 historian environments, including tag management, Asset Framework (AF) configuration, analytics deployment, PI Vision development, data quality monitoring, and proactive remediation. The role also extracts, transforms, curates, and delivers clean, structured datasets from PI and IP.21 into downstream data engineering platforms such as Databricks to support M&D’s growing AI and machine learning portfolio, including iSight anomaly detection, predictive analytics models, and AI agents.

In short, this role owns the data journey from raw sensor ingestion in PI through curated, AI-ready datasets — ensuring the M&D team always has trusted, high-quality, well-engineered data to power both real-time monitoring and advanced analytics.

This position will closely interface with the Aveva PI/ AspenTech IP.21 System Administrator, M&D Analysts, AI/ML Analysts, Renewable Performance Engineers, Renewable, Gas, and Commercial Operations, the SPC Technology Organization, SCADA teams, and plant personnel.

MAJOR JOB RESPONSIBILITIES

PI/IP.21 System Support

• Tag Management — Support the PI/IP.21 Administrator in the creation, modification, scaling, and decommissioning of PI/IP.21 tags across gas, solar, wind, and energy storage assets. Ensure tag naming conventions, point types, and compression settings are consistent with fleet-wide standards.

• Asset Framework (AF) Configuration — Create, modify, and delete AF elements, attributes, templates, and hierarchies to reflect fleet changes (new sites, equipment swaps, decommissions). Maintain AF structure integrity across all OEMs (solar inverters, wind turbines, gas turbines, batteries, and BOP equipment).

• AF Analytics Deployment — Develop, test, and deploy PI AF Analytics (calculated attributes, rollup expressions, event frames) in test and production environments. Validate analytic outputs against expected results prior to production deployment.

• Data Quality Monitoring & Proactive Remediation — Continuously monitor data quality across PI and IP.21 platforms — identifying stale tags, flatlined signals, bad values, communication failures, scaling errors, and missing data. Proactively remediate issues before they impact downstream analytics, dashboards, or AI models. Support data surrogation processes where needed.

• PI Vision Development & Maintenance — Design, develop, and maintain real-time PI Vision screens and dashboards for fleet monitoring, equipment health, data quality, and KPI tracking. Update displays as new sites are onboarded or fleet configurations change.

• Site Onboarding Support — Assist the PI/IP.21 Administrator with integrating new generation and storage sites into the PI/IP.21 System, including interface/connector configuration, tag provisioning, AF buildout, initial data validation, and PI Vision screen creation.

• Data Query Support for Other Teams — Serve as a resource for operations, performance, and analytics teams who need to extract data from PI/IP.21. Provide support and guidance using PI DataLink, IP.21 Excel Connector, Python, SQL, PI Web API, and PI Connect to enable self-service data access and integration with downstream tools.

• Troubleshooting — Assist in diagnosing and resolving data flow issues, interface communication failures, archive gaps, and system errors within the PI and IP.21 environments. Escalate infrastructure-level issues to the PI/IP.21 Administrator or IT as appropriate.

Data Engineering & AI/ML Data Readiness

• Dataset Curation & Cleaning — Build and maintain repeatable data curation pipelines that clean, validate, deduplicate, align timestamps, handle missing values, and resolve data quality issues — producing trusted, well-documented datasets for AI/ML model training and inference in Databricks.

• AI/ML Data Requirements Engineering — Partner directly with the AI/ML Analyst to understand model input requirements, feature definitions, labeling schemas, data frequency needs, and quality thresholds. Translate these requirements into actionable data engineering tasks and deliver datasets that meet model specifications.

• Model-Ready Data Validation — Validate curated datasets against AI model input specifications — checking for completeness, balance, feature drift, outliers, and schema compliance in/outside Databricks. Flag and resolve data issues before they enter training or inference pipelines.

• Pipeline Monitoring & Maintenance — Monitor health and performance of data pipelines, alerting on failures, latency, or data quality degradation. Continuously improve pipeline efficiency, reliability, and scalability as the fleet and AI use cases grow.

Collaboration & Continuous Improvement

• Cross-Functional Collaboration — Build and maintain strong working relationships with the PI/IP.21 Administrator, AI/ML Analysts, M&D Analysts, Renewables Performance Engineers, Renewable, Gas, and Commercial Operations, SCADA teams, Technology Organization developers, and plant personnel.

• Documentation — Maintain thorough documentation of PI configurations, AF structures, tag inventories, data pipeline architectures, dataset catalogs, and standard operating procedures.

• Best Practices & Lessons Learned — Incorporate industry best practices, lessons learned, and feedback into daily operations. Participate in fleet-wide standardization efforts and data governance initiatives.

• Continuous Learning — Stay current on AVEVA PI System updates, data engineering best practices (Databricks), AI/ML pipeline methodologies, and relevant industry trends.

JOB REQUIREMENTS

Education

• Bachelor's degree in Engineering (Electrical, Computer, Instrumentations and Controls), Computer Science, Data Science, or a related technical field — required.

• Master's degree in Engineering (Electrical, Computer, Instrumentation & Controls), Computer Science, Data Science, or a related technical field - preferred.

Experience

Required

• PI System Hands-On: 0-3 years of hands‑on experience with AVEVA PI System, including PI Data Archive, PI Asset Framework (AF), PI Vision, and PI Interfaces/Connectors.

• Python: Proficient in Python for data extraction, transformation, pipeline development, and automation (Pandas, NumPy, Web API calls, scripting).

• SQL: Proficient in SQL for data querying, integration, and manipulation across relational databases and data platforms.

• Data Engineering Platform: Familiar with Databricks, Apache Spark, or equivalent data engineering platforms — including ETL/ELT pipeline development, Delta Lake, and feature store concepts.

• Data Quality & Governance: Experience with data quality monitoring, validation, remediation, and surrogation in an operational/industrial context.

Preferred

• PI Data Access Tools: Working knowledge of PI DataLink, PI Web API, and PI Connect for data extraction and downstream integration.

• PI AF Analytics: Experience developing and deploying AF Analytics, calculated attributes, event frames, and notifications.

• AI/ML Pipeline Understanding: Foundational understanding of ML model deployment pipelines — including feature engineering, data labeling, model training data requirements, and inference data delivery.

• Data Visualization / BI: Experience with Power BI, Tableau, or similar BI tools for dashboard development and operational reporting.

• Energy Sector: Experience in power generation, renewables, or utilities operations.

Plus

• Other Data Historians: Experience with AspenTech IP.21, dataPARC, eDNA etc.

• SCADA Systems: Familiarity with Ignition/other SCADA systems.

• Communications Protocols: OPC DA/UA, DNP3, Modbus protocols and data acquisition architectures.

• PI Accreditation: AVEVA / OSIsoft PI System accreditation.

BEHAVIORAL ATTRIBUTES

• Must be able to make timely decisions, apply seasoned judgment, and display personal responsibility.

• Demonstrate Southern Company Values: Safety First, Intentional Inclusion, Act with Integrity, and Superior Performance.

• Be a team player — able to quickly build good, productive working relationships with the PI Administrator, AI/ML team, operations teams, and technology partners.

• Detail-oriented and proactive — anticipate data quality issues before they impact downstream consumers.

• Results-oriented self-starter that can work independently while contributing to team objectives.

• Creatively solve issues, think outside the box, and find innovative ways to bridge operational data and AI/ML requirements.

• Intellectually curious — eager to learn new tools, platforms, and methodologies across both PI System administration and data engineering domains.

• Southern Power , a subsidiary of Southern Company, is a leading U.S. wholesale energy provider meeting the electricity needs of municipalities, electric cooperatives, investor-owned utilities, and other energy customers. Southern Power and its subsidiaries own 55 facilities operating or under construction in 14 states with more than 12,500 MW of generating capacity in Alabama, California, Delaware, Georgia, Kansas, Maine, Nevada, New Mexico, North Carolina, Oklahoma, South Dakota, Texas, West Virginia, and Washington.

Southern Company (NYSE: SO ) is a leading energy provider serving 9 million customers across the Southeast and beyond through its family of companies. Providing clean, safe, reliable and affordable energy with excellent service is our mission. The company has electric operating companies in three states, natural gas distribution companies in four states, a competitive generation company, a leading distributed energy solutions provider with national capabilities, a fiber optics network and telecommunications services. Through an industry-leading commitment to innovation, resilience and sustainability, we are taking action to meet customers' and communities' needs while advancing our goal of net‑zero greenhouse gas emissions by 2050. Our uncompromising values ensure we put the needs of those we serve at the center of everything we do and are the key to our sustained success. We are transforming energy into economic, environmental, and social progress for tomorrow. Our corporate culture has been recognized by a variety of organizations, earning the company awards and recognitions that reflect Our Values and dedication to service. To learn more, visit www.southerncompany.com .

Southern Company invests in the well‑being of its employees and their families through a comprehensive total rewards strategy that includes competitive base salary, annual incentive awards for eligible employees and health, welfare and retirement benefits designed to support physical, financial, and emotional/social well‑being.

• This position may also be eligible for additional compensation, such as an incentive program, with the amount of any bonus/awards subject to the terms and conditions of the applicable incentive plan(s).
• A summary of the benefits offered for this position can be found here https://seo.nlx.org/southernco/pdf/SOCO-Benefits.pdf .
• Additional and specific details about total compensation and benefits will also be provided during the hiring process.