Data Engineer

Southern Company; Birmingham (AL); Hybrid; USD 120,000 - 160,000; Full time

Job summary

Southern Company is seeking an experienced Data Engineer to build, operationalize, and maintain data pipelines across hybrid and multi-cloud environments. You will translate data into consumable formats and support batch and streaming workflows to enable analytics and AI use cases.

You will standardize data curation, taxonomy, and solution delivery for Databricks and Azure, and collaborate with cross‑functional teams on strategic data projects within Electric Operations Technology Solutions.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, ML, or related field.
• 9+ years of experience in data engineering or related roles.
• Experience with batch and real-time data processing frameworks.
• Experience with big data technologies (Hadoop, Hive, Spark).
• Experience with AI/ML solutions in Python.
• 4+ years with on-prem tools (MSBI, Informatica, Oracle GoldenGate, SQL Server).
• 2+ years with Microsoft Azure tools (Data Lake, Data Factory, Databricks, Synapse, Power BI).
• Experience with containerization (Docker, OpenShift).

Responsibilities

• Design and develop methods to process structured, semi-structured, and unstructured data using batch and real-time techniques.
• Develop release pipelines to automate build, version control, and deployment tasks.
• Build and maintain reusable templates, code libraries, and semantic models.
• Establish gatekeeping and guard rail processes for production data promotion.
• Collaborate with cross-functional teams including data, business, and technical stakeholders.
• Promote data reusability and modular data product delivery.
• Define and enforce data quality and integrity controls.
• Provide technical guidance to less experienced data engineers.
• Optimize performance using parallel processing and minimal data movement.
• Stay current with data technologies and share insights across the organization.
• Standardize, design, and develop Databricks applications, data integrations and automated business processes.
• Integrate data from multiple systems, databases, APIs, and business applications.
• Provide technical guidance, knowledge sharing, and support for business users and fellow data engineers.

Skills

Data Modeling

Databricks

Python

SQL

Azure

Big Data

CI/CD

Data Governance

Education

Bachelor's degree in CS/Engineering/related

Tools

Hadoop

Spark

Informatica

Databricks

SQL Server

Docker

OpenShift

Job description

DATA ENGINEER

Locations:

Atlanta, GA (30 Ivan Allen) OR Birmingham, AL (The Energy Center)

Onsite 4 says/week and one day remote

Job Summary

The Electric Operations Technology Solutions (EOTS) Data Engineer is responsible for building, operationalizing, and maintaining data pipelines to support data, analytics, and AI use cases across hybrid and multi-cloud environments. The role involves translating data into consumable formats, supporting various data integration styles (e.g., virtualization, replication, streaming), and ensuring data reliability and scalability.

The data engineer will lead standardization of data curation, data taxonomy and solution delivery across the Electric Operations Technology Solutions Organization for the Databricks and Azure environments. The position is on the Electric Operations Technology Solutions Leadership Team engaging in strategic delivery of business solutions supporting multiple business areas within Southern Company.

JOB REQUIREMENTS:

Experience And Knowledge

• Bachelor’s degree in Computer Science, Engineering, Machine Learning, or related field
• 9+ years of experience in data engineering or related roles
• Experience with batch and real-time data processing frameworks
• Experience with big data technologies (e.g., Hadoop, HIVE, Spark)
• Experience with AI/ML solutions in Python
• 4+ years with on-prem tools (e.g., MSBI, Informatica, Oracle Golden Gate, SQL Server)
• 2+ years with Microsoft Azure tools (e.g., Data Lake, Data Factory, Databricks, Synapse, Power BI)
• Experience with containerization (e.g., Docker, OpenShift)

Skills

• Proficiency in data modeling, access, storage, and quality tools
• Familiarity with Agile, DevOps, CI/CD methodologies
• Strong communication and collaboration skills
• Ability to lead and mentor others
• Familiarity with performance optimization and data governance
• Proactive in sharing knowledge and best practices
• Hands‑on expertise with Databricks, SQL, Python, and Apache Spark.
• Proficiency in data modeling for analytics and machine learning.

MAJOR JOB RESPONSIBILITIES:

Specify major duties performed by the job and % of time spent on duties.

Design and develop methods to process structured, semi-structured, and unstructured data using batch and real-time techniques

• Develop release pipelines to automate build, version control, and deployment tasks
• Build and maintain reusable templates, code libraries, and semantic models
• Establish gatekeeping and guard rail processes for production data promotion
• Collaborate with cross-functional teams including data, business, and technical stakeholders
• Promote data reusability and modular data product delivery
• Define and enforce data quality and integrity controls
• Provide technical guidance to less experienced data engineers
• Optimize performance using parallel processing and minimal data movement
• Stay current with data technologies and share insights across the organization
• Standardize, design, and develop Databricks applications, data integrations and automated business processes.
• Integrate data from multiple systems, databases, APIs, and business applications.
• Provide technical guidance, knowledge sharing, and support for business users and fellow data engineers.

About Southern Company

Southern Company (NYSE: SO ) is a leading energy provider serving 9 million customers across the Southeast and beyond through its family of companies. Providing clean, safe, reliable and affordable energy with excellent service is our mission. The company has electric operating companies in three states, natural gas distribution companies in four states, a competitive generation company, a leading distributed energy solutions provider with national capabilities, a fiber optics network and telecommunications services. Through an industry-leading commitment to innovation, resilience and sustainability, we are taking action to meet customers' and communities' needs while advancing our goal of net-zero greenhouse gas emissions by 2050. Our uncompromising values ensure we put the needs of those we serve at the center of everything we do and are the key to our sustained success. We are transforming energy into economic, environmental and social progress for tomorrow. Our corporate culture has been recognized by a variety of organizations, earning the company awards and recognitions that reflect Our Values and dedication to service. To learn more, visit www.southerncompany.com .

Southern Company invests in the well-being of its employees and their families through a comprehensive total rewards strategy that includes competitive base salary, annual incentive awards for eligible employees and health, welfare and retirement benefits designed to support physical, financial, and emotional/social well-being. This position may also be eligible for additional compensation, such as an incentive program, with the amount of any bonus/awards subject to the terms and conditions of the applicable incentive plan(s). A summary of the benefits offered for this position can be found here https://seo.nlx.org/southernco/pdf/SOCO-Benefits.pdf . Additional and specific details about total compensation and benefits will also be provided during the hiring process.

Southern Company is an equal opportunity employer where an applicant's qualifications are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity or expression, or any other basis prohibited by law.

Job Identification: 22546

Job Category: Information Technology

Job Schedule: Full time

Company: Southern Company Services