Data Engineer II, TO

Southern Company; Atlanta (GA); On-site; USD 106,000 - 176,000; Full time

Job summary

Southern Company is seeking a skilled Data Engineer II to enhance its cloud data lake architecture in Atlanta. The ideal candidate will design and optimize data pipelines, ensuring robust governance and data quality while collaborating with various stakeholders in a dynamic environment.

Benefits

Competitive base salary

Annual incentive awards

Health benefits

Retirement benefits

Career development opportunities

Qualifications

• Minimum of 3 years of experience in data engineering or related roles.
• Strong understanding of data warehousing and ETL processes.
• Experience with Azure services and big data technologies.

Responsibilities

• Design, develop, and maintain data pipelines for the data lake house.
• Collaborate with stakeholders to translate data requirements into solutions.
• Ensure data quality and security across all data sources.

Skills

Data Engineering

Cloud Platforms

Data Analytics

Data Quality

Data Governance

Education

Bachelor's degree in Computer Science

Tools

Databricks

Azure Data Lake

Azure Synapse

Apache Spark

Delta Lake

Job description

Join to apply for the Data Engineer II, TO role at Southern Company

Join to apply for the Data Engineer II, TO role at Southern Company

Get AI-powered advice on this job and more exclusive features.

ASCEND Program Information

Southern Company is committed to building the future of energy for the customers who depend on us, the communities we serve and the industry we lead. The ASCEND program will transform how we do business, helping us elevate the customer experience, adapt to industry changes, and implement technology that offers new capabilities with more agility. It will involve implementing multiple applications, including the replacement of our meter data management (MDM) and customer service systems (CSS) with a new, Oracle customer information system (CIS) called customer to meter (C2M). Additionally, it includes implementing an advanced analytics platform (AAP), customer experience (CX) and customer engagement platform (CEP).

The new platform, to be rolled out to Alabama Power, Georgia Power, and Mississippi Power, will be implemented in phases over the next four years. Currently, we are building an ASCEND organization dedicated to helping the electric operating companies realize the vision for a modernized, efficient, digital customer experience to deeply engage with our customers and provide a more personalized experience. ASCEND will be one of the most comprehensive Customer Service and Marketing transformation initiatives in our company’s history.

Each Leader, Technology (CIS/MDM) position is responsible for the oversight, management, and delivery of critical activities within the Technology Workstream required for the program.

Click here for more information about the CIS project and to view FAQs.

The location for this position is flexible between Birmingham or Atlanta.

The successful candidate will remain an employee of the operating company while reporting to the CIS/MDM Project Team and may report to a SCS or operating company leader for delivery. There will be alignment for technology employees to the technology leaders and business employees to business leaders

About Us

Southern Company is upgrading its Customer Information System (CIS) to better serve 4.6 million electricity customers. The new system leverages Databricks’ lakehouse architecture and Azure’s cloud services to enhance data management, streamline reporting, and empower advanced analytics, data science, and artificial intelligence initiatives.

Alongside these modern tools, we are assembling an agile and collaborative data management practice focused on delivering business-aligned objectives through robust, accurate, and scalable data products and features. Our innovative customer data solutions prioritize strong governance, regulatory compliance, and user-centric design, driving exceptional customer experiences and operational excellence.

The Customer Data Platform (CDP) is a data lake house built atop Databricks within Microsoft’s Azure cloud. Information relative to Southern Company’s customers is managed in CDP to produce data products and features used for customer and partner facing data projects, reporting and analytics. CDP rapidly puts Southern Company’s customer information to work towards the achievement of the greatest value for our customers and shareholders.

Job Summary

We are seeking a skilled and motivated Data Engineer to join our team and contribute to the development and maintenance of our data lake house. The ideal candidate will have a strong background in data engineering, cloud platforms (specifically Azure), and data analytics. This role will involve designing, implementing, and optimizing data pipelines to ensure the scalability, security, and performance of our data lake house, meeting the needs of our business and customers.

Key Responsibilities

• Design, develop, and maintain data pipelines and ETL/ELT processes for the data lake house on Databricks in Azure.
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
• Ensure data quality, consistency, and security across all data sources and pipelines.
• Implement best practices for data governance, data management, and data lifecycle processes.
• Optimize the performance, scalability, and cost-efficiency of data workflows and storage solutions.
• Work closely with data architects, data analysts, and other team members to ensure seamless integration and operation of the data lake house.
• Stay current with industry trends, emerging technologies, and best practices in data engineering and analytics.
• Troubleshoot and resolve data-related issues, ensuring high levels of system availability and reliability.
• Document data workflows, processes, and technical solutions for reference and knowledge sharing.
  
  

Qualifications

• Bachelor's degree in computer science, Information Technology, Data Science, or a related field.
• Minimum of 3 years of experience in data engineering, data architecture, or related roles.
• Proven experience with Databricks, Azure Data Lake, Azure Synapse, and other relevant Azure services.
• Strong understanding of data warehousing, ETL/ELT processes, and data modeling.
• Experience with big data technologies such as Apache Spark, Delta Lake, and related frameworks.
• Excellent analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with technical and non-technical stakeholders.
• Knowledge of the electric utility industry is a plus.
  
  

Preferred Skills

• Certification in data management or analytics (e.g., CDMP, CBIP).
• Experience with machine learning and advanced analytics techniques.
  
  

Behavioral Attributes

• Opportunistic Drive - Committed to delivering technology solutions that help Southern Company achieve their business imperatives and driven to identify opportunities to do so within the solutions, information and data we’re stewards of.
• Positive Can-Do Attitude – Must be willing to take full responsibility for duties and work effectively under the pressure of deadlines and shifting priorities.
• Self-Starter – Able to work in a professional environment with limited direct supervision.
• Results-Oriented – Acts with speed and decisiveness; takes initiative does what it takes to meet commitments.
• Safety Focused – Accepts responsibility for the safety of yourself and co-workers.
• Commitment to continuous learning and improvement – Stays abreast of new technologies and techniques in the market; Looks for opportunities improve through strategy and innovation.
  
  

This job description does not, nor is it intended to represent an exhaustive listing of all duties, tasks or responsibilities for the position listed. Based upon individual experience and team workload, responsibilities are assigned in varying degrees.

About Southern Company

Southern Company (NYSE: SO ) is a leading energy provider serving 9 million customers across the Southeast and beyond through its family of companies. Providing clean, safe, reliable and affordable energy with excellent service is our mission. The company has electric operating companies in three states, natural gas distribution companies in four states, a competitive generation company, a leading distributed energy solutions provider with national capabilities, a fiber optics network and telecommunications services. Through an industry-leading commitment to innovation, resilience and sustainability, we are taking action to meet customers' and communities' needs while advancing our goal of net-zero greenhouse gas emissions by 2050. Our uncompromising values ensure we put the needs of those we serve at the center of everything we do and are the key to our sustained success. We are transforming energy into economic, environmental and social progress for tomorrow. Our corporate culture has been recognized by a variety of organizations, earning the company awards and recognitions that reflect Our Values and dedication to service. To learn more, visit www.southerncompany.com .

Southern Company invests in the well-being of its employees and their families through a comprehensive total rewards strategy that includes competitive base salary, annual incentive awards for eligible employees and health, welfare and retirement benefits designed to support physical, financial, and emotional/social well-being. This position may also be eligible for additional compensation, such as an incentive program, with the amount of any bonus/awards subject to the terms and conditions of the applicable incentive plan(s). A summary of the benefits offered for this position can be found here https://seo.nlx.org/southernco/pdf/SOCO-Benefits.pdf . Additional and specific details about total compensation and benefits will also be provided during the hiring process.

Southern Company is an equal opportunity employer where an applicant's qualifications are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity or expression, or any other basis prohibited by law.

Job Identification: 12331

Job Category: Information Technology

Company: Southern Company Services

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Telecommunications and Utilities

Referrals increase your chances of interviewing at Southern Company by 2x

Get notified about new Data Engineer jobs in Atlanta, GA.

Atlanta, GA $106,300.00-$175,400.00 4 months ago

Atlanta, GA $123,000.00-$203,000.00 4 months ago

Atlanta, GA $106,300.00-$175,400.00 1 day ago

Atlanta, GA $112,597.33-$152,810.66 1 month ago

Atlanta, GA $140,000.00-$180,000.00 1 week ago

Atlanta, GA $100,000.00-$125,000.00 4 days ago

Atlanta, GA $125,000.00-$135,000.00 1 day ago

Atlanta, GA $106,300.00-$175,400.00 2 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.