Data Analytics Engineer

The E Group; Georgia; Hybrid; USD 90,000 - 130,000; Full time

Job summary

The E Group in Atlanta, GA is seeking a Data Engineer on a hybrid W2 contract to design, build, and support scalable data platforms and analytics solutions for Power Delivery. You will develop enterprise data pipelines, integrate operational systems with cloud-based lakehouse platforms, and support both low-code and pro-code development using Microsoft Power Platform, OutSystems, and Databricks.

Collaborate with stakeholders to deliver governed, reusable data assets and partner with data

Qualifications

• Bachelor’s degree in CS, IS, Data Analytics, Engineering, or related technical discipline.
• 3–7 years of experience in data engineering, analytics engineering, or software development.
• Experience building enterprise data pipelines and cloud-based data platforms.

Responsibilities

• Design, build, and support enterprise data pipelines.
• Develop scalable ingestion frameworks for structured, semi-structured, and streaming data.
• Build and maintain Databricks notebooks, workflows, and data pipelines.
• Ingest data from source systems using Azure Data Factory, Kafka, CDC technologies, APIs, files and database sources.
• Implement data quality checks, monitoring, and exception handling.
• Support Bronze, Silver, and Gold (Medallion) data architectures within the Databricks Lakehouse.
• Develop integrations between Databricks and business applications.
• Partner with users to automate workflows and operational processes.

Skills

Data engineering

ETL/ELT design

Data ingestion

Data pipelines

Cloud data platforms

Data governance

CI/CD practices

Education

Bachelor's degree in CS/IS/Data Analytics/Engineering

Tools

Databricks

Databricks Workflows

PySpark

Spark SQL

Delta Lake

Unity Catalog

Azure Data Factory

APIs

Kafka

CDC technologies

SQL Server

Python

SQL

GitHub

Azure DevOps

Power Apps

Power Automate

Power Platform

OutSystems

Job description

Job Description

Immediate W2 contract position available in Atlanta, GA (Hybrid).

• The position is listed as hybrid because team members come into the office as needed for meetings with business partners. Currently, we do not have sufficient office space for all workers to be onsite Monday through Thursday from 8:00 AM to 5:00 PM.

Estimated Duration: 3 years
Job Summary:The Data Engineer is responsible for designing, building, and supporting scalable data platforms, data products, application integrations, and analytics solutions that enable business decision-making across Power Delivery. This role develops and maintains enterprise data pipelines, integrates operational systems with cloud-based lakehouse platforms, and supports both low-code and pro-code application development using Microsoft Power Platform, OutSystems, and Databricks.

The successful candidate partners with business stakeholders, data analysts, application developers, and technology teams to deliver trusted, governed, and reusable data assets.

Key Responsibilities

• Data Engineering & Integration
• • Design, build, and support enterprise data pipelines using ETL and ELT methodologies.
  • Develop scalable ingestion frameworks for structured, semi-structured, and streaming data.
  • Build and maintain Databricks notebooks, workflows, and data pipelines.
  • Ingest data from source systems using:
  • • Azure Data Factory
    • Kafka
    • CDC technologies
    • APIs
    • Files and database sources
  • Implement data quality checks, monitoring, and exception handling.
  • Support Bronze, Silver, and Gold (Medallion) data architectures within the Databricks Lakehouse.
• Databricks Development
• • Design and maintain Delta Lake tables and data products.
  • Develop solutions using:
  • • Databricks
    • PySpark
    • Spark SQL
    • Python
    • SQL
  • Optimize lakehouse performance, scalability, and cost management.
  • Support data sharing, governance, and catalog management using Unity Catalog.
• Application Development
• • Build and enhance business applications using:
  • • Microsoft Power Apps
    • Power Automate
    • Microsoft Power Platform
    • OutSystems
  • Develop integrations between Databricks and business applications.
  • Partner with users to automate workflows and operational processes.
• Data Governance & DevOps
• • Follow Company governance and security standards.
  • Implement CI/CD practices using GitHub and Azure DevOps.
  • Maintain documentation, data lineage, and metadata for enterprise data assets.
  • Participate in architecture reviews and solution design activities.

Required Qualifications

Education

• Bachelor's degree in one of the following:
• • Computer Science
  • Information Systems
  • Data Analytics
  • Engineering
  • Related technical discipline

Experience

• 3–7 years of experience in data engineering, analytics engineering, or software development.
• Experience building enterprise data pipelines and integrations.
• Experience working with cloud-based data platforms.

Required Technical Skills

• Data Engineering
• • ETL / ELT design and development
  • Data ingestion frameworks
  • Data pipeline orchestration
  • Data warehousing concepts
  • Data Lake and Lakehouse architectures
  • Medallion architecture
• Databricks
• • Databricks
  • Databricks Workflows
  • PySpark
  • Spark SQL
  • Delta Lake
  • Unity Catalog
  • Data Products
• Cloud & Integration
• • Azure Data Factory
  • APIs
  • Kafka
  • CDC technologies
  • SQL Server
• Development
• • Python
  • SQL
  • GitHub
  • Azure DevOps
• Business Applications
• • Microsoft Power Apps
  • Power Automate
  • Microsoft Power Platform
  • OutSystems

Preferred Qualifications

• Utility industry experience
• Power Delivery domain knowledge
• Experience supporting Transmission or Distribution Analytics
• Real-time data streaming experience
• Knowledge of AI/ML enablement on Databricks
• Experience with Power BI integration and DirectQuery architectures

Company Description

We provide supplemental employees to the region's most sought after power projects. We credit our s