Senior Data Engineer 4 4P/259

4P Consulting Inc.; Atlanta (GA); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading consulting firm seeks a Senior Data Engineer in Atlanta, GA. The ideal candidate will have over 10 years of experience in building and optimizing data pipelines, working with SQL and cloud platforms like Azure and AWS. This role involves designing robust data infrastructure, ensuring data integrity, and implementing data governance best practices in a dynamic environment.

Qualifications

• 10+ years of experience in data engineering.
• Expert-level proficiency in SQL and data modeling.
• Hands-on experience with big data frameworks and cloud data platforms.

Responsibilities

• Design and maintain scalable ETL/ELT pipelines.
• Work with structured and unstructured data.
• Collaborate with business analysts and data scientists.

Skills

SQL

Data Modeling

Data Pipeline Orchestration

Cloud Data Platforms

Data Governance

Python

Education

Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems

Tools

Apache Spark

Hive

Airflow

Azure Data Lake

AWS Redshift

Databricks

Job description

Senior Data Engineer

Location: Atlanta, GA

Client- Southern Company

Contract- 1 Year
Experience Level: 10+ Years

Position Summary:

We are seeking an experienced Senior Data Engineer with a strong background in designing and developing robust, scalable, and high-performance data infrastructure. The ideal candidate will have 10+ years of experience in manipulating data, working with both relational and NoSQL systems, and building modern data pipelines across data lakes and warehouses. This role demands a deep technical skillset in SQL, data modeling, and data pipeline orchestration tools like Apache Spark, Hive, and Airflow.

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines to process and integrate data from disparate sources.

• Work with structured and unstructured data to build clean, efficient, and machine-readable datasets.

• Normalize databases and ensure that data structures align with application and business requirements.

• Collaborate with business analysts, data scientists, and software engineers to deliver data solutions aligned with company objectives.

• Design and implement data models that support reporting, analytics, and machine learning use cases.

• Migrate and optimize workloads in cloud-based environments (e.g., Azure, AWS, GCP).

• Monitor and optimize data pipeline performance, data quality, and reliability.

• Implement data governance best practices and ensure compliance with security and privacy regulations.

Technical Skills & Expertise:

• Expert-level proficiency in SQL, including writing complex queries and optimizing performance.

• Deep understanding of data modeling techniques for both OLTP and OLAP systems.

• Hands-on experience with big data frameworks:

  • Apache Spark, Hive, Airflow, Databricks

• Experience with modern cloud data platforms:

  • Azure Data Lake, Azure Synapse, AWS Redshift, or Google BigQuery

• Strong experience with data orchestration, scheduling, and automation tools.

• Familiarity with Python, Scala, or Java for data processing and scripting tasks.

• Knowledge of NoSQL databases (e.g., MongoDB, Cassandra) and streaming tools (e.g., Kafka) is a plus.

• Experience with data security, lineage, and cataloging tools (e.g., Unity Catalog, Collibra).

Preferred Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.

• Microsoft Azure Data Engineer Associate or equivalent certifications preferred.

• Experience in data governance processes and supporting enterprise analytics platforms.

• Knowledge of containerization (e.g., Docker) and CI/CD pipelines in DevOps environments.