Senior Data Engineer – Lakehouse & Cloud Pipelines

4P Consulting Inc.; Atlanta, Birmingham (GA, AL); Hybrid; USD 90,000 - 120,000; Full time

Job summary

A consulting firm is seeking an experienced Data Engineer III to build and maintain scalable data pipelines. The role requires proficiency in Databricks, Azure, and strong skills in SQL optimization and data transformation. The ideal candidate will have 5-10 years of relevant experience and expertise in data modeling and pipeline development. This position operates within the business technology/data domain and focuses on ensuring clean and accessible data assets.

Qualifications

• 5-10 years in a Data Engineering role with hands-on development.
• Strong background in data manipulation and software engineering-oriented data practices.
• Experience supporting enterprise-scale platforms.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Implement transformations using Spark, SQL, and ETL/ELT tools.
• Ensure data consistency, accuracy, completeness, and reusability.

Skills

Data transformation

SQL optimization

Databricks

Azure

Spark

Hive

Airflow

Tools

Databricks

Azure

Spark

Hive

Airflow

Job description

A consulting firm is seeking an experienced Data Engineer III to build and maintain scalable data pipelines. The role requires proficiency in Databricks, Azure, and strong skills in SQL optimization and data transformation. The ideal candidate will have 5-10 years of relevant experience and expertise in data modeling and pipeline development. This position operates within the business technology/data domain and focuses on ensuring clean and accessible data assets.