Data Engineer II 4P/554

4P Consulting Inc.; Birmingham (AL); On-site; Full time

Job summary

A prominent consulting firm located in Birmingham, AL, is seeking a Data Engineer II to enhance their data solutions. The ideal candidate will possess strong expertise in SQL, data modeling, and big data tools such as Spark, Hive, and Airflow, along with experience in relational databases, NoSQL platforms, and data lakes. A Bachelor's degree in a technical field is essential, with advanced degrees preferred, and a robust background in data engineering and analytics solutions is expected.

Qualifications

• 3–5 years of experience in data engineering or related role.
• Strong proficiency in SQL.
• Experience with data modeling and database normalization.
• Hands-on experience with Spark, Hive, and Airflow.
• 5+ years of experience with on-premises tools such as MSBI, Informatica, and Oracle.

Skills

SQL

Data modeling

Spark

Hive

Airflow

Hadoop

R

Python

Education

Bachelor’s degree in a technical field

Advanced degree preferred

Tools

MSBI (SSIS/SSAS)

Informatica

Oracle Golden Gate

SQL Server

Azure Data Lake

Azure Data Factory

Azure Databricks

Power BI

Job description

Data Engineer II

Location- Birmingham, AL( ONSITE)

Client- Southern Company Services.

The ideal candidate has strong expertise in SQL, data modeling, and big data tools such as Spark, Hive, and Airflow, with experience working across relational databases, NoSQL platforms, and data lakes.

Required Qualifications

• 3–5 years of experience in data engineering or related role

• Strong proficiency in SQL

• Experience with data modeling and database normalization

• Experience working with:

  • Relational databases

  • NoSQL systems

  • Data lakes

• Hands-on experience with Spark, Hive, and Airflow.

Education

• Bachelor’s degree in a technical field (ex: Computer Science, Engineering, Mathematics, or other relevant academic discipline) required. Advanced degree preferred.

Knowledge, Skills, and Abilities

• Hands-on experience developingsolutions withbig data technologies such as Hadoop, HIVE and Spark.

• Hands-on experience developing and supporting statistical models, R, and/or Python based AI/ML solutions.

• 5+ years hands on experience designing,developing, testing, deploying, and supportingdata engineering and analytics solutions usingon-premisestools such asMSBI(SSIS/SSAS),Informatica, Oracle Golden Gate,SQL, Oracle, and SQL Server.

• 3+ years hands on experience designing, developing, testing, deploying, and supporting data engineering and analytics solutions using Microsoftcloud-basedtools such asAzure Data Lake, Azure Data Factory, Azure Databricks, Python, Azure Synapse, Azure Key Vault, and Power BI.

• Hands-on experience designing and developing solutions involving data sourcing, enrichment and delivery using APIs & Web Services.