Data Engineer

Optomi; Moncks Corner (SC); On-site; USD 90,000 - 130,000; Full time

Job summary

Optomi, in partnership with a leading electric and water utility services company, is seeking a Data Engineer to join their team. This role requires expertise in Python, SQL, Databricks, Spark, and Informatica to ensure seamless data processing and ETL execution.

The position emphasizes hands-on cloud experience with Azure and Google Cloud, Databricks, and PySpark to support ETL pipelines across a multi-cloud environment.

Qualifications

• Extensive experience with multi-cloud ETL pipelines.
• Proficiency in Python and SQL for data manipulation and analysis.
• Hands-on experience with Databricks for data engineering tasks.

Responsibilities

• Develop and maintain ETL processes using Informatica.
• Optimize data workflows in a multi-cloud environment.
• Collaborate with team members to ensure project success.
• Address technical challenges and provide innovative solutions.

Skills

Python

SQL

Databricks

Spark

PySpark

Informatica

Azure

Google Cloud

Tools

Databricks

Informatica

Azure

Google Cloud Platform

Job description

Optomi, in partnership with a leading electric and water utility services company, is seeking a Data Engineer to join their team! This role is critical to the ongoing success of the project as the team is nearing crucial deadlines. The position requires a strong expertise in Python, SQL, Databricks, and Spark technologies to ensure seamless data processing and ETL job execution using Informatica.

Job Qualifications:

• Extensive experience with Azure and Google Cloud platforms.
• Proficiency in Python and SQL for data manipulation and analysis.
• Hands-on experience with Databricks for data engineering tasks.
• Familiarity with Informatica for ETL processes.
• Strong knowledge of Spark and Pyspark.

Job Responsibilities:

• Develop and maintain ETL processes using Informatica.
• Optimize data workflows in a multi-cloud environment.
• Collaborate with team members to ensure project success.
• Address technical challenges and provide innovative solutions.