Data Engineer – ETL, Databricks & Spark (Multi-Cloud)

Optomi; Moncks Corner (SC); On-site; USD 90,000 - 130,000; Full time

Job summary

Optomi, in partnership with a leading electric and water utility services company, is seeking a Data Engineer to join their team. This role requires expertise in Python, SQL, Databricks, Spark, and Informatica to ensure seamless data processing and ETL execution.

The position emphasizes hands-on cloud experience with Azure and Google Cloud, Databricks, and PySpark to support ETL pipelines across a multi-cloud environment.

Qualifications

• Extensive experience with multi-cloud ETL pipelines.
• Proficiency in Python and SQL for data manipulation and analysis.
• Hands-on experience with Databricks for data engineering tasks.

Responsibilities

• Develop and maintain ETL processes using Informatica.
• Optimize data workflows in a multi-cloud environment.
• Collaborate with team members to ensure project success.
• Address technical challenges and provide innovative solutions.

Skills

Python

SQL

Databricks

Spark

PySpark

Informatica

Azure

Google Cloud

Tools

Databricks

Informatica

Azure

Google Cloud Platform

Job description

Optomi, in partnership with a leading electric and water utility services company, is seeking a Data Engineer to join their team. This role requires expertise in Python, SQL, Databricks, Spark, and Informatica to ensure seamless data processing and ETL execution.

The position emphasizes hands-on cloud experience with Azure and Google Cloud, Databricks, and PySpark to support ETL pipelines across a multi-cloud environment.