ETL Developer

TechDigital Group; Montgomery (AL); On-site; USD 80,000 - 110,000; Full time

Job summary

A leading tech firm in the United States is seeking candidates with strong skills in Azure Data Factory and Databricks for a data migration project. The ideal candidate will have experience in Python programming, SQL, and ETL concepts, along with strong troubleshooting and communication skills. This is a great opportunity to work on innovative data solutions in a collaborative environment.

Qualifications

• Experience in Azure Data Factory and Databricks.
• Strong knowledge of ETL concepts, SQL, and Python programming.
• Experience in query performance tuning and creating reusable notebooks in Databricks.

Skills

Azure Data Factory

Databricks

Python/PySpark

Oracle

SQL

Data Migration

ETL concepts

PLSQL

Job description

Must Have

• Azure Data Factory, Databricks, Python/PySpark, Oracle / SQL and Experience in Data Migration / Conversion project
• Clear understanding of ETL concepts like full load and incremental load using Databricks and ADF pipelines.
• Create ETL pipelines with Azure Data factory and sequence data bricks jobs in ADF.
• Creation of reusable notebooks in Azure Databricks and experience with functions and parameters.
• Good knowledge and experience in Python programming language.
• Good Oracle and SQL Server query experience with knowledge of CTE, Ansi SQL and Oracle functions.
• Experience in minus, except, union and other set operators in SQL.
• Good experience in creating PLSQL blocks, triggers and indexes.
• Query performance tuning experience with knowledge in Indexes and partitions.
• Strong troubleshooting skills and defect resolution.
• Good communication skills and client facing skills.