Sr ETL Developer

TechDigital Group; Montgomery (AL); On-site; USD 70,000 - 95,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer with expertise in ETL processes and Azure Data Factory. In this role, you will design and implement robust ETL pipelines, leveraging Databricks and Azure technologies to ensure efficient data processing. Your strong background in Python and SQL will be crucial for optimizing query performance and troubleshooting issues. Join a forward-thinking team where your contributions will enhance data workflows and drive impactful business decisions. If you're passionate about data engineering and eager to make a difference, this opportunity is perfect for you.

Qualifications

• Experience with ETL concepts and creating pipelines using Azure Data Factory.
• Strong skills in Python and SQL, including Oracle and SQL Server.

Responsibilities

• Develop ETL pipelines and manage data processing using Azure Data Factory.
• Optimize SQL queries and troubleshoot performance issues.

Skills

ETL Concepts

Azure Data Factory

Databricks

Python Programming

Oracle SQL

SQL Server

PLSQL

Query Performance Tuning

Troubleshooting Skills

Client Communication

Job description

1. Clear understanding of ETL concepts like full load and incremental load using Databricks and ADF pipelines.
2. Create ETL pipelines with Azure Data factory and sequence data bricks jobs in ADF.
3. Creation of reusable notebooks in Azure Databricks and experience with functions and parameters.
4. Good knowledge and experience in Python programming language.
5. Good Oracle and SQL Server query experience with knowledge of CTE, Ansi SQL and Oracle functions.
6. Experience in minus, except, union and other set operators in SQL.
7. Good experience in creating PLSQL blocks, triggers and indexes.
8. Query performance tuning experience with knowledge in Indexes and partitions.
9. Strong troubleshooting skills and defect resolution.
10. Good communication skills and client facing skills.