Azure Data Engineer

TechDigital Group; Washington (District of Columbia); On-site; USD 100,000 - 130,000; Full time

Job summary

A tech company in Washington, DC is seeking an Azure Data Engineer Developer with extensive experience in Microsoft Azure data stack, including Azure Data Factory and SQL Database. The role involves building complex ETL pipelines and providing expertise in data modeling and integration. Ideal candidates will have strong SQL and PL/SQL skills, along with a good understanding of data warehousing concepts.

Qualifications

• In-depth knowledge of Azure data stack including Azure Data Factory and Azure SQL Database.
• Experience in big data approaches and architectural concepts.
• Strong development skills in SQL and PL/SQL.

Responsibilities

• Build and migrate complex ETL pipelines to Azure cloud database.
• Provide high-level ETL technical services and support.
• Develop data integration workflows using Azure Data Factory.

Skills

ADF

Pyspark

Azure Data Factory

Data warehousing skills

Tools

Azure SQL Database

SQL Server

Oracle 11g/18c/19c

Job description

Azure Data Engineer Developer

• In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e. Azure Data Factory, Azure Synapse, Azure SQL Database, etc.
• Experience of big data approach, architectural concepts, data sourcing/ ingestion/ curation and storage mechanisms.
• Experience with real-time / near-real-time data warehousing concepts and design approaches.
• Good understanding of OLTP and OLAP concepts and Strong knowledge on design concepts of Database and Data ware housing systems.
• Must have strong development & design skills in SQL and PL/SQL areas in RDBMS environments e.g. MS SQL Server and Oracle 11g/18c/19c.
• In-depth knowledge of NoSQL database usage within enterprise context and design/ modeling approach
• Building and migrating the complex ETL pipelines from on premise system to cloud database such as Azure SQL Data warehouse, Spark to make the system grow elastically
• Provide a high level of ETL technical services and support; is considered an expert in multiple ETL technologies; maps data source to destination
• Building and migrating the complex ETL pipelines from on premise system to cloud database such as Azure SQL Data warehouse, Spark
• Provide a high level of ETL technical services and support; is considered an expert in multiple ETL technologies; maps data source to destination
• Experience building Azure data lake ETL pipelines component such as Azure Data lake Analytics, Azure SQL database and SQL Datawarehouse.
• Expertise with data modeling on Azure SQL database and SQL Datawarehouse
• Expertise with building Azure data catalogue
• Data Integration : Building Pipeline and workflows (ETL) with Azure data factory

Key Skills: ADF, Pyspark, ADB and good knowledge in Data warehousing skills