Denedo tech SME

TechDigital Group; Weehawken (NJ); On-site; USD 100,000 - 150,000; Full time

Job summary

Denedo tech SME/Architects seeks an Azure Data Technical Specialist to design, develop, and maintain data pipelines using Azure Data Factory and Azure Databricks. You will optimize ETL processes, manage SQL data flows, and ensure reliable data transformation and storage across cloud sources.

Collaborate with cross‑functional teams, write efficient Python scripts, monitor pipelines, and troubleshoot issues. Certifications in Azure Data Factory, Azure Databricks, SQL, or Python are a plus as you

Qualifications

• Experience with Azure Data Factory for data integration and orchestration.
• Experience with Azure Databricks for data engineering and analytics.
• Strong SQL skills for data querying and manipulation.
• Proficiency in Python for data processing and automation.
• Good analytical and problem-solving abilities with attention to detail.
• Clear communication and collaboration in a team environment.
• Ability to adapt to changing priorities and handle multiple tasks.

Responsibilities

• Design, develop, and implement data pipelines using Azure Data Factory to move data between sources and data warehouses.
• Utilize Azure Databricks for data transformations and analytics to derive insights from data.
• Write and optimize SQL queries to extract and analyze data from multiple sources.
• Develop and maintain Python scripts for data processing and automation tasks.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Monitor data pipeline performance and troubleshoot issues to ensure data accuracy and reliability.
• Stay updated on industry trends and best practices in Azure data tools and Python.

Skills

Azure Data Factory

Azure Databricks

SQL

Python

ETL

Data pipelines

Teamwork

Job description

Denedo tech SME/Architects

Azure Data Technical Specialist with Azure Data Factory (ADF),Azure Databricks,SQL,Oracle PL/SQL,Python

Job Summary

The Technical Specialist will be responsible for overseeing the Azure Data Factory (ADF), Azure Databricks, SQL, Python processes. They will play a key role in designing, developing, and maintaining data pipelines and ETL processes, leveraging the Azure cloud platform and related technologies to ensure optimized data transformation and storage.

Key Responsibilities

• 1. Design, develop, and implement data pipelines using azure data factory (adf) to move data between various sources and data warehouses.
• 2. Utilize azure databricks for data transformations and analytics to derive valuable insights from data.
• 3. Write and optimize sql queries to extract, manipulate, and analyze data from multiple sources.
• 4. Develop and maintain python scripts for data processing and automation tasks.
• 5. Collaborate with cross functional teams to understand data requirements and ensure data solutions meet business needs.
• 6. Monitor data pipeline performance and troubleshoot issues to ensure data accuracy and reliability.
• 7. Stay updated on industry trends and best practices related to azure data factory, azure databricks, sql, and python.

Skill Requirements

• 1. Proficiency in azure data factory (adf) for data integration and orchestration.
• 2. Experience working with azure databricks for data engineering and analytics.
• 3. Strong sql skills for data querying and manipulation.
• 4. Proficient in python programming for data processing and automation.
• 5. Strong analytical and problem-solving skills with a high attention to detail.
• 6. Excellent communication and collaboration abilities to work effectively in a team environment.
• 7. Ability to adapt to changing priorities and handle multiple tasks simultaneously.

Certifications: Azure Data Factory, Azure Databricks, SQL, or Python certifications are a plus.