Azure Data Engineer ADF at Inherent Technologies Cincinnati, OH

Inherent Technologies; Cincinnati (OH); On-site; USD 100,000 - 130,000; Full time

Job summary

Inherent Technologies is looking for an Azure Data Engineer ADF to join their team in Cincinnati, OH. The candidate will develop and orchestrate distributed data processing pipelines, conduct testing, and enhance applications while mentoring junior team members.

Essential requirements include a bachelor's degree in a relevant field, over ten years of experience, and proficiency in Azure and Python. This position involves onsite work from day one.

Qualifications

• 10+ years' experience required.
• 2 years of proven professional data development experience.
• Proficient with software engineering best practices.

Responsibilities

• Develop distributed data processing data pipeline solutions.
• Orchestrate multi-step data transformation pipelines.
• Mentor junior team members.

Skills

Microsoft Azure

Python

Agile Way of Working

SQL

Data Pipeline Orchestration

Automated Testing with PyTest

Education

Bachelor's degree in Computer Science or related field

Tools

Git

Java

Spring Framework

PySpark

Snowpark

Job description

Azure Data Engineer ADF job at Inherent Technologies. Cincinnati, OH.

Position

Azure Data Engineer ADF

Location

Cincinnati, OH (Onsite from Day 1)

Competencies

• 10+ years' experience required
• Microsoft Azure
• Agile Way of Working
• Python

Role Description

Take ownership of stories and drive them to completion through all phases of the entire 84.51 SDLC. This includes external facing and internal applications as well as process improvement activities.

• Develop distributed data processing data pipeline solutions
• Orchestrate multi-step data transformation pipelines
• Perform unit, integration, and regression testing on packaged code
• Build transformation logic and code in an Object Oriented Programming style
• Enhance CICD pipelines in the path to production
• Create data quality checks for ingested and post processed data
• Ensure data observability via alerting and monitoring of automated pipeline solutions
• Maintain and enhance existing applications
• Build cloud resources via infrastructure as code
• Provide mentoring to junior team members
• Participate in retrospective reviews
• Participate in the estimation process for new work and releases
• Bring new perspectives to problems
• Be driven to improve yourself and the way things are done

Essential Skills

• Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program.
• 2 years of proven professional data development experience
• 2 years developing with SQL
• Proficient with software engineering best practices
• Proficient with data pipeline orchestration
• Proficient with automated testing (PyTest, etc)
• Proficient with VCS (Git, GitHub)
• Proficient using Python frameworks
• Proficient with Object Oriented Programming principles
• Proficient with Java and Sprint Framework
• Experience with distributed data processing (PySpark and/or Snowpark)
• Experience with Data Observability
• Experience with Data Quality checks and processes
• Experience with Cloud Technologies Services (Azure preferred, GCP, AWS)
• Experience with CICD
• Experience with dependency management (Conda, venv, etc)
• Experience with debugging enterprise applications
• Understanding of performance tuning enterprise processes
• Understanding of Infrastructure as Code
• Understanding SOLID principles
• Understanding Agile Principles (Scrum)