Azure Data Platform Architect

Artifintech; Jefferson City (MO); Vor Ort; USD 90.000 - 130.000; Vollzeit

Zusammenfassung

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a data engineering expert with deep knowledge of Microsoft data services (Azure Fabric, ADF, Synapse) to design, develop, and maintain cloud-based data pipelines and BI-ready solutions.

The role focuses on modernizing legacy ingestion, ETL/ELT processes, implementing secure data access patterns, and collaborating with data scientists and business stakeholders to deliver scalable analytics across on-prem and cloud environments.

Qualifikationen

• 4+ years designing and implementing data warehouse and analytics solutions (on-premise and cloud).
• 3+ years data warehousing concepts (ETL/ELT, data quality, privacy/security, MDM) with hands-on use of ADF, Data Factory, SSIS.
• 3+ years experience with cloud data and cloud-native data lakes/warehouses; Microsoft Azure services (Fabric Lakehouse, ADF, Data Factory, Synapse).
• 2+ years experience in Python, Scala, or Java for distributed processing and analytics (Spark).
• Familiarity with CI/CD practices and tools such as Azure DevOps, Git, or Jenkins.

Aufgaben

• Lead modernization of legacy data ingestion and ETL/ELT to cloud technologies (AWS/Azure).
• Own ambiguity, navigate constraints with minimal supervision.
• Implement data access, classification, and security patterns meeting regulatory standards.
• Collaborate with technical teams through effective communication and collaboration.
• Translate business requirements into scalable data solutions with stakeholders.
• Integrate data from multiple sources into cloud architectures.
• Work with data scientists and analysts to meet data requirements.
• Operate in a matrixed team, sharing responsibilities across teams.
• Perform data profiling on structured and unstructured data.
• Design and map ETL/ELT pipelines for new or modified data streams.
• Automate and maintain ETL/ELT processes with Databricks, ADF, SSIS, Spark, Python, Scala.
• Identify design/development issues and propose improvements.
• Conduct unit, system, and integration testing for ETL/ELT solutions.
• Create documentation for data processes and architectures.
• Monitor and optimize data pipelines and databases.

Kenntnisse

Data warehousing

ETL/ELT

CI/CD practices

Distributed processing

Tools

Databricks

Azure Data Factory

SSIS

Spark

Python

Scala

Jobbeschreibung

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a data engineering expert with deep knowledge of Microsoft data services (Azure Fabric, ADF, Synapse) to design, develop, and maintain cloud-based data pipelines and BI-ready solutions.

The role focuses on modernizing legacy ingestion, ETL/ELT processes, implementing secure data access patterns, and collaborating with data scientists and business stakeholders to deliver scalable analytics across on-prem and cloud environments.