AZURE Data Solution Architect

Artifintech; Jefferson City (MO); On-site; USD 90,000 - 130,000; Full time

Job summary

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is seeking a data engineering expert with deep knowledge of Microsoft data services (Azure Fabric, ADF, Synapse) to design, develop, and maintain cloud-based data pipelines and BI-ready solutions.

The role focuses on modernizing legacy ingestion, ETL/ELT processes, implementing secure data access patterns, and collaborating with data scientists and business stakeholders to deliver scalable analytics across on-prem and cloud environments.

Qualifications

• 4+ years designing and implementing data warehouse and analytics solutions (on-premise and cloud).
• 3+ years data warehousing concepts (ETL/ELT, data quality, privacy/security, MDM) with hands-on use of ADF, Data Factory, SSIS.
• 3+ years experience with cloud data and cloud-native data lakes/warehouses; Microsoft Azure services (Fabric Lakehouse, ADF, Data Factory, Synapse).
• 2+ years experience in Python, Scala, or Java for distributed processing and analytics (Spark).
• Familiarity with CI/CD practices and tools such as Azure DevOps, Git, or Jenkins.

Responsibilities

• Lead modernization of legacy data ingestion and ETL/ELT to cloud technologies (AWS/Azure).
• Own ambiguity, navigate constraints with minimal supervision.
• Implement data access, classification, and security patterns meeting regulatory standards.
• Collaborate with technical teams through effective communication and collaboration.
• Translate business requirements into scalable data solutions with stakeholders.
• Integrate data from multiple sources into cloud architectures.
• Work with data scientists and analysts to meet data requirements.
• Operate in a matrixed team, sharing responsibilities across teams.
• Perform data profiling on structured and unstructured data.
• Design and map ETL/ELT pipelines for new or modified data streams.
• Automate and maintain ETL/ELT processes with Databricks, ADF, SSIS, Spark, Python, Scala.
• Identify design/development issues and propose improvements.
• Conduct unit, system, and integration testing for ETL/ELT solutions.
• Create documentation for data processes and architectures.
• Monitor and optimize data pipelines and databases.

Skills

Data warehousing

ETL/ELT

CI/CD practices

Distributed processing

Tools

Databricks

Azure Data Factory

SSIS

Spark

Python

Scala

Job description

The ideal candidate will have a deep understanding of Microsoft data services, including Azure Fabric, Azure Data Factory (ADF), Azure Synapse, and ETL/ELT processes. This role focuses on designing, developing, and maintaining cloud-based data pipelines and solutions to drive our analytics and business intelligence capabilities.

Key Responsibilities

• Provide technical leadership in modernizing legacy data ingestion, ETL/ELT, and databases to cloud technologies (AWS/Azure).
• Demonstrate a self-driven, ownership mindset to navigate ambiguity, resolve constraints, and mitigate risks with minimal supervision.
• Implement data access, classification, and security patterns that comply with regulatory standards (PII, locational data, contractual obligations, etc.).
• Build strong relationships with technical teams through effective communication, presentation, and collaboration skills.
• Collaborate with stakeholders, business analysts, and SMEs to translate business requirements into scalable solutions.
• Integrate data from multiple sources into cloud-based architectures, collaborating with cross-functional teams.
• Work closely with data scientists, analysts, and stakeholders to meet data requirements with high-quality solutions.
• Function within a matrixed team environment, sharing responsibilities across various teams.
• Perform data profiling and analysis on both structured and unstructured data.
• Design and map ETL/ELT pipelines for new or modified data streams, ensuring integration into on-prem or cloud-based data storage.
• Automate, validate and maintain ETL/ELT processes using technologies such as Databricks, ADF, SSIS, Spark, Python, and Scala.
• Proactively identify design, scope, or development issues and provide recommendations for improvement.
• Conduct unit, system, and integration testing for ETL/ELT solutions, ensuring defects are resolved.
• Create detailed documentation for data processes, architectures, and workflows.
• Monitor and optimize the performance of data pipelines and databases.

Required Skills and Qualifications

• 4+ years of experience in designing and implementing data warehouse and analytics solutions (on-premise and cloud).
• 3+ years of expertise in data warehousing concepts (ETL/ELT, data quality management, privacy/security, MDM) with hands-on experience using ADF, Data Factory, SSIS, and related tools.
• 3+ years of experience with cloud data and cloud-native data lakes/warehouses. Microsoft Azure services (Fabric Lakehouse, ADF, Data Factory, Synapse, etc.).
• 2+ years of experience in Python, Scala, or Java for use with distributed processing and analytics, such as Spark.
• Familiarity with CI/CD practices and tools such as Azure DevOps, Git, or Jenkins.

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract