Data Engineer: Azure & Databricks Data Pipelines

Vizient, Inc; Irving (IA); On-site; USD 77,000 - 135,000; Full time

Benefits offered by this job

Incentive plan

Job summary

Vizient, Inc. is seeking a data engineer in the United States (Iowa, Irving) to design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and related cloud technologies.

You will optimize SQL queries, build data solutions across Azure SQL and data warehouses, and support Databricks environments. The role involves data preparation for AI/ML, BI, and analytics, along with CI/CD and release management, collaboration with multiple teams, and ensuring data quality

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and other cloud-based technologies.
• Develop and optimize SQL queries, stored procedures, database processes, and data transformation solutions using SQL, Python, and/or Java.
• Build and support data solutions across Azure SQL, Azure SQL Managed Instance, Databricks, data warehouses, and lakehouse platforms.
• Configure and support Databricks workspaces, catalogs, clusters, jobs, workflows, access controls, and deployment processes.
• Support cloud infrastructure components, including storage, security, service connections, secrets, permissions, and environment configurations.
• Monitor, troubleshoot, and optimize data pipelines, databases, Databricks workloads, and cloud infrastructure to improve performance and reliability.
• Implement data validation, quality checks, error handling, and reconciliation processes to maintain data accuracy and integrity.
• Prepare, structure, and integrate data for artificial intelligence, machine learning, automation, business intelligence, and advanced analytics use cases.
• Participate in testing, code reviews, source control, CI/CD, deployment, and release management activities.
• Maintain technical documentation and collaborate with engineers, architects, analysts, infrastructure teams, and business clients to deliver scalable data solutions.

Job description

Vizient, Inc. is seeking a data engineer in the United States (Iowa, Irving) to design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and related cloud technologies.

You will optimize SQL queries, build data solutions across Azure SQL and data warehouses, and support Databricks environments. The role involves data preparation for AI/ML, BI, and analytics, along with CI/CD and release management, collaboration with multiple teams, and ensuring data quality