Sr. Data Engineer – Azure

INSPYR Solutions; Scottsdale (AZ); Hybrid; USD 134,000 - 196,000; Full time

Job summary

A technology solutions provider is looking for a Senior Data Engineer to lead the design and optimization of data solutions in a cloud-forward environment. This role requires expertise in Azure Data Factory, Python, and SQL Server, along with strong analytical skills to drive data-driven decision-making. The successful candidate will collaborate with various teams and ensure data integrity. Experience in agile environments and mentoring skills are preferred.

Qualifications

• 10+ years of experience in data engineering, data warehousing, and analytics.
• 7+ years of expertise in building data pipelines using Python, Spark, and Scala.
• 5+ years of strong expertise in SQL Server and Azure data engineering.

Responsibilities

• Design and maintain scalable data pipelines and ETL processes.
• Perform data quality checks and troubleshoot issues across the pipeline.
• Collaborate with teams to deliver impactful insights and solutions.

Skills

Azure Data Factory

Databricks (Spark, Python, Scala)

Power BI

SQL Server

RESTful APIs

Agile methodologies

Data Governance

Education

Bachelor's degree in Computer Science or Information Systems

Tools

Azure DevOps

GitHub

Jenkins

Job description

Overview

Role: Sr. Data Engineer - Azure
Location: Hybrid in Scottsdale AZ
Duration: Full Time, Direct Hire
Compensation: $134-196k
Work Requirements: US Citizen, GC Holders or Authorized to Work in US

If interested, please contact Margot Parsons at [e-mail] or call 714-465-5478

JOB SUMMARY

We are seeking a highly skilled and motivated Senior Data Engineer to lead the design, development, and optimization of enterprise-grade data pipelines and analytics platforms. This is an exciting opportunity to shape the future of data infrastructure in a dynamic, cloud-forward environment. You will play a critical role in enabling data-driven decision-making across the organization by building scalable, secure, and high-performance data solutions primarily within the Azure ecosystem.

As a strategic contributor, you\'ll collaborate with cross-functional teams to deliver impactful insights, drive innovation, and ensure data integrity across platforms. This role is ideal for a seasoned data engineering professional who thrives in a fast-paced, agile environment and is passionate about transforming raw data into actionable intelligence.

Principal Duties & Responsibilities

Data Architecture & Engineering

• Design, develop, and maintain scalable data pipelines and ETL processes for batch and streaming workloads using Azure Data Factory, Databricks (Spark, Python, Scala), and other tools.
• Implement and optimize data ingestion, transformation, and storage solutions using Azure Data Lake, Azure SQL, and Delta Lake with Medallion Architecture and Unity Catalog.
• Develop and maintain robust data models, schemas, and dictionaries to support efficient data retrieval and reporting.

Data Quality & Governance

• Perform data profiling, cleansing, validation, and quality checks to ensure accuracy and reliability.
• Troubleshoot and resolve data-related issues across the pipeline.
• Collaborate with data governance teams to implement lineage and quality frameworks using tools like Collibra.
• Build and maintain Power BI dashboards, reports, and visualizations to communicate insights effectively.
• Implement data transformations and modeling within Power BI to support business intelligence needs.
• Create and maintain technical documentation for reporting solutions and data structures.

DevOps & Agile Delivery

• Use Azure DevOps, GitHub, and Jenkins for CI/CD and deployment automation.
• Participate in Agile development cycles using Jira and Confluence, delivering features incrementally.
• Stay current with industry trends and proactively recommend improvements to data infrastructure and reporting capabilities.
• Work closely with business stakeholders, analysts, and developers to understand data requirements and deliver solutions.
• Communicate effectively across technical and non-technical teams.
• Demonstrate adaptability, multitasking, and problem-solving in a collaborative team environment.

Position Specifications

• Bachelor\'s degree in Computer Science, Information Systems, or equivalent practical experience.
• 10+ years of experience in data engineering, data warehousing, and analytics.
• 7+ years of expertise implementing data pipelines in cloud-based infrastructure using Python, Spark, and Scala for batch and streaming ETL workloads.
• 5+ years of strong expertise in SQL Server, SSIS, and Azure-based data engineering.
• 5+ years of experience with RESTful APIs and JSON for data integration and service communication.
• 3+ years of hands-on experience with Power BI, Azure Data Lake, Azure SQL, and Databricks.
• Familiarity with build and deployment tools such as Azure DevOps, GitHub, and Jenkins, within Agile and DevOps environments.

Preferred Qualifications:

• Industry certifications in Azure, GCP, or AWS.
• Experience with containerization technologies like Docker and Kubernetes, and shell scripting in Bash, Unix, or Windows.
• Experience with programming languages such as Java, JavaScript, or C/C++ for backend development and data processing.
• Experience in Banking and Financial Services domains.
• Experience with Collibra for data lineage and data quality management.
• Exposure to Power Platform tools, including Power Automate and Power Apps.

About INSPYR Solutions

Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients\' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.