Senior Technical Data Analyst - Azure, Spark & Python

SMASH; Town of Texas (WI); On-site; USD 90,000 - 140,000; Full time

Job summary

SMASH in Wisconsin is seeking an experienced Technical Data Analyst to join our data team. You will work with large-scale datasets, write advanced SQL queries, and leverage Python, Spark, and Spark SQL to transform data and deliver actionable insights.

The role emphasizes Azure cloud environments and collaboration with business stakeholders. Familiarity with Microsoft Fabric is a plus; prior pharma, life sciences, or insurance experience is valued.

Qualifications

• 5–6+ years of experience working on technical Data Analyst or closely related data projects.
• Strong hands-on SQL experience.
• Strong hands-on Python experience for data analysis and processing.
• Experience with Apache Spark.
• Strong experience with Spark SQL.
• Hands-on experience with PySpark.
• Experience working within Microsoft Azure data environments.
• Experience analyzing and transforming large and complex datasets.
• Strong understanding of data structures, data quality, and data validation.
• Strong analytical and problem-solving skills.
• Ability to independently investigate technical data issues and drive them toward resolution.
• Strong communication skills and ability to collaborate across technical and business teams.

Responsibilities

• Analyze complex and large-scale datasets to identify trends, patterns, anomalies, and actionable insights.
• Develop advanced SQL queries to extract, transform, validate, and analyze data.
• Use Python and PySpark for data processing, transformation, automation, and analysis.
• Work with Apache Spark and Spark SQL to process and analyze large datasets efficiently.
• Support data analysis initiatives within Microsoft Azure environments.
• Collaborate with technical and business stakeholders to understand data requirements and translate them into analytical solutions.
• Perform data profiling, validation, reconciliation, and quality analysis to ensure accuracy and consistency.
• Investigate data issues and perform root-cause analysis across datasets and data workflows.
• Support the development and improvement of scalable data processes and analytical solutions.
• Document data requirements, business rules, analytical findings, and technical processes.
• Communicate technical findings clearly to both technical and non-technical stakeholders.

Skills

SQL

Python

Spark

Spark SQL

PySpark

Microsoft Azure

Tools

Microsoft Fabric

Job description

SMASH in Wisconsin is seeking an experienced Technical Data Analyst to join our data team. You will work with large-scale datasets, write advanced SQL queries, and leverage Python, Spark, and Spark SQL to transform data and deliver actionable insights.

The role emphasizes Azure cloud environments and collaboration with business stakeholders. Familiarity with Microsoft Fabric is a plus; prior pharma, life sciences, or insurance experience is valued.