Shape and evolve enterprise data architecture through scalable pipelines, platform modernization, and HIPAA-aligned data practices.
Responsibilities
- Contribute to strategic direction for enterprise data architecture, aligning with business goals and long-term scalability.
- Lead evaluation and adoption of emerging data technologies, platforms, and frameworks to improve innovation and efficiency.
- Design and implement complex, cross-domain data solutions for advanced analytics, AI/ML, and operational intelligence.
- Modernize enterprise data infrastructure, including migration to cloud-native platforms and adoption of Microsoft Fabric components.
- Architect scalable, secure, and efficient data pipelines and data architectures.
- Evaluate and recommend tools, frameworks, platforms, and best practices for data engineering.
- Enforce coding standards, conduct code reviews, and mentor others on engineering best practices.
- Ensure data quality, lineage, and regulatory compliance with a focus on HIPAA.
- Maintain high customer responsiveness, with strong documentation and communication and attention to detail.
- Build and maintain data pipelines, data flows, PySpark notebooks, and semantic models.
- Assemble complex data sets from multiple domains to meet functional and non-functional requirements.
- Improve internal processes by running and automating manual processes, improving data delivery, and redesigning infrastructure for greater scalability.
- Create ETL/ELT processes to extract, transform, and load data from SQL, web APIs, and spreadsheets.
- Collaborate with Executive, Product, Data, and Design teams to resolve data-related technical issues and support data infrastructure needs.
- Ensure data separation through access controls for diverse use cases, including HIPAA, personally identifiable information, and financial data.
- Create data tools that help analysts and domain experts build and improve company services.
- Partner with domain experts and analysts to improve how value is extracted from data systems.
- Assess current data and identify additional data sources that can provide further value.
- Deliver long-term IT data projects with competing priorities.
- Lead documentation efforts and support onboarding and assistance for new data engineers.
- Conduct performance optimization by identifying bottlenecks and improving data process performance.
- Mentor junior data engineers with guidance, training, and support.
Requirements
- 10+ years of experience in data engineering or closely related fields.
- Expert-level SQL knowledge, including query authoring and experience with relational databases.
- Advanced knowledge of traditional ETL technologies, including Microsoft SSIS, Informatica, and Talend (preferred).
- Experience with emerging cloud data platforms such as Microsoft Fabric, Snowflake, and Databricks (preferred).
- Experience with distributed processing technologies including Apache Spark and related querying languages such as PySpark and Spark SQL (preferred).
- Proven experience building data pipelines, architectures, and data sets with little to no documentation across major domains.
- Experience performing root cause analysis on internal and external data and processes to answer business questions and identify improvement opportunities.
- Strong analytical skills.
- Ability to build processes for data transformation, data structures, metadata, dependency, and workload management.
- Track record manipulating, processing, and extracting value from disconnected datasets.
- Experience supporting cross-functional teams in a dynamic environment.
Technology Stack
- SQL
- Microsoft SSIS
- Informatica
- Talend
- Microsoft Fabric
- Snowflake
- Databricks
- Apache Spark
- PySpark
- Spark SQL
- HIPAA
- Web APIs
- Spreadsheets
Location / Schedule
- Tempe, AZ (onsite)
- PHOENIX, AZ
- 5 & 2
Core Competencies
- Safe
- Efficient
- Quality
- Service
Behavioral Competencies
- Show Real Grit
- Perform with Integrity
- Be a great team player
- Give and Get Help
Disclaimer: The above statements describe the general nature and level of work performed by people in this classification and are not an exhaustive list of responsibilities, duties, and skills required.