The Senior Data Engineer will design, deploy, and maintain data engineering frameworks that support enterprise data requirements and enable data analytics initiatives. This onsite role in Tampa, FL emphasizes delivery of accurate, reliable, AI-ready data across cloud and on-premise environments, including production support with HIPAA compliance.
What You Will Do
- Complete engineering tasks such as data analysis, data modeling, reverse engineering, and performance optimization.
- Design, develop, and deploy data pipelines and solutions for data warehouses, marts, and lakehouse environments.
- Build and maintain infrastructure to extract, transform, and load data from multiple sources using AWS, Azure, Snowflake, SQL, and modern lakehouse architectures with Parquet and Apache Iceberg.
- Document technical specifications, data models, process flows, and standards, including processes and procedures.
- Define data engineering strategies and process improvements to optimize performance, scalability, reliability, data quality, security, cost, delivery, and automation.
- Establish data quality practices, including testing, monitoring, error handling, and deployment for data solutions.
- Guide and mentor data engineering team members on advanced concepts, technologies, and best practices.
- Provide rotational on-call production support, monitoring services and facilitating issue resolution for data engineering workloads.
- Ensure design, testing, documentation, and implementation practices align with HIPAA and other patient data management policies.
Required Qualifications
- Bachelor’s degree in information systems, Computer Science, Business Administration, or a related field.
- Minimum of 8 years of experience implementing data engineering initiatives.
- Minimum of 3 years of cloud experience with AWS and/or Azure.
- Minimum of 3 years of experience working with and communicating across cross-functional teams, including deriving requirements and architecting data models, shared datasets, and AI-ready data solutions.
Experience and Technical Background
- Hands-on experience with modern and traditional data integration and transformation technologies, including dbt, AWS Glue, Informatica, and Azure Data Factory.
- Experience designing and implementing Snowflake solutions, including data ingestion, ELT, data modeling, Streams, Tasks, Dynamic Tables, Snowpipe/Snowpipe Streaming, and Snowpark, with emphasis on performance, security, workload management, and cost optimization.
- Strong dbt experience, including models, incremental models, snapshots, tests, macros, packages, documentation, and reusable transformation frameworks.
- Experience integrating dbt with Git, CI/CD pipelines, and DevOps practices to support automated testing, code reviews, and deployments across development, test, and production environments.
- Experience with Azure data services including Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and Microsoft Fabric for ingestion, orchestration, transformation, and data platform development.
- Experience designing and building cloud-based data lake and lakehouse architectures using AWS, Azure, Parquet, Apache Iceberg, and related cloud services.
- Experience designing and building AI-ready data solutions, including curated and governed data products, metadata, data quality, and data structures supporting analytics, machine learning, generative AI, and AI/ML workloads.
- Experience working with Spark, Kafka, and Airflow for distributed processing, streaming, and workflow orchestration.
- Strong engineering foundation in data and database technologies, including advanced T-SQL and SQL.
- Experience working on Unix platforms and using scripting and programming languages such as Python.
- Experience working in Agile/SCRUM and software development environments, applying software engineering practices for code management, testing, and production support; ability to apply advanced data engineering principles and mentor team members.
- Ability to continuously seek and apply industry best practices and emerging technologies to improve data engineering capabilities and develop new solutions.
Technology Stack
AWS, Azure, Snowflake, SQL, Parquet, Apache Iceberg, AWS Glue, Informatica, Azure Data Factory, dbt, Git, CI/CD, DevOps, Git CI/CD pipelines, Snowpipe, Snowpipe Streaming, Snowpark, Snowflake Streams, Snowflake Tasks, Snowflake Dynamic Tables, Azure Data Lake Storage (ADLS Gen2), Microsoft Fabric, Spark, Kafka, Airflow, T-SQL, Unix platforms, Python, Agile/SCRUM.
Compensation
$108,492.80 - $165,422.40 per year (base pay range). Actual compensation may vary by location and job-related factors including experience, skills, education, and internal equity.
The organization reviews compensation regularly to support fair and equitable pay practices.
Location
Tampa, FL (onsite)
Salary Range
USD 108,492 - 165,422 per yearly