Senior Data Engineer

Insight Global; Seattle (WA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

[e-mail]

Job summary

Insight Global is seeking a Senior Data Engineer in Seattle, WA to support a day-to-day production release team with a DevOps mindset. You will own data pipelines, secure data views, and modernize pipelines using Delta Live Tables and Unity Catalog, while leveraging CI/CD and Azure DevOps.

You will collaborate with an engineering team, participate in Agile ceremonies, and contribute to our Engineering Community of Practice. Strong experience with Azure, Snowflake, and Data Factory is required.

Qualifications

• 7+ years' data engineering experience, with at least 5 years in an Azure environment.
• Experience with DBT/DLT and working with Medallion Architecture.
• Experience with Azure Cloud deployments and configurations.
• Experience with CI/CD principles and best practices including Azure DevOps and Repos.
• Experience with Azure Data Factory, Azure Data Bricks, Snowflake, and Storage Accounts.
• Experience working with a Data Engineering team and understanding of Data Engineering practices.
• Experience with bug tracking and task management software such as JIRA.
• Azure certification is preferred.
• Experience with Terraform and ARM templates is preferred.

Responsibilities

• Create and maintain data pipelines.
• Publish secure data views to Enterprise Data Exchange via Snowflake.
• Data pipeline modernization and migration via Delta Live Tables (DLT) and Unity Catalog.
• Leverage existing CI/CD process for pipeline deployment.
• Adhere to PII encryption and masking standards.
• Support improvements to CI/CD processes and production monitoring.
• Participate in on-call support rotations and Agile ceremonies.
• Contribute to Engineering Community of Practice.

Skills

Azure

DBT

Delta Live Tables

Medallion Architecture

CI/CD

JIRA

Tools

Azure DevOps

Azure Repos

Azure Data Factory

Azure Databricks

Snowflake

Storage Accounts

Terraform

ARM templates

Job description

Job Description

We're hiring for a Senior Data Engineer in Seattle, WA to support a well-known athletic & lifestyle brand. You will be part of a day-to-day production release team and may perform on-call support functions as needed. Having a DevOps mindset is the key to success in this role, as Engineers are commonly part of full DevOps teams that “own” all parts of software development, release pipelines, production monitoring, security and support.

Data Engineering Projects

• Data pipeline creation and maintenance.
• Create secure data views and publish them to the Enterprise Data Exchange via Snowflake for other teams to consume.
• Data pipeline modernization and migration via Databricks Delta Live Tables (DLT) and Unity Catalog.
• Leverage existing CICD process for pipeline deployment.
• Adhere to PII encryption and masking standards.

DevOps Support

• Support improvements to current CICD process.
• Production monitoring and failure support.
• Provide an escalation point and participate in on-call support rotations.
• Participate in discussions on how to improve DevOps.
• Be aware of product release and how that impacts our business.
• Take part in Agile ceremonies.
• Perform engineering assignments using existing procedures and best practices.
• Conduct research to aid in product troubleshooting and optimization efforts.Participate in and contribute to our Engineering Community of Practice.

Skills and Requirements

7+ years' data engineering experience, with at least 5 years in an Azure environment.Experience with DBT/DLT and working with Medallion ArchitectureExperience with Azure Cloud deployments and Configurations.Experience with CI/CD principles and best practices including Azure DevOps and Repos.Experience with Azure Data Factory, Azure Data Bricks, Snowflake, and Storage Accounts.Experience working with a Data Engineering team and understanding of Data Engineering practices.Experience with bug tracking and task management software such as JIRA, etc.Experienced in managing outages, customer escalations, crisis management, and other similar circumstances.Azure certification is preferred.Experience with Terraform and ARM templates is preferred.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [e-mail].