Sr. Data Engineer / Production Support Lead

Chubb; Philadelphia (Philadelphia County); On-site; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking a Sr. Data Engineer / Production Support Lead to enhance their North America enterprise data warehouse. In this pivotal role, you will ensure the seamless operation of the data warehouse, focusing on incident management, performance optimization, and collaboration with various teams to uphold data quality. Your expertise will be instrumental in addressing data discrepancies and driving solutions that impact business decisions daily. This position offers a unique opportunity to develop your technical skills while managing data-related projects that influence enterprise-wide data practices. Join a forward-thinking company where your contributions will make a significant difference.

Qualifications

• 8+ years of ETL development experience with strong data warehousing knowledge.
• Bachelor’s degree in Computer Science or equivalent experience required.

Responsibilities

• Lead incident management and performance optimization for the data warehouse.
• Collaborate with teams to ensure data quality and system stability.

Skills

ETL Development

Data Warehousing

Cloud Technologies (Azure, Snowflake)

Unix/Linux Scripting

Problem-Solving

Communication Skills

Education

Bachelor’s degree in Computer Science or related field

Tools

Informatica/IICS

Autosys

Azure Synapse

Snowflake

PERL

Shell Scripting

Python

Job description

By joining Chubb as a Sr. Data Engineer / Production Support Lead for our North America enterprise data warehouse, you'll be responsible forensuring the data warehouse operates smoothly and reliably, including incident management, performance optimization, and collaborating with other teams to maintain data quality and system stability. Our data warehouse platform is a strategic application within the business, feeding into multiple systems and applications both up and downstream with data that directly supports business decisions being made each and every day. With us, you’ll leverage your technical expertise to tactically and strategically handle data discrepancies, and partner with applications teams, IT teams across the business, our stakeholders, and our Data Architect to drive solutions that directly impacts how data is used throughout the business. You’ll have opportunities to build upon your technical skills and insurance knowledge as we continue the evolution of our data warehouse and related infrastructure. Through it all, we’ll also look to you to share your ideas and manage data related projects end to end that influence how we incorporate, validate, and distribute data enterprise-wide.

In this role, you will:

• Lead the process of identifying, prioritizing, and resolving production issues, ensuring minimal disruption to business operations.
• Investigate and identify the root causes of incidents to prevent recurrence
• Maintain clear and timely communication with stakeholders, including business users, IT teams, and management, throughout the incident lifecycle.
• Continuously monitor the data warehouse's performance, identifying bottlenecks and areas for improvement
• Implement performance tuning techniques to optimize query execution times, ETL processes, and overall system performance
• Collaborate with other teams to ensure the data warehouse has sufficient resources to meet current and future demands
• Implement and maintain data validation processes to ensure the accuracy and integrity of data in the data warehouse
• Address data quality issues, including data cleansing and transformation, to ensure data accuracy and consistency
• Participate in the planning and execution of data warehouse releases, ensuring minimal disruption to production operations
• Test new releases and changes to the data warehouse environment to ensure stability and functionality
• Build and maintain strong relationships with business users, IT teams, and other stakeholders
• Maintain comprehensive documentation of the data warehouse architecture, processes, and procedures
• Possess a strong understanding of data warehouse technologies, ETL processes, and database management systems
• Demonstrate strong analytical and problem-solving skills to effectively address technical issues and challenges
• Lead and mentor team members, providing guidance and support as needed

Qualifications

• Bachelor’s degree required in Computer Science, Computer Information Systems, Information Systems, Information Technology or Computer Engineering or equivalent work experience
• 8+ years of Strong understanding of ETL development concepts and tools such as ETL development solutions (Informatica/IICS)
• 5+ years of Experience with Data Warehousing and Cloud Technologies like Azure (Synapse, Data bricks, Snowflake ).
• 3+ years of experience in scheduling jobs using Autosys (or comparable distributed scheduler)
• 3+ years of experience writing Unix/Linux or Windows Scripts in tools such as PERL, Shell script, Python, etc.
• 3+ years of experience in creating complex technical specifications from business requirements/specificationsDemonstrated critical thinking skills and the ability to identify and resolve data quality issues, performance bottlenecks, and other ETL-related problems
• Excellent communication and interpersonal skills
• Experience leading a team and providing technical guidance to junior data engineers