AVP, Senior Data Engineer

Synchrony; United States; Remote; USD 110,000 - 185,000; Full time

Job summary

An established industry player is seeking an Enterprise Data Lake Principal Product Engineer to oversee the administration of a robust Big Data platform. This role is pivotal in ensuring the platform's availability, performance, and security while managing large datasets from various sources. You'll collaborate with architects and data scientists to design scalable solutions and lead the implementation of monitoring tools to enhance system performance. Join a company that values flexibility and innovation, offering you the chance to work from home or in one of their offices, while contributing to cutting-edge data-driven systems.

Qualifications

• 4+ years of experience as a Hadoop platform run lead or equivalent.
• 5 years of experience with production support operational processes.
• Experience with issue management and escalation processes.

Responsibilities

• Design and implement scalable data applications on Big-Data platforms.
• Resolve problems through evaluation of business and system processes.
• Drive implementation of monitoring tools for performance measurement.

Skills

Hadoop

Spark

Hive

Kafka

API

Scala

Python

SQL

AWS

DevOps

Education

Bachelor's degree

High School Diploma/GED

Tools

Unix/Linux

Cloud Platforms

Containerization

Job description

Job Description:

Role Summary/Purpose:

We are looking for an Enterprise Data Lake Principal Product Engineer who will play an integral role in the administration of our Enterprise Big Data platform. The platform will host significantly large datasets sourced from batch, real-time feeds, variety of user interactions with mobile apps and internal transactions. As Principal Product Engineer, you will be responsible for ensuring our platform availability, performance, security, maintenance - upgrades, installation, and user administration across all Data Lake environments both on-prem & cloud. We are looking for a Hadoop professional who is passionate about creating data driven systems and have experience in maintaining large complex distributed systems at scale in production.

Our Way of Working

We’re proud to offer you choice and flexibility. At Synchrony, our way of working allows you to have the option to work from home, near one of our Hubs or come into one of our offices. Occasionally you may be required to commute to our nearest office for in person engagement activities such as business or team meetings, training and culture events.

Essential Responsibilities:

• Be the SME for all platform issues / POCs for immediate complex issues and finalize the new feature which to be enabled on EDL.
• Responsible for the design and implementation of scalable & fault tolerant data applications on Big-Data & Cloud Platforms to store and process terabytes of data from upstream sources with high availability.
• Partner with information architects, platform architects, data scientists and product management on solution requirements to design solutions.
• Resolve problems through in-depth evaluation of business processes, system processes, enterprise standards & procedures.
• Responsible for design, development, testing oversight and production implementation using Spark, Hive, Kafka, API, Scala, Python, SQL & AWS.
• Work with development teams to assist in code promotion across environments and deployments in production, including CMDB CI creation and updates.
• Perform capacity planning and expansion activities working across Infrastructure and other Enterprise Services teams, including financial planning.
• Ensure all existing data lake functionality is running as expected and we are meeting SLA’s and reporting on SLA compliance.
• Drive implementation of monitoring tools to measure the performance of the environments.
• Drive integration of the environments with service management tools to drive automated incident management and reporting.
• Define and lead a feedback mechanism for the build teams to identify areas of improvement to enhance supportability of new functionality.
• Define metrics and provide reporting on application outages on all clusters.
• Provide RCA analysis to key environment stakeholders.
• Work with build teams to analyze the impact of new functionality releases on the production clusters to identify potential risks and mitigate them and be part of the DevOps process.
• Analyze, Design & Builds operational services which run and repairs themselves.
• Works on reducing Manual, Repetitive and Non-value work.
• Capacity and life cycle management – trend analysis & software concurrency.
• Perform other duties and/or special projects as assigned.

Qualifications/Requirements:

• Bachelor's degree with minimum 4+ years of industry experience as a Hadoop platform run lead Or in lieu of Degree, a High School Diploma/GED and 4 years of experience as a Unix/Linux Admin and 4 years as a Hadoop Platform Run Lead - in a production environment.
• 5 years of experience with production support operational processes and tools.
• 5 years of experience with enterprise level Hadoop administration, support and code deployments on any major Hadoop distribution – MapR, Hortonworks, Cloudera – in a production environment.
• 4 years of experience with issue management and escalation processes, Hardware and Software Monitoring including Network performance, production installation & rolling upgrades, administering Hadoop Security components – in a Hadoop production environment.
• 4 years of experience troubleshooting and analyzing Hadoop application issues.
• 4 years of experience developing of Capacity Plans, Runbooks, and other operational documentation.
• 4 years of experience with design, management, implementation of Backup, Disaster Recovery, and/or High Availability solutions.
• DevOps experience within large enterprise organization is a plus.
• Cloud & Containerization experience with in large enterprise organization is a plus.

Desired Characteristics:

• Strong communication skills to drive and collaborate across enterprise teams with a sense of urgency, including facilitation and presentation skills to management teams.
• Demonstrated excellent planning and organizational skills.
• Experience collaborating with teams of internal and external technical staff, application teams, software support and operations staff.
• Experience with Agile project management methods and practices.
• Demonstrated ability to quickly learn new technology & tools.

Grade/Level: 11

The salary range for this position is 110,000.00 - 185,000.00 USD Annual and is eligible for an annual bonus based on individual and company performance.

Actual compensation offered within the posted salary range will be based upon work experience, skill level or knowledge.

Salaries are adjusted according to market in CA, NY Metro and Seattle.

Eligibility Requirements:

• You must be 18 years or older.
• You must have a high school diploma or equivalent.
• You must be willing to take a drug test, submit to a background investigation and submit fingerprints as part of the onboarding process.
• You must be able to satisfy the requirements of Section 19 of the Federal Deposit Insurance Act.
• New hires (Level 4-7) must have 9 months of continuous service with the company before they are eligible to post on other roles. Once this new hire time in position requirement is met, the associate will have a minimum 6 months’ time in position before they can post for future non-exempt roles. Employees, level 8 or greater, must have at least 18 months’ time in position before they can post. All internal employees must consistently meet performance expectations and have approval from your manager to post (or the approval of your manager and HR if you don’t meet the time in position or performance expectations).

Legal authorization to work in the U.S. is required. We will not sponsor individuals for employment visas, now or in the future, for this job opening. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

Our Commitment:

When you join us, you’ll be part of a diverse, inclusive culture where your skills, experience, and voice are not only heard—but valued. We celebrate the differences in all of us and believe that our individual, unique perspectives is what makes Synchrony truly a great place to work. Together, we’re building a future where we can all belong, connect and turn ideals into action. Through the power of our 8Diversity Networks+, with more than 60% of our workforce engaged, you’ll find community to connect with an opportunity to go beyond your passions.

This starts when you choose to apply for a role at Synchrony. We ensure all qualified applicants will receive consideration for employment without regard to age, race, color, religion, gender, sexual orientation, gender identity, national origin, disability, or veteran status.

Reasonable Accommodation Notice:

• Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.
• If you need special accommodations, please call our Career Support Line so that we can discuss your specific situation. We can be reached at 1-866-301-5627. Representatives are available from 8am – 5pm Monday to Friday, Central Standard Time.

Job Family Group:

Information Technology