Data Engineer at Guardian Life Bethlehem, PA

kozmetickesluzby.vecnakraska.sk - Jobboard; Bethlehem (Northampton County); Hybrid; USD 95,170 - 156,355; Full time

Job summary

Guardian is seeking a Data Engineer to join their team in Bethlehem, PA. This role involves establishing and maintaining scalable data pipelines and collaborating with data architects and scientists. The ideal candidate should have extensive experience in SQL, Python, and cloud technologies.

The position allows for a hybrid work model and offers a competitive salary range of $95,170.00 to $156,355.00 based on qualifications and experience.

Qualifications

• 10+ years of IT experience with 5+ years as a data engineer.
• Expert in SQL and relational databases.
• Hands-on experience with Python and PySpark.

Responsibilities

• Develop and maintain data pipelines using ETL processes.
• Collaborate with cross-functional teams to meet data needs.
• Monitor and troubleshoot data pipelines.

Skills

Data Modeling

SQL Proficiency

ETL Processes

Data Pipeline Development

Education

Bachelor's or Master's in IT or related field

Tools

Databricks

AWS

Informatica

Job description

Overview

Guardian is seeking a Data Engineer to join the team responsible for establishing and maintaining an optimized, scalable data pipelines to provide access to high quality, consistent data in an easy and convenient manner to all authorized end users and applications of Guardian and its subsidiaries. As a Data Engineer, you will play a vital role in our data infrastructure and analytics ecosystem. You will work closely with data architects and data scientists to build and maintain data pipelines, transform raw data into actionable insights, and contribute to the development of cutting‑edge data solutions.

This is an excellent hands‑on opportunity to experience the latest technologies and make a significant impact on our data‑driven initiatives. The position will integrate new data sources from enterprise sources and external vendors using a variety of ingestion patterns including Structured Query Language (SQL) ingestion, file, and application programming interfaces (APIs).

Responsibilities

• Collaborate with cross‑functional teams to understand data requirements and translate them into effective data pipelines.
• Develop and maintain ETL processes using Python, PySpark, and SQL to extract, transform, and load data from various sources.
• Utilize Databricks for data processing, analysis, and optimization tasks.
• Work with Syncsort to enhance data integration and data quality.
• Assist in data modeling, schema design, and database optimization.
• Monitor and troubleshoot data pipelines to ensure data accuracy, reliability, and performance. Participate in code reviews, testing, and documentation efforts to maintain high‑quality code and data documentation.
• Stay updated on industry trends and best practices in data engineering.
• Establish and maintain the quality, supportability, and performance of all processes.
• Continue to look for innovative and next‑generation solutions for solving data challenges.
• Establish real‑time data pipelines using AWS services like SQS / SNS and OpenSearch.

Qualities

• A self‑starter, self‑motivated team player with excellent communication skills, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs.
• An individual who works closely with IT and business leaders across the enterprise to drive and embed the Enterprise Data Strategy into transformational roadmaps ensuring key principles of Data Governance, Data Management, Data Analytics and Architecture are implemented.

Qualifications

• 10+ years of IT experience, with 5+ years of experience as a Data Architect, data engineer or other data professional.
• Expert relational database concepts and experience across multiple database technologies (e.g., SQL, NoSQL, Oracle, Hadoop, Postgres) environments.
• Expert proficiency in data modelling tools – preferably Erwin and strong logical and physical data modelling experience.
• Hands‑on experience in data engineering with extensive knowledge of SQL and PySpark on Databricks platform.
• Hands‑on experience designing, building, and optimizing data pipelines and architecture for large‑scale data warehousing projects.
• Experience with cloud data services such as Redshift, RDS, Snowflake and Databricks.
• Knowledge of AWS data services is a big plus.
• Demonstrated expertise with data sourcing, profiling, data mapping and data analysis.
• Strong SQL, PL/SQL experience and skilled in creating and optimizing queries and data structures.
• Knowledge of ETL concepts, preferably Informatica or Syncsort.
• Experience with one or more SQL‑on‑Hadoop technology (Hive, Presto, Spark SQL) and Hadoop ecosystem.
• Ability to design cloud and on‑prem data solutions and provide guidance across storage, big data platform services, Hadoop ecosystem, vendor SaaS integrations, RDBMS and NoSQL databases is a plus.
• Excellent written and verbal communication skills and creative problem‑solving skills.
• Ability to adapt to changing business priorities and experience with effectively communicating change across different levels in the organization.
• Strong listening skills and ability to provide constructive feedback.
• SAFE experience and the ability to work on cross‑functional, self‑organizing development teams is a plus.
• Significant experience interfacing with customers and management across business and IT.

Work Authorization Requirement

• Guardian Life is unable to sponsor employment visas for this position, now or in the future. Applicants must be legally authorized to work in the United States without employer sponsorship.
• Only U.S. citizens and lawful permanent residents (green card holders) will be considered for employment.

Location

• Hybrid – three days a week at a Guardian Office in New York NY, Holmdel NJ or Bethlehem PA.
• Only local candidates will be considered.
• Up to 10% travel within the NY/NJ/PA location.

Compensation

Salary range: $95,170.00 – $156,355.00. The salary range reflected above is a good faith estimate of base pay for the primary location of the position. The salary for this position will ultimately be determined based on education, experience, knowledge, and abilities of the successful candidate. In addition to salary, this role may also be eligible for annual, sales, or other incentive compensation.

Equal Employment Opportunity

Guardian is an equal‑opportunity employer. All qualified applicants will be considered for employment without regard to age, race, color, creed, religion, sex, affectionate or sexual orientation, national origin, ancestry, marital status, disability, military or veteran status, or any other classification protected by applicable law.

Accommodations

Guardian is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. Guardian also provides reasonable accommodations to qualified job applicants (and employees) to accommodate the individual's known limitations related to pregnancy, childbirth, or related medical conditions, unless doing so would create an undue hardship. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact [e-mail].