Big Data Engineer

Highmark Health; United States; On-site; USD 86,000 - 139,000; Full time

Job summary

Highmark Health in the United States is seeking a data solutions engineer to design and implement enterprise data solutions, working with business, analytic and IT stakeholders.

The role involves coding ingestion pipelines, transformations, and delivery programs, enabling data access for operational and analytic needs using platforms such as Google Cloud Platform, Hadoop, Hive, NoSQL, Kafka, Spark, Python, Linux shell scripting, SAS, Teradata, Oracle, and Informatica.

Qualifications

• Bachelor's Degree in Software Engineering, Information Systems, Computer Science, Data Science or related field
• 3 years of Data platform development, data engineering, software development, or data science
• 1 year of Big data or cloud data platform
• 1 year of Google Cloud Platform, AWS, Azure or other cloud platform
• 1 year of Spark or Python
• 1 year of Data science, AI & machine learning engineering
• 1 year Healthcare Industry
• 1 year of Database Administration

Responsibilities

• Design, build and maintain data solutions across data warehouses, big data, and cloud platforms.
• Collaborate with stakeholders to implement data sourcing, flow, and data models.
• Develop scalable data ingestion, transformation, and delivery pipelines.
• Support data governance, data quality, and metadata management.
• Maintain MLOps processes for cloud or big data environments.
• Lead project delivery and guide junior contributors.
• Stay current with cloud, big data and data science technologies.

Skills

SQL

Data Warehousing

Problem-Solving

Communication Skills

Analytical Skills

Education

Bachelor's Degree in Software Engineering, Information Systems, Computer Science, Data Science or related field

Job description

• CANDIDATE MUST BE US Citizen (due to contractual/access requirements)***

Company

Highmark Health

Job Description

JOB SUMMARY

• CANDIDATE MUST BE US Citizen (due to contractual/access requirements)***

This job is responsible for designing and engineering data solutions for the enterprise and, working closely with business, analytic and IT stakeholders, assists with the development and maintenance of these solutions. This includes coding data ingestion pipelines, transformations and delivery programs/logic for people and systems to access data for operational and/or analytic needs. Duties include but is not limited to the coding, testing, and implementation of ingestion and extraction pipelines, transformation and cleansing processes, and processes that load and curate data in conformed, fit-for-purpose data structures. The incumbent is expected to partner with others throughout the organization (including other engineers, architects, analysts, data scientists, and non-technical audiences) in their daily work. The incumbent will work with cross-functional teams to deliver and maintain data products and capabilities that support and enable strategies at business unit and enterprise levels. The incumbent is expected to utilize technologies such as, but not limited to Google Cloud Platform, Hadoop, Hive, NoSQL, Kafka, Spark, Python, Linux shell scripting, SAS, Teradata, Oracle, and Informatica.

ESSENTIAL RESPONSIBILITIES

• In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms.


• Work with internal and external platforms and systems to connect and align on data sourcing, flow, structure, and subject matter expertise. Work with business stakeholders and strategic partners to implement and support operational and analytic platforms. This may include products purchased by the organization that must be ingested or modeled/derived data maintained by enterprise platforms and data consumers.


• Working across multiple, disparate systems and platforms, code, test, implement, and maintain scalable and extensible frameworks that support data engineering services.


• Align with security, data governance and data quality programs by contributing to assigned components of metadata management, data quality management, and the application of business rules. Develop and maintain associated data engineering processes and participate in required operating procedures as part of the enterprise’s overall information management activities. Includes data cleansing, standardization, technical metadata documentation, and the de-identification and/or tokenization of data.


• Maintain machine learning and AI engineering processes (MLOps) that are deployed to cloud or big data environments.


• Responsible for delivery of assigned projects, this may include providing guidance to Junior contributors within team. Will attend meetings with customers as needed.


• Assist with the establishment of standards and patterns for high performance data ingestion, transformation, and delivery. Keep current with cloud, big data, and data science technologies and be able to recommend and use best tools to perform current and future work.


• Other duties as assigned or requested.

EDUCATION

Required

• Bachelor's Degree in Software Engineering, Information Systems, Computer Science, Data Science or related field

Substitutions

• None

Preferred

• Master's Degree Software Engineering, Information Systems, Computer Science, Data Science or related field

EXPERIENCE

Required

• 3 years of Data platform development, data engineering, software development, or data science


• 1 year of Big data or cloud data platform

Preferred

• 1 year of Google Cloud Platform, AWS, Azure or other cloud platform


• 1 year of Spark or Python


• 1 year of Data science, AI & machine learning engineering


• 1 year Healthcare Industry


• 1 year of Database Administration

LICENSES AND CERTIFICATIONS

Required

• None

Preferred

• None

SKILLS

• SQL


• Data Warehousing


• Problem-Solving


• Communication Skills


• Analytical Skills

Language (Other Than English)

None

Travel Required

0% - 25%

PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS

• Position Type


• Office-Based


• Teaches / trains others regularly


• Rarely


• Travel regularly from the office to various work sites or from site-to-site


• Does Not Apply


• Works primarily out-of-the office selling products/services (sales employees)


• Never


• Physical work site required


• No


• Lifting up to 10 pounds


• Frequently
  
• Lifting 10 to 25 pounds


• Occasionally


• Lifting 25 to 50 pounds


• Rarely

Disclaimer

The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job.

Compliance Requirement

This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies.

As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company’s Handbook of Privacy Policies and Practices and Information Security Policy.

Furthermore, it is every employee’s responsibility to comply with the company’s Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements.

Pay Range Minimum

$86,400.00

Pay Range Maximum

$138,600.00

Base pay is determined by a variety of factors including a candidate’s qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations. The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets.

Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.

We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below.

For accommodation requests, please contact HR Services Online at [e-mail]

California Consumer Privacy Act Employees, Contractors, and Applicants Notice