Senior Data Engineer
Highmark
A complete application in a minute
Tailored resume and cover letter, ready to send.
Job summary
Highmark Inc. is seeking a senior data engineer to join a technical team and drive design, development, and maintenance of the organization's data infrastructure.
You will ensure reliable data movement, transformation, and storage across platforms while collaborating with data professionals, analysts, and engineers to optimize pipelines and ensure data quality and integrity. The role requires leadership, adaptability, and a proactive approach to implementing modern data engineering practices,
Qualifications
- 5 years of experience in algorithm design and data structures for scalable systems.
- 5 years in data engineering, ETL development, or data management.
- 5 years of SQL and experience with MySQL, PostgreSQL, or MongoDB.
- 5 years of data warehousing concepts and Snowflake/Redshift/BigQuery.
Responsibilities
- Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems
- Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs
- Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs
- Monitor work against production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly
- Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations.
- Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking
- Mentor other associate and intermediate data engineers as needed
- Perform data analysis and provide insights to support decision-making across various departments
- Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed
- Other duties as assigned or requested.
Skills
Education
Tools
Job description
This role is an integral senior member of a technical team, responsible for supporting the design, development, and maintenance of the organization's data infrastructure, ensuring the efficient and reliable flow of data across various systems. This position is responsible for ensuring the reliable movement, transformation, and storage of data across various platforms. The incumbent will work closely with data professionals, analysts, and engineers to build and optimize data pipelines, ensuring data quality and integrity. The ideal candidate is adaptable, solution-oriented, and capable of collaborating across multiple teams to support a broad range of data initiatives. The incumbent and team will be involved in every aspect of the data process, from idea generation, analysis, design, build, and support, using the latest technologies and design patterns.
Highmark Inc.
This role is an integral senior member of a technical team, responsible for supporting the design, development, and maintenance of the organization's data infrastructure, ensuring the efficient and reliable flow of data across various systems. This position is responsible for ensuring the reliable movement, transformation, and storage of data across various platforms. The incumbent will work closely with data professionals, analysts, and engineers to build and optimize data pipelines, ensuring data quality and integrity. The ideal candidate is adaptable, solution-oriented, and capable of collaborating across multiple teams to support a broad range of data initiatives. The incumbent and team will be involved in every aspect of the data process, from idea generation, analysis, design, build, and support, using the latest technologies and design patterns.
- Design, develop, and maintain robust data processes and solutions to ensure the efficient movement and transformation of data across multiple systems
- Develop and maintain data models, databases, and data warehouses to support business intelligence and analytics needs
- Collaborate with stakeholders across IT, product, analytics, and business teams to gather requirements and provide data solutions that meet organizational needs
- Monitor work against production schedule, provide progress updates, and report any issues or technical difficulties to lead developers regularly
- Implement and manage data governance practices, ensuring data quality, integrity, and compliance with relevant regulations.
- Collaborate on the design and implementation of data security measures, including access controls, encryption, and data masking
- Mentor other associate and intermediate data engineers as needed
- Perform data analysis and provide insights to support decision-making across various departments
- Stay current with industry trends and emerging technologies in data engineering, recommending new tools and best practices as needed
- Other duties as assigned or requested.
- 5 years of experience in design and analysis of algorithms, data structures, and design patterns in the building and deploying of scalable, highly available systems
- 5 years of experience in a data engineering, ETL development, or data management role.
- 5 years of experience in SQL and experience with database technologies (e.g., MySQL, PostgreSQL, MongoDB).
- 5 years of experience in data warehousing concepts and experience with data warehouse solutions (e.g., Snowflake, Redshift, BigQuery)
- 5 years of experience with Python and Spark framework
- 2 years of experience with Databricks7 years of experience with data pipeline and workflow management tools (e.g., Apache Airflow, AWS Glue, Azure Data Factory).
- 7 years of experience defining system architectures and exploring technical feasibility trade-offs for optimizing short term execution while planning for long term technical capabilities
- 7 years of experience working with a variety of technology systems, designing solutions or developing data solutions in healthcare
- 7 years of experience with cloud platforms (AWS, Azure, GCP) and their respective data services
- 7 years of experience in data governance, data quality, and data security best practices
- 7 years of experience translating requirements, design mockups, prototypes or user stories into technical designs
- 7 years of experience in producing data-related code that is fault-tolerant, efficient, and maintainable
- Demonstrated ability to achieve stretch goals in a highly innovative and fast-paced environment
- Adaptability Strong ability to take on diverse tasks and projects, adapting to the evolving needs of the organization
- Analytical Thinking Strong analytical skills with a focus on detail and accuracy
- Interest and ability to learn other data development technologies/languages as needed
- Technical Proficiency Comfortable with a range of data tools and technologies, with a willingness to learn new skills as needed
- Strong track record in designing and implementing large-scale data sources
- Strong sense of ownership, urgency, and drive
- Demonstrated passion for user experience and improving usability
- Team Collaboration A team player who can work effectively in cross-functional environments
- Experience and willingness to mentor junior data engineers and help develop their skills and leadership
- Bachelor’s degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field
- Master's degree in Computer Science, Information Systems, Data Science, Computer Engineering or related field
- None
- None
None
0% - 25%
Remote-based
Occasionally
Rarely
Never
No
Constantly
Occasionally
Rarely
The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job.
This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies.
As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company’s Handbook of Privacy Policies and Practices and Information Security Policy. Furthermore, it is every employee’s responsibility to comply with the company’s Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements.
$102,700.00
$164,600.00
Base pay is determined by a variety of factors including a candidate’s qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations. The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets.
Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.
California Consumer Privacy Act Employees, Contractors, and Applicants Notice
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
