Data Engineer II

ICW Group; San Diego (CA); On-site; USD 95,000 - 161,000; Full time

Benefits offered by this job

Competitive benefits package

Paid time off

401K retirement plan with companymatch

Job summary

ICW Group is seeking a Data Engineer II who will design, develop, and implement data pipelines and storage solutions, partnering with IT Managers, BI, and Data Governance teams. You will help solve data problems, enable data-driven decisions, and optimize data delivery architecture across projects.

The role emphasizes building reliable, scalable pipelines, data quality, and collaboration with multiple teams to drive the data platform forward in a dynamic environment.

Qualifications

• Bachelor's degree in Computer Science, Applied Mathematics, Engineering, or related field.
• Minimum 3 years of experience in data integration/engineering (Cloud/Traditional).
• Insurance industry experience is a plus.
• Strong knowledge of data governance and data quality practices.

Responsibilities

• Design, develop, and maintain scalable data pipelines (batch/streaming).
• Analyze data elements and build conceptual/logical/physical data models.
• Design and support data warehouse schemas and ETL/ELT mappings.
• Test data sources, optimize performance, and reduce costs.
• Collaborate with BI/Data Science teams and data architects to ensure data availability and quality.

Skills

Data pipelines

ETL/ELT mappings

Data modeling

SQL

Python

Spark

Kafka

Hadoop

Databricks

Snowflake

Redshift

AWS

Education

Bachelor's degree in Computer Science or related field

Tools

MS-SQL

PostgreSQL

SSIS

Informatica

Talend

AWS

Job description

Are you looking to make an impactful difference in your work, yourself, and your community? Why settle for just a job when you can land a career? At ICW Group, we are hiring team members who are ready to use their skills, curiosity, and drive to be part of our journey as we strive to transform the insurance carrier space. We're proud to be in business for over 50 years, and its change agents like yourself that will help us continue to deliver our mission to create the best insurance experience possible.

PURPOSE OF THE JOB

The Data Engineer II will design, develop, and implement data pipelines, data integration and data storage solutions such as data warehouses, data lakes, relational and non-relational databases. The role will partner closely with IT Managers, Enterprise Business Intelligence, Data Governance and Data Science teams to solve business-significant data problems and enable data-driven decision-making, automation, and optimization. Data is central to ICW Group’s business strategy and digital evolution, and the Data Engineer ensures optimal data delivery architecture is consistent throughout all projects.

ESSENTIAL DUTIES AND RESPONSIBILITIES

Builds data solutions that ensure data integrity and information usability for enterprise-wide digital solutions and decision making.

• Creates and maintains scalable data pipelines and solutions (batch and/or streaming) that make the best use of traditional and cloud platforms (AWS or similar) by understanding the business, technology, and data landscape including real time data processing.
• Provides analysis of complex data elements and systems, data flow and in development of conceptual, logical, and physical data models as well as verification and implementation of ETL/ELT mappings and transformation logic.
• Designs, supports and peer reviews the data models and schemas for new and existing data sources for the data warehouse.
• Conducts unit, integration, and system tests on our data sources to validate data against source systems, and continuously optimize performance to improve query speed and reduce cost.
• Builds pipelines that are reliable, efficient, testable, and maintainable.
• Maintains a good understanding of the current landscape and assists in the analysis of data deficiencies, gaps, and opportunities.
• Contributes to building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using ‘big data’ technologies and tools.

Partners with various teams in implementing overall data solutions.

• Works closely with BI and Data Science teams in implementing various data streams.
• Collaborates with data architects to ensure the output of the physical models meet required needs— e.g., collaborates on data definition, data structure, data content and data usage.
• Partners with Enterprise Architecture, Technology, and Project teams to ensure consistency of solutions approach while maintaining data governance requirements.
• Contributes to data governance and data quality best practices including design reviews, unit testing, code reviews, and continuous integration and deployment.
• Collaborates with the Enterprise Architecture team to drive tooling and standards to improve the productivity and quality of output for data engineers across the company.

SUPERVISORY RESPONSIBILITIES

This role does not have supervisory responsibilities.

EDUCATION AND EXPERIENCE

Bachelor's degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field required, or equivalent combination for education and experience. Minimum 3 years of experience in a data integration (Cloud/Traditional) engineering related role required. Insurance experience a plus.

CERTIFICATES, LICENSES, REGISTRATIONS

• Data architecture or data engineering related certifications strongly desired.
• AWS Cloud Practitioner or more advanced AWS certification preferred.

KNOWLEDGE AND SKILLS

• Expertise with database & data warehouse design, using MS-SQL, PostgreSQL etc.
• Knowledge of Model and Design of DB schemas for read and write performance.
• Working knowledge of API or stream-based data extraction processes.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with AWS technologies like Redshift, S3, EC2, Glue, EMR, Kinesis, Lambda, DynamoDB, etc.
• Experience with modern data architectures and modern data platforms like Snowflake, Databricks etc.
• Experience with data technologies: Hadoop, Spark, Kafka, Spark & Kafka Streaming, Python, Scala, Talend etc.
• Knowledge and experience with data movement tools – SSIS, Profisee, Alteryx, Informatica.
• A self-starter mentality that thrives in a rapidly changing, fast-paced environment and tolerates ambiguity while demonstrating problem-solving.
• Strong analytical and time management skills. Self-motivated and able to handle tasks with minimal supervision.
• Must be organized, detail oriented, and able to multi-task. Ability to work well under pressure and deliver results with tight deadlines and under changing priorities.
• Ability to cross collaborate with multiple teams and offer value-added solutions to meet objectives.
• Strong verbal and written communication skills.

PHYSICAL REQUIREMENTS

This job operates in a professional office environment. While performing the duties of this job, the employee is regularly required to talk or hear. The employee frequently will sit, stand, walk, and bend during working hours. Requires manual and finger dexterity and eye-hand coordination. Required to lift and carry relatively light materials. Requires normal or corrected vision and hearing corrected to a normal range. Ability to work additional hours, as required.

WORK ENVIRONMENT

This position operates in an office environment and requires the frequent use of a computer, telephone, copier and other standard office equipment.

We are currently not offering employment sponsorship for this opportunity.

The current range for this position is $95,378.98 - $160,850.17. This range is exclusive of fringe benefits and potential bonuses. If hired at ICW Group, your final base salary compensation will be determined by factors unique to each candidate, including experience, education and the location of the role and considers employees performing substantially similar work.

WHY JOIN ICW GROUP?

• Challenging work and the ability to make a difference
• You will have a voice and feel a sense of belonging
• We offer a competitive benefits package, with generous medical, dental, and vision plans as well as 401K retirement plans and company match
• Bonus potential for all positions
• Paid Time Off
• Paid holidays throughout the calendar year
• Want to continue learning? We’ll support you 100%

ICW Group is committed to creating a diverse environment and is proud to be an Equal Opportunity Employer. ICW Group will not discriminate against an applicant or employee on the basis of race, color, religion, national origin, ancestry, sex/gender, age, physical or mental disability, military or veteran status, genetic information, sexual orientation, gender identity, gender expression, marital status, or any other characteristic protected by applicable federal, state or local law.

At ICW Group we offer a work environment that encourages entrepreneurialism and celebrates success. Our team members are hands-on contributors who are given the opportunity to make an impact. It's our people who make us an employer of choice and the vibrant company we are today.