Lead Data Engineer

Inizio Partners Corp; Jersey City (NJ); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology consulting firm in Jersey City is seeking an experienced Data Engineer to lead cloud implementations and data processing solutions. The ideal candidate will have over 10 years of experience in Data Engineering, strong expertise in SQL, Python, and AWS, and a background in the insurance industry. You will collaborate with technical and non-technical stakeholders, ensuring effective data solutions. This position offers an opportunity for significant impact in a fast-paced environment.

Qualifications

• 10+ years of relevant experience in Data Engineering.
• Proven experience as a Data Engineer.
• Strong understanding of data warehousing concepts.
• Experience in the insurance industry is preferred.

Skills

SQL

Python

PySpark

Data Engineering

Agile Methodology

Snowflake

AWS

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Jenkins

GIT

Job description

Must have:

• 10+ years of relevant experience in Data Engineering and delivery.
• 10+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
• Strong experience with SQL, python and PySpark
• Good understanding of Data ingestion and data processing frameworks
• Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture)
• Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
• Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
• Experience working in Agile Methodology

Good to have:

Have experience in DevOps tools (Jenkins, GIT etc.) and practices, continuous integration, and delivery (CI/CD) pipelines.

Worked on cloud implementations, data migration, Data Vault 2.0, etc.

Requirements:

• Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer, with a focus on AWS and Snowflake.
• Strong understanding of data warehousing concepts and best practices.
• Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
• Experience in the insurance industry, preferably with knowledge of claims and loss processes.
• Proficiency in SQL, Python, and other relevant programming languages.
• Strong problem-solving skills and attention to detail.
• Ability to work independently and as part of a team in a fast-paced environment.

Preferred Qualifications:

• Experience with data modeling and ETL processes.
• Familiarity with data governance and data security practices.
• Certification in AWS or Snowflake is a plus.