Lead Data Engineer - Aws, Snowflake at Acunor Inc Jersey City, NJ

Acunor Inc; Jersey City (NJ); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Acunor Inc. in Jersey City is seeking a Lead Data Engineer (AWS) to design, develop, and implement data solutions using AWS and Snowflake.

This role requires guiding the data architecture and collaborating with cross-functional teams to translate business needs into scalable technical solutions. You will lead data pipelines, ensure data quality and security, and optimize storage for warehousing and analytics.

Qualifications

• 8+ years of relevant experience in Data Engineering and delivery.
• 8+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
• Strong experience with SQL, python and PySpark.
• Good understanding of Data ingestion and data processing frameworks.
• Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture).
• Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
• Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
• Experience working in Agile Methodology.

Responsibilities

• Lead the design, development, and implementation of data solutions using AWS and Snowflake.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Develop and maintain data pipelines, ensuring data quality, integrity, and security.
• Optimize data storage and retrieval processes to support data warehousing and analytics.
• Provide technical leadership and mentorship to junior data engineers.
• Work closely with stakeholders to gather requirements and deliver data-driven insights.
• Ensure compliance with industry standards and best practices in data engineering.
• Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.

Skills

Snowflake

SQL

Python

Spark

AWS Glue

Big Data Concepts

Education

Bachelor's or Master's degree in Computer Science/Information Technology

Tools

Jenkins

Git

Job description

Lead Data Engineer (AWS)

Location: Jersey City

Work mode: Hybrid (4 days a week onsite)

Key Skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts

Responsibilities

• Lead the design, development, and implementation of data solutions using AWS and Snowflake.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Develop and maintain data pipelines, ensuring data quality, integrity, and security.
• Optimize data storage and retrieval processes to support data warehousing and analytics.
• Provide technical leadership and mentorship to junior data engineers.
• Work closely with stakeholders to gather requirements and deliver data-driven insights.
• Ensure compliance with industry standards and best practices in data engineering.
• Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.

Must have

• 8+ years of relevant experience in Data Engineering and delivery.
• 8+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
• Strong experience with SQL, python and Pyspark.
• Good understanding of Data ingestion and data processing frameworks.
• Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture).
• Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
• Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
• Experience working in Agile Methodology.

Good to have

Have experience in DevOps tools (Jenkins, GIT, etc.) and practices, continuous integration, and delivery (CI/CD) pipelines.

Worked on cloud implementations, data migration, Data Vault 2.0, etc.

Requirements

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer, with a focus on AWS and Snowflake.
• Strong understanding of data warehousing concepts and best practices.
• Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
• Experience in the insurance industry, preferably with knowledge of claims and loss processes.
• Proficiency in SQL, Python, and other relevant programming languages.
• Strong problem-solving skills and attention to detail.
• Ability to work independently and as part of a team in a fast-paced environment.

Preferred Qualifications

• Experience with data modeling and ETL processes.
• Familiarity with data governance and data security practices.
• Certification in AWS or Snowflake is a plus.