Data Engineer -601/602 at Pinnacle Group Jersey City, NJ

kozmetickesluzby.vecnakraska.sk - Jobboard; Jersey City (NJ); On-site; USD 89,544 - 96,432; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401K contributions

PTO and sick leave

Job summary

Pinnacle Group is looking for a Data Engineer in Jersey City, NJ, who will focus on designing and executing data solutions using AWS, Python, and PySpark. The role emphasizes creating and maintaining data pipelines that support various business objectives.

Candidates should have formal data engineering training, advanced proficiency with SQL, and a solid understanding of cloud services and data modeling techniques. The position offers a contract with a competitive pay range of $65-$70 per hour.

Qualifications

• 2+ years of applied experience in data engineering concepts.
• Proficiency in writing and executing complex queries.
• Understanding of Agile methodology and CI/CD tools.

Responsibilities

• Design and deliver reliable data collection, storage, access, and analytics solutions.
• Develop and maintain data pipelines and architectures across diverse technical areas.
• Ensure compliance with data governance requirements.

Skills

AWS

Python

PySpark

SQL

Data modeling techniques

Data governance

Education

Formal training or certification in data engineering

Tools

Airflow

AWS Data Lake

Snowflake

Job description

Data Engineer -601/602 job at Pinnacle Group. Jersey City, NJ.

Position: Data Engineer- AWS

Location: Jersey City, New Jersey

Duration: Contract

Job ID: 172543

Job Overview

As a Data Engineer III specializing in Python, Spark, and Data Lake technologies within the Consumer and Community Bank, you will be a key member of an agile team. Your role will involve designing and delivering reliable data collection, storage, access, and analytics solutions that are secure, stable, and scalable. You will develop, test, and maintain essential data pipelines and architectures across diverse technical areas, supporting various business functions to achieve organizational objectives.

Responsibilities

• Review and ensure sufficient protection of enterprise data through controls.
• Make custom configuration changes in tools to meet business or customer requests.
• Update logical or physical data models based on new use cases.
• Utilize SQL frequently and understand NoSQL databases and their applications.
• Contribute to a team culture of diversity, opportunity, inclusion, and respect.
• Develop enterprise data models and maintain large-scale data processing pipelines.
• Lead code reviews and provide mentoring to team members.
• Drive data quality and ensure data accessibility for analysts and data scientists.
• Ensure compliance with data governance requirements and alignment with business goals.

Qualifications

• Formal training or certification in data engineering concepts with 2+ years of applied experience.
• Experience across the data lifecycle with advanced SQL skills and understanding of NoSQL databases.
• Proficiency in statistical data analysis and determining appropriate tools and data patterns.
• Extensive experience in AWS and maintaining data pipelines using Python and PySpark.
• Proficient in Python and PySpark for writing and executing complex queries.
• Proven experience in performance tuning to optimize job execution.
• Advanced proficiency in leveraging Gen AI models using APIs/SDKs.
• Expertise in cloud data lakehouse platforms such as AWS Data Lake, Databricks, or Hadoop.
• Proficiency in relational data stores like Postgres, Oracle, or similar, and NoSQL data stores like Cassandra, DynamoDB, or MongoDB.
• Advanced proficiency in Cloud Data Warehouses such as Snowflake or AWS Redshift.
• Experience with scheduling/orchestration tools like Airflow or AWS Step Functions.
• Proficiency in Unix scripting, data structures, and data serialization formats like JSON, AVRO, or Protobuf.
• Knowledge of big-data storage formats such as Parquet or Iceberg.
• Familiarity with data processing methodologies like batch, micro-batching, or streaming.
• Experience with data modeling techniques such as Dimensional, Data Vault, Kimball, or Inmon.
• Understanding of Agile methodology, TDD/BDD, and CI/CD tools.

Preferred Qualifications

• Knowledge of data governance and security best practices.
• Experience in conducting data analysis to support business insights.
• Strong expertise in Python and Spark.

Compensation

Pay Range: $65- $70

The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by applicable state or localities where you reside or work.

#LI-SS5