Data Engineer

Open Systems Technologies; Newark (NJ); On-site; USD 123,984 - 151,536; Full time

Job summary

A large asset management firm is seeking a Data Engineer in Newark, NJ, focusing on building data pipelines with Python and Azure. Candidates should have at least 5 years of experience in data engineering and familiarity with financial services is essential. This is a full-time role, offering a pay range of $90-110/hr with responsibilities including developing enterprise Datawarehouse systems and collaborating in Agile environments.

Qualifications

• 5+ years in building data pipelines using Python or Java.
• 2+ years in Azure Cloud Services.
• Experience with Azure Data Factory.

Responsibilities

• Build and maintain applications for large-scale architectural migration within an Agile framework.
• Collaborate with Product Owner and Scrum Master to translate business needs into scalable applications.
• Develop and maintain enterprise Datawarehouse systems.

Skills

Building data pipelines using Python or Java

Azure Cloud Services

Azure Data Factory

Proficiency in SQL

Agile environments with Scrum methodology

Strong analytical and problem-solving skills

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Hadoop

ECS or Docker

Jira

Confluence

Job description

Get AI-powered advice on this job and more exclusive features.

A large asset manager is looking for a Data Engineer with Azure experience in Newark, NJ.

Pay: $90-110/hr (corp or W2)

Must be local to NY/NJ area - no relocation.

Must have experience in financial services.

Strong Python skills are required; Azure experience, especially with Azure Data Factory, is a big plus.

Responsibilities:

• Build and maintain applications for large-scale architectural migration within an Agile framework.
• Collaborate with Product Owner and Scrum Master to translate business needs into scalable applications.
• Manage data from diverse sources including web sources, databases, and flat files.
• Develop and maintain enterprise Datawarehouse systems.
• Design storage solutions for large data sets; plan for AWS cloud migration.
• Assess scalability impacts and ensure sustainable data management.
• Create interfaces supporting evolving applications and data sources.

Qualifications:

Required Skills:

• 5+ years in building data pipelines using Python or Java.
• 2+ years in Azure Cloud Services.
• Experience with Azure Data Factory.
• Knowledge of data lakes, data marts, and data warehouses.
• Proficiency in SQL for data analysis.
• Strong analytical and problem-solving skills.
• Experience working in Agile environments with Scrum methodology.

Desired Skills:

• Experience with Spark and Hadoop.
• Knowledge of deploying code pipelines.
• Experience with containers like ECS or Docker.
• Linux environment experience.
• Understanding of capital markets, especially Fixed Income.
• Familiarity with Jira, Confluence, SAFe, and DevOps.
• Ability to work quickly in dynamic settings.
• Bachelor's degree in Computer Science or related field.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology