Senior Data Architect Kafka Iceberg Mesh Finance Manhattan | Manhattan, NY, USA | Hybrid

Joseph Harry; New York (NY); Hybrid; USD 200,000 - 260,000; Full time

Job summary

A leading financial services firm in Manhattan is seeking a Senior Data Architect to lead a new data management platform project. This hybrid role requires expertise in Java or Python, AWS, and data governance. You'll work with a team to design and implement a data mesh architecture, ensuring compliance with regulations. The position offers a competitive salary and bonus structure, along with opportunities for growth and development within the company.

Benefits

401K

Bonus

Qualifications

• Hands-on experience as a Senior Data Architect/Engineering Manager.
• Excellent design and architecture ability for large data systems.
• Experience with data governance and regulation projects is desirable.

Responsibilities

• Lead technical design and architecture for a new data management platform.
• Implement data governance policies and automate data catalogue population.
• Collaborate with other teams in data engineering.

Skills

Java

Python

AWS

Kafka

CI/CD

Tools

SQL

Oracle

Apache Iceberg

Job description

Senior Data Architect Kafka Iceberg Mesh Finance Manhattan

Senior Data Architect Kafka Iceberg Mesh Finance Manhattan

Joseph Harry Manhattan, United States Apply now Posted 2 days ago Hybrid Job Permanent USD200000 - USD260000 per annum + 50% Bonus + 401K

Senior Data Architect (Architecture Lead Software Engineer Manager Solutions Java Python Automation Data Lake Datalake Data Mesh CI/CD Big Data AWS SQL Oracle Java Kafka Apache Iceberg Hoodie Finance Trading Financial Services Banking Remote Working Governance Management Regulation) required by our financial services client in Manhattan, New York City.

Senior Data Architect (Architecture Lead Software Engineer Manager Solutions Java Python Automation Data Lake Datalake Data Mesh CI/CD Big Data AWS SQL Oracle Java Kafka Apache Iceberg Hoodie Finance Trading Financial Services Banking Remote Working Governance Management Regulation) required by our financial services client in Manhattan, New York City.

You MUST have the following:

• Good experience as a hands-on Senior Data Architect/Engineering Manager/Principal Engineer
• Excellent design and architecture ability for systems involving a petabyte or more of data
• Advanced Java or Python
• Amazon Web Services (AWS) or GCP
• Enterprise-scale SQL or Oracle
• Kafka or equivalent for streaming
• Some CI/CD experience

The following is DESIRABLE, not essential:

• Experience delivery projects in data management, governance and regulation
• An understanding of data mesh architecture

Role: Senior Data Architect (Architecture Lead Software Engineer Manager Solutions Java Python Automation Data Lake Datalake Data Mesh CI/CD Big Data AWS SQL Oracle Java Kafka Apache Iceberg Hoodie Finance Trading Financial Services Banking Remote Working Governance Management Regulation) required by our financial services client in Manhattan, New York City. You will be hired to be the technical lead and co-manager of a new team that is being assembled to build a new data management platform on AWS. The greenfield project will include the automation of data catalogue population and the implementation of data governance policies. You will be the lead engineer/manager/solutions architect in a team that has a senior developer, mid-level developer and business lead. You and the business lead will share responsibility of the team. He will be responsible for the interpretation of data regulation, building of road maps and strategy and creation of policies. You will do the design, architecture and technical delivery of this strategy and his data policies. Over the course of the next year, you will hire more developers into the team and the workload grows. You will be working with Java or Python on AWS with Apache Iceberg. As the data environment moves from an AWS based data lake to a data mesh architecture, any understanding of data mesh would also be highly desirable.

You will also contribute to the two other teams in the data engineering space within the company- the data platform team which operates a Hudi based data lake and the team working with Iceberg and Kafka to create the new data mesh architecture- but the data governance programme will be your priority.

Hours are 8.30am - 5.30pm. Hybrid working is 2 days/week in the office.

Salary and Comp: $200k - $260k + 50% Bonus + 401k

Principal Data Engineer Kafka Iceberg Mesh Finance New York Joseph Harry Manhattan, United States

Data Engineering Manager Kafka Iceberg Mesh Finance New York Joseph Harry Manhattan, United States

Sr Development Manager Java TS Finance Trading New York Joseph Harry Manhattan, United States

Sr Engineering Manager Java TS Finance Trading New York Joseph Harry Manhattan, United States

Sr Development Manager Java TS Finance Trading New York Joseph Harry Manhattan, United States

More jobs from the company

Boost your career

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.