Data Engineer

Global Business Ser. 4u; Boston (MA); Hybrid; USD 130,000 - 190,000; Full time

Job summary

Global Business Ser. 4u seeks a Lead Data Engineer to implement data engineering and analytics solutions within an agile team. You will own data ingestion, validation and delivery for the investment data platform, collaborating with technology peers, investment professionals and vendors.

Lead development of pipelines sourcing from internal and external sources, drive data quality and system monitoring, and partner with architects to evolve the unified data model and platform integration.

Qualifications

• Bachelor’s degree in Computer Science or related disciplines.
• 5+ years of design and development of data-oriented applications.
• 2–4 years hands-on Advanced SQL experience.
• Experience with ETL/ELT, data warehouse and analytics architectures; Snowflake and cloud databases preferred.
• Development on PAAS platforms such as Azure, GCP or AWS.
• Strong understanding of Agile SDLC, DevOps and cloud technologies.
• Knowledge of UDМ, data mesh, event-driven architectures and real-time data flows.
• Experience in financial services data domain is desirable.

Responsibilities

• Design, develop and implement data pipelines for a unified data platform.
• Lead development activities and align solutions with program objectives.
• Develop and maintain data ingestion from internal and external sources.
• Improve data quality, resiliency, control, efficiency and monitoring.
• Troubleshoot complex system interactions and root causes.
• Collaborate with platform/data/ integration architects to upgrade components.
• Support outages and incident response when needed.

Skills

Data pipelines

Data quality

Agile SDLC

DevOps

Data warehousing

Real-time data

Education

Bachelor’s degree in Computer Science or related disciplines

Tools

Snowflake

Azure

GCP

AWS

Job description

Boston, MA || Hybrid Only localno NO Relocation

Job Description

We are searching for a Lead Data Engineer to implement data engineering and analytics solutions. Primary responsibilities include full implementation and maintenance of data ingestion, data maintenance, data validation and data delivery of investment data. We are looking for someone who thrives in an agile, collaborative, team-based environment, working closely with technology peers across the organization, investment professionals and key vendor partners.

• Design, develop, and implement data pipelines to maintain unified data platform for the Investment Data Management Office(IDMO)
• Lead and participate in all development activities, develop and implement solutions to meet business requirements that align with program strategic objectives
• Responsible for new and on-going development of data pipelines sourcing from internal and external sources
• Drive continuous improvement of data quality, resiliency, control, efficiency, and monitoring
• Troubleshooting complex system interactions to find the root cause to problems
• Partner with platform lead to design, develop, implement and deploy new software components to investment data platform
• Partner with data architect to evaluate and finalize the unified data model
• Partner with integration architect to upgrade and integrate data ingestion and data delivery tools with the unified data platform
• Upgrade and integrate transformation tool, data validation tool and orchestration tools with the unified data platform to implement data engineering, analytical engineering and data maintenance capabilities.
• Provide support during unexpected outages

Job Requirements

• Bachelor’s degree in Computer Science or related disciplines.
• Minimum of 5 years of experience in design, development and building data oriented complex applications.
• Minimum of 2-4 years of hands-on progressive experience from SQL to Advanced SQL.
• Experience working in data integration (ETL/ELT), data warehouse, data analytics architecture and sound understanding of design principles. Knowledge of and experience with Snowflake and other cloud native databases is highly preferred.
• Development Experience in Cloud based PAAS platforms like Microsoft Azure, Google GCP or Amazon AWS
• Deep understanding of Agile SDLC, DevOps and Cloud technologies required, in addition to exposure to multiple, diverse technologies, platforms, and processing environments.
• Knowledge about various architectures, patterns such as unified data management architecture (UDM), data mesh architecture, event-driven architecture, real-time data flows, non-relational repositories, data virtualization, etc.
• Experience with building solutions in the financial services domain with an understanding of financial instruments, transactions, and positions, is desired.
• Good interpersonal and communication skills with the ability to lead cross-team collaboration and partnerships across a variety of internal and external constituencies.