Senior Data Engineer – Financial Services Ops & AI

LE001 Berkeley Research Group, LLC; New York (NY); On-site; USD 158,000 - 210,000; Full time

Job summary

Berkeley Research Group (BRG) is launching a new Financial Services Operations & Technology practice in the United States. You will lead hands-on data engineering workstreams to transform operational data into AI-ready digital assets, collaborating with AI Co-lab and domain experts to deliver production-quality data foundations and practical implementation roadmaps.

Senior roles guide engineers, coordinate with change and risk teams, and contribute to reusable assets, with travel to client sites

Qualifications

• Minimum 5 years of hands-on data engineering delivery, with production pipelines and data products.
• Strong Python and SQL skills; ability to design, debug, optimize, and test ingestion and transformation processes across APIs, databases, files, and documents.
• Experience building warehouse or lakehouse models and explaining schema choices, storage, orchestration, and reconciliation.

Responsibilities

• Lead data engineering workstreams from discovery to production handover, managing dependencies and risks.
• Design and build batch and streaming pipelines in Python and SQL to ingest and reconcile data from various sources.
• Develop ingestion for structured and unstructured data, including extraction, metadata capture, and metadata lineage.
• Build data models for analytics and AI use cases with data quality checks, lineage, access controls, and PII handling.
• Collaborate with AI engineers and domain experts to frame data requirements and reusable approaches.
• Create automated tests, CI/CD pipelines, monitoring, and recovery procedures for data products.
• Mentor engineers and coordinate with AI, application, change, and risk teams to deliver integrated solutions.
• Capture domain knowledge in reusable schemas and pipeline components for proposals and client pursuits.

Skills

Python

SQL

Data pipelines

AI/ML concepts

Mentoring

Tools

Spark

dbt

Snowflake

APIs

Job description

Berkeley Research Group (BRG) is launching a new Financial Services Operations & Technology practice in the United States. You will lead hands-on data engineering workstreams to transform operational data into AI-ready digital assets, collaborating with AI Co-lab and domain experts to deliver production-quality data foundations and practical implementation roadmaps.

Senior roles guide engineers, coordinate with change and risk teams, and contribute to reusable assets, with travel to client sites