Senior Data Engineer - Financial Services Ops & AI

Berkeley Research Group; New York (NY); On-site; USD 180,000 - 250,000; Full time

Job summary

Berkeley Research Group is launching a new Financial Services Operations & Technology practice. You will lead hands-on data engineering workstreams, turning operational data and domain knowledge into AI-ready digital assets.

You will mentor engineers, collaborate with AI specialists and client teams, and help deliver production-quality data foundations and implementation roadmaps. You will design batch/streaming pipelines, ingestion processes, and lakehouse models, while ensuring data quality,

Qualifications

• 5+ years of relevant work experience for Managing Consultant level; 7+ years for Sr. Managing Consultant.
• Hands-on delivery of production data pipelines and data products at senior level.
• Strong Python and SQL skills for ingestion, transformation, and orchestration.
• Experience with warehouse/lakehouse models and data governance controls.
• Ability to translate business and risk requirements into engineering tests and controls.
• Prepare data for AI retrieval with document parsing, indexing, and metadata design.
• Deliver maintainable data services with version control, CI/CD, monitoring, and cloud infra.
• Lead complex workstreams, mentor engineers, and communicate estimates to clients.

Responsibilities

• Lead data engineering workstreams from discovery through production handover.
• Design and build batch and streaming pipelines in Python and SQL.
• Develop ingestion for structured and unstructured data with metadata capture.
• Design warehouse/lakehouse models to support reporting and AI use cases.
• Implement data quality, lineage, access controls, and PII handling.
• Prepare retrieval-ready data with parsing, chunking, and indexing.
• Collaborate with AI Co-lab and vendor partners to frame data requirements.
• Build tests, deployment pipelines, monitoring, and recovery procedures.
• Mentor engineers and coordinate with AI, application, change, and risk teams.

Skills

Python

SQL

Data pipelines

Mentoring

Client collaboration

Leadership

Tools

Spark

dbt

Job description

Berkeley Research Group is launching a new Financial Services Operations & Technology practice. You will lead hands-on data engineering workstreams, turning operational data and domain knowledge into AI-ready digital assets.

You will mentor engineers, collaborate with AI specialists and client teams, and help deliver production-quality data foundations and implementation roadmaps. You will design batch/streaming pipelines, ingestion processes, and lakehouse models, while ensuring data quality,