Senior Data Engineer – AI-Driven Financial Services Ops

Berkeley Research Group, LLC; New York (NY); On-site; USD 158,000 - 210,000; Full time

Job summary

Berkeley Research Group, LLC seeks leaders to drive data engineering for AI-ready financial services solutions. You will guide teams, design data models, and ensure data quality, provenance, and security across complex pipelines.

You will collaborate with AI specialists, domain experts, and client teams to deliver production-ready data foundations and actionable roadmaps. Travel to client sites may be required.

Qualifications

• Minimum 5 years of prior applicable work experience for Managing Consultant level.
• For Senior Managing Consultant, 7+ years of experience is required.
• Strong Python and SQL skills with experience building ingestion and transformation processes across APIs, databases, files, and documents.
• Applied data quality, lineage, least-privilege access, and sensitive-data controls in production.

Responsibilities

• Lead data engineering workstreams from discovery through production handover, managing dependencies and risks.
• Design and build batch and streaming pipelines in Python and SQL from operational sources.
• Develop ingestion for structured and unstructured data, with extraction, metadata, and traceability.
• Design warehouse/lakehouse data models supporting reporting, analytics, and AI use cases.
• Implement data quality checks, lineage, access controls, and PII handling with security teams.
• Prepare retrieval-ready data with document parsing, chunking, and indexing in collaboration with AI engineers.
• Collaborate with AI Co-lab and vendor partners to frame data requirements and validate approaches.
• Build automated tests, deployment pipelines, monitoring, and recovery procedures.
• Mentor engineers and coordinate with cross-functional teams to deliver integrated solutions.

Skills

Python

SQL

Data pipelines

Spark

dbt

CI/CD

Education

Experience-based credentials

Tools

Snowflake

Job description

Berkeley Research Group, LLC seeks leaders to drive data engineering for AI-ready financial services solutions. You will guide teams, design data models, and ensure data quality, provenance, and security across complex pipelines.

You will collaborate with AI specialists, domain experts, and client teams to deliver production-ready data foundations and actionable roadmaps. Travel to client sites may be required.