Senior Data Engineer & AI Solutions Lead (NYC, Onsite)

Berkeley Research Group, LLC; New York (NY); On-site; USD 158,000 - 210,000; Full time

Job summary

Berkeley Research Group, LLC in New York, NY is seeking a Senior Managing Consultant Data Engineer to lead hands-on data engineering workstreams supporting AI-enabled financial services solutions. The role focuses on building reliable data products and scalable pipelines for ingestion, transformation, and retrieval.

You will design warehouse and lakehouse models, implement data quality controls, and collaborate with AI engineers and client teams to deliver trusted data assets and actionable

Qualifications

• Minimum 5 years for Managing Consultant; 7 years for Sr. Managing Consultant.
• Hands-on delivery of production data pipelines and data products.
• Strong Python and SQL skills across ingestion and transformation.
• Experience with warehouse or lakehouse models and schema design.
• Experience with data quality, lineage, access controls, and PII handling.

Responsibilities

• Lead data engineering workstreams from discovery through production handover.
• Design and build batch and streaming pipelines in Python and SQL.
• Develop ingestion for structured and unstructured data, including metadata capture and indexing.
• Design warehouse and lakehouse models for reporting, analytics, and AI use cases.
• Implement data quality checks, lineage, access controls, and PII handling.
• Prepare retrieval-ready data with embedding pipelines and metadata enrichment.
• Collaborate with AI engineers and client teams to validate approaches.
• Build automated tests, deployment pipelines, monitoring, and recovery procedures.
• Mentor engineers and review code and designs; coordinate with stakeholders.
• Contribute technical estimates, assumptions, and data dependencies to proposals.

Skills

Python

SQL

Data pipelines

Mentoring

Leadership

Tools

Spark

dbt

CI/CD

Snowflake

Job description

Berkeley Research Group, LLC in New York, NY is seeking a Senior Managing Consultant Data Engineer to lead hands-on data engineering workstreams supporting AI-enabled financial services solutions. The role focuses on building reliable data products and scalable pipelines for ingestion, transformation, and retrieval.

You will design warehouse and lakehouse models, implement data quality controls, and collaborate with AI engineers and client teams to deliver trusted data assets and actionable