Data Engineering Team Lead - Grata

Datasite; New York (NY); On-site; USD 141,000 - 248,000; Full time

Benefits offered by this job

Health insurance

Retirement plan

Paid time off

Job summary

Grata is seeking a Data Engineering Team Lead to own the technical direction and delivery of a team building data platforms powering Grata’s products and analytics.

You’ll combine hands-on leadership with people management, shaping architecture, design reviews, and helping engineers grow while delivering high-leverage data solutions.

Qualifications

• 6+ years building and operating production data systems at scale.
• Experience leading a team or mentoring senior engineers.
• Fluency with Python and SQL; expert in Spark/Databricks and lakehouse patterns.
• Strong data modeling skills with governance and standards.
• Experience running workloads in AWS (storage, compute, networking, cost controls).
• Hands-on with orchestration (Airflow/Databricks Workflows), CI/CD for data, and IaC.
• Comfort leading as both IC and people manager.
• Experience shaping product-facing datasets and semantic layers.

Responsibilities

• Lead and grow a Data Engineers team, setting goals and performance.
• Define architecture and standards for ELT/ETL pipelines on Databricks/Spark.
• Evolve lakehouse and warehouse designs, optimize performance and cost.
• Shape real-time/near-real-time data processing and idempotent workflows.
• Ensure automated testing, lineage, metadata, and data governance.
• Own SLOs and on-call rotations for data platforms and scaling.
• Coordinate with Product, DS, and App Eng on APIs and semantic layers.
• Mentor engineers and drive technical ownership across the team.

Skills

Python

SQL

Spark/Databricks

Lakehouse patterns

Data modeling

CI/CD for data

IaC

Airflow

dbt

AWS

Tools

Databricks

Airflow

dbt

Kafka

Kinesis

Spark

Job description

Grata is the leading private-market deal‑making platform—bringing the most comprehensive, accurate, and searchable proprietary data on private companies, financials, and owners to investors, advisers, and corporate deal teams. With 700+ customers and recognition from G2 and PE Wire, we're growing fast and shaping the future of data-driven dealmaking.

Role overview: We’re looking for a Data Engineering Team Lead to own the technical direction and delivery of the team that builds and operates the data platforms powering Grata’s products and analytics. You'll split your time between hands‑on technical leadership — architecture, design review, and unblocking hard problems — and people leadership: growing engineers, setting priorities, and making sure the team ships reliable, high‑leverage work. You'll partner closely with Product, Data Science, and Application Engineering, and represent the data platform in cross‑functional planning.

What you’ll do

• Lead the team: Manage and grow a team of Data Engineers — set goals, run 1:1s, give feedback, and own hiring and performance for the team.
• Own technical direction: Set architecture and design standards for ELT/ETL pipelines in Python/SQL/Spark on Databricks, and make the build-vs-buy and platform trade‑off calls for the team.
• Evolve the lakehouse & warehouse: Drive dimensional modeling/star schemas and incremental patterns (e.g., Delta Lake/CDC), balancing cost, performance, and usability across the team's roadmap.
• Streaming & event data: Set the technical bar for real‑time/near-real‑time jobs, idempotency, and exactly‑once semantics; review designs before they ship.
• Quality, lineage, and governance: Ensure the team implements automated testing, anomaly detection, validation, lineage/metadata, and documentation as a standard part of delivery.
• Scale & reliability: Own SLOs and on‑call rotations for data platforms; make sure monitoring, alerting, and capacity/cost management scale with the business.
• Prioritize & sequence delivery: Break down ambiguous initiatives into a roadmap, sequence the team's work, and hold the team accountable to measurable improvements in freshness, completeness, and query performance.
• Partner across functions: Represent the data platform with Product and DS on source selection, feature readiness, and experiment design; with App Eng on stable APIs and semantic layers.
• Raise the bar: Lead design and code review, run brown‑bag sessions, and coach engineers toward greater technical ownership and independence.

What you’ll bring

• 6+ years building and operating production data systems at scale, including prior experience leading a team or mentoring senior engineers.
• A track record of managing people or leading a team through ambiguous, high‑stakes initiatives to clear results — including hiring, performance management, and career development.
• Deep fluency with Python and SQL; expert in Spark/Databricks and lakehouse patterns.
• Strong data modeling skills, and the judgment to set standards other engineers will follow.
• Experience running workloads in AWS (or similar cloud): storage, compute, networking basics, cost controls.
• Hands‑on with orchestration (Airflow/Databricks Workflows/dbt), CI/CD for data, and IaC.
• Comfort operating as both an individual technical contributor and a people manager — able to context‑switch between deep technical work and team leadership day to day.
• Nice‑to‑haves Event platforms (Kafka/Kinesis), vector/feature stores, ML feature engineering with DS partners. Data observability platforms; data catalog/lineage tooling; data access governance.
• Experience shaping product‑facing datasets and semantic layers (e.g., for BI and APIs).
• Prior experience as an EM or tech lead managing a team of 3+ data or software engineers.

The base salary range represents the estimated low and high end for this position based on a good faith assessment of the role and market data at the time of posting. Consistent with applicable law, each candidate’s compensation offer may vary and will be determined based on but not limited to, your geographic region, skills, qualifications, and experience along with the requirements of the position. This position may be eligible for bonuses, commissions, or overtime if applicable. Benefits include health insurance (medical, dental, vision), a retirement savings plan, paid time off, and other employee benefits. Specific details will be provided during the interview process. Datasite reserves the right to modify this pay range at any time. $141,000.00 - $248,000.00

Our company is committed to fostering a diverse and inclusive workforce where all individuals are respected and valued. We are an equal opportunity employer and make all employment decisions without regard to race, color, religion, sex, gender identity, sexual orientation, age, national origin, disability, protected veteran status, or any other protected characteristic. We encourage applications from candidates of all backgrounds and are dedicated to building teams that reflect the diversity of our communities.