Senior Data Platform Engineer: Real-Time Pipelines & AI

Trepp; New York (NY); Hybrid; USD 167,000 - 204,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401K with employer match

Life and disability insurance

Flexible PTO

Parental leave

Wellness subsidy

Pet insurance

Laptop + WFH equipment

Career progression

Pre-tax commuter benefit (NYC)

Company events

Job summary

Trepp, an NYC-based fintech data leader, seeks a Data Platform Pipeline Engineer to design and maintain scalable data pipelines powering CRE and banking analytics.

You will collaborate with multiple product and engineering teams to deliver robust pipelines, optimize performance, and embed data quality controls while advancing AI-driven workflows and LLM orchestration within our AWS cloud environment.

Qualifications

• Bachelor’s Degree required.
• 5+ years of application development experience.
• 3+ years in big data technologies.
• Dimensional data modeling and enterprise data warehouses/lakes experience.
• 3+ years of cloud computing (AWS, Azure, Google Cloud).
• Experience with Agile, SDLC, Git workflows, and CI/CD.
• Hands-on data pipelines on AWS core services (S3, EMR, Glue, Lambda, Step Functions).

Responsibilities

• Design, build, and maintain scalable batch and near real-time data pipelines powering Trepp’s data-driven products.
• Lead complex data engineering projects from planning through delivery with stakeholders.
• Translate business requirements into data models, designs, and production-ready implementations.
• Embed data quality, validation, monitoring, and reliability checks into pipelines.
• Develop domain expertise to shape roadmaps and prioritize initiatives.
• Break down ideas into actionable tasks, plans, and milestones.
• Evaluate options, justify tradeoffs, and propose business-impacting solutions.
• Champion best practices for scalability, maintainability, and performance.
• Design and integrate AI-driven workflows including LLM orchestration and vector search pipelines.

Skills

Python

SQL

Scala

Java

AWS

Big data technologies

Distributed data processing

Education

Bachelor's Degree

Tools

MapReduce

Hadoop

Hive

EMR

Kafka

Spark

Terraform

CloudFormation

CDK

S3

Lambda

Job description

Trepp, an NYC-based fintech data leader, seeks a Data Platform Pipeline Engineer to design and maintain scalable data pipelines powering CRE and banking analytics.

You will collaborate with multiple product and engineering teams to deliver robust pipelines, optimize performance, and embed data quality controls while advancing AI-driven workflows and LLM orchestration within our AWS cloud environment.