Data Quality & ML Pipelines Engineer - Onsite NYC

Selby Jennings; New York (NY); On-site; USD 150,000 - 180,000; Full time

Job summary

Selby Jennings is seeking an onsite Data Analyst in New York to develop and maintain batch and real-time data pipelines using Python and SQL. You will ingest, cleanse, validate, and normalize diverse datasets while building data quality controls and anomaly detection.

You will work with large financial datasets, onboard new data providers, and collaborate with engineering and business teams to improve data accessibility. Experience with ML/NLP and LLM-driven workflows is a plus.

Qualifications

• Bachelor's, Master's, or PhD in Computer Science, Engineering, Mathematics, Statistics, Economics, or a related quantitative discipline.
• Strong development skills in Python and SQL.
• Experience with data engineering, analytics, quantitative research, financial data, or large-scale datasets.
• Knowledge of ETL development, data modeling, and data pipeline design.
• Exposure to workflow orchestration tools such as Airflow or Dagster.
• Experience with AWS or GCP.
• Familiarity with modern data warehouses including Snowflake, BigQuery, or Databricks.
• Hands-on experience with machine learning, NLP, or LLM-based solutions.
• Strong understanding of data quality, validation, reconciliation, and monitoring practices.
• Experience working with messy, incomplete, or high-volume datasets.
• Familiarity with Git, Linux, testing, and software engineering best practices.
• Excellent communication skills to explain technical concepts to technical and non-technical audiences.
• Strong analytical thinking, attention to detail, and problem-solving ability.

Responsibilities

• Develop and maintain batch and real-time data pipelines using Python and SQL.
• Ingest, cleanse, validate, and normalize structured and unstructured datasets from multiple sources.
• Build and improve data quality controls, validation frameworks, reconciliation processes, and anomaly detection.
• Work with large financial and alternative datasets to maintain accuracy, consistency, and reliability.
• Support new data provider onboarding by reviewing specs, mapping fields, and integrating APIs.
• Partner with engineering and business teams to define data requirements and improve accessibility.
• Apply machine learning and AI to automate data processing, classification, extraction, and enrichment.
• Evaluate and help implement LLM-based solutions for data mapping, documentation, and QA.
• Monitor production workflows and investigate data issues, outliers, and operational anomalies.
• Create documentation and data dictionaries to support scalability and process improvements.
• Collaborate on cloud-based data platform initiatives and modern data architecture projects.
• Own datasets and processes, identifying opportunities for efficiency and automation.

Skills

Python

SQL

Data pipelines

Data quality

Machine learning

NLP

Data analysis

Education

Bachelor's/Master's/PhD in CS/Engineering/Math/Stats/Economics

Tools

Airflow

Dagster

AWS

GCP

Snowflake

BigQuery

Databricks

Git

Linux

Job description

Selby Jennings is seeking an onsite Data Analyst in New York to develop and maintain batch and real-time data pipelines using Python and SQL. You will ingest, cleanse, validate, and normalize diverse datasets while building data quality controls and anomaly detection.

You will work with large financial datasets, onboard new data providers, and collaborate with engineering and business teams to improve data accessibility. Experience with ML/NLP and LLM-driven workflows is a plus.