Technical Architect - GenAI & Data Pipelines

Dataquad Inc.; Rockville (MD); Hybrid; USD 120,000 - 170,000; Full time

Job summary

Dataquad Inc. is seeking a Data Engineer to build large-scale data pipelines and contribute to the development of agentic AI systems, including LLM-powered data assistants and MCP servers. The role emphasizes secure data handling, FINRA-aligned practices, and cross-team collaboration.

You will work on Spark-based ETL pipelines, Big Data platforms, and AI tooling within a hybrid environment, collaborating with multiple teams to deliver reliable data products.

Qualifications

• Experience building data pipelines with Spark (PySpark) and SQL.
• Experience with Hive/Trino/Presto and cloud data platforms (S3, EMR).
• Familiarity with big data platforms (SageMaker, Domino, Dataiku).
• Strong debugging, performance tuning, and data quality skills.

Responsibilities

• Build/maintain ETL/ELT pipelines using Spark, Hive, and Trino across S3 data lakes.
• Develop and optimize SQL for large surveillance datasets with complex queries.
• Design and engineer big data systems on EMR-on-EC2/EKS; integrate with analytical platforms (SageMaker).
• Contribute to CI/CD and IaC on AWS; ensure secure handling of sensitive data.

Skills

Spark

SQL

Python

ETL pipelines

AWS

Education

Bachelor's degree in CS/related

Tools

Hive

Trino/Presto

EMR on EC2

EMR on EKS

SageMaker

Dataiku

Job description

Dataquad Inc. is seeking a Data Engineer to build large-scale data pipelines and contribute to the development of agentic AI systems, including LLM-powered data assistants and MCP servers. The role emphasizes secure data handling, FINRA-aligned practices, and cross-team collaboration.

You will work on Spark-based ETL pipelines, Big Data platforms, and AI tooling within a hybrid environment, collaborating with multiple teams to deliver reliable data products.