GenAI Data Engineer

Tiger Analytics, LLC; Hartford (CT); On-site; USD 80,000 - 120,000; Full time

Job summary

Tiger Analytics, LLC is looking for an experienced Data Engineer to join our data team in Hartford, Connecticut. The role involves designing, building, and maintaining data pipelines and infrastructure, utilizing tools like Snowflake and GCP.

Candidates will collaborate with data scientists and analysts to ensure efficient data flow, and be responsible for integrating AI tools to convert unstructured data into actionable insights. Career development opportunities are significant as the company continues to grow.

Qualifications

• Experience in designing and implementing data pipelines.
• Proficient in integrating AI tools like OCR and NLP.
• Ability to tune SQL for petabyte-scale environments.

Responsibilities

• Design and implement robust data pipelines.
• Leverage Snowflake for unstructured data processing.
• Build and maintain cloud-native ETL processes.
• Integrate AI tools into the engineering flow.

Skills

Dataiku

SQL

Python

ETL/ELT processes

GCP

Snowflake

Tools

BigQuery

Cloud Storage

Dataflow

Job description

We are seeking an experienced Data Engineer with expertise in Dataiku to join our data team. As a Data Engineer, you will be responsible for designing, building, and maintaining data pipelines, data integration processes, and data infrastructure. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure efficient data flow and support data-driven decision making across the organization.

Responsibilities

• Design and implement robust data pipelines that ingest, process, and store unstructured data formats at scale within Snowflake and GCP.
• Leverage Snowflake’s unstructured data capabilities (Directory Tables, Scoped URLs, Snowpark) to make "dark data" queryable and actionable.
• Build and maintain cloud-native ETL/ELT processes using BigQuery, Cloud Storage, and Dataflow, ensuring seamless integration between GCP and Snowflake.
• Instead of just using LLMs, you will integrate AI tools (OCR, NLP entities, Document AI) into the engineering flow to transform unstructured blobs into structured insights.
• Tune complex SQL queries and Python-based processing jobs to handle petabyte-scale environments efficiently.

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.