Data Analyst / Data Engineer (LLM/AI, Data)

Top Selection; United States; Remote; USD 110,000 - 160,000; Full time

Job summary

Top Selection is seeking a Senior Data Analyst/Data Engineer to develop ETL pipelines and analyze data for the CodeGen platform. You will work with Python and SQL to process data from internal services and AI tools.

You will design databases and analytical dashboards to measure usage metrics, and prepare data (structured and unstructured) for AI-driven indexing in vector databases, enhancing the data infrastructure.

Qualifications

• Proficient in Python and SQL.
• Experience building ETL/ELT pipelines.
• Experience analyzing data from diverse sources.
• Familiar with AI tools and related workflows.

Responsibilities

• Design databases and dashboards to evaluate CodeGen platform usage metrics.
• Develop ETL/ELT pipelines and integrate data from internal services and AI tools.

Skills

Python

SQL

ETL/ELT

Data analysis

AI tools

Tools

PostgreSQL

Greenplum

Job description

Top Selection seeks a Senior Data Analyst/Data Engineer to develop ETL pipelines and analyze data for their CodeGen platform. Ideal candidates are proficient in Python and SQL with experience in AI tools.

In this role, you will engage in data collection and analysis from various internal services and AI tools. Key responsibilities include designing databases and analytical dashboards to evaluate usage metrics of the CodeGen platform, as well as processing both structured and unstructured data.

You will develop ETL/ELT pipelines and work with technologies like PostgreSQL and Greenplum. Additionally, you will contribute to RAG solutions by preparing data for indexing in vector databases, enhancing the overall data infrastructure for AI agents.