Junior Data Scientist (Python And Azure Databricks)

TAT IT Technolgies; Doha; On-site; QAR 200,000 - 400,000; Full time

Job summary

A technology company is seeking a Junior Data Scientist skilled in Python and Azure Databricks to develop backend services for data processing in Doha, Qatar. Responsibilities include creating APIs, optimizing data pipelines, and collaborating with teams to ensure reliable data solutions. Ideal candidates will have experience in ETL workflows and familiarity with various databases, including graph and vector databases. This is a fantastic opportunity to grow in a dynamic environment focused on AI-driven solutions.

Qualifications

• Proficiency in Python for scripting and backend development.
• Experience building APIs using FastAPI or Flask.
• Good knowledge of Azure Databricks.

Responsibilities

• Develop Python-based backend services for document processing.
• Design and optimize data pipelines on Azure Databricks.
• Collaborate with teams to deliver scalable data solutions.

Skills

Proficiency in Python

API development

Azure Databricks

Graph Databases

OpenAI APIs

ETL workflows

Version control (Git)

Tools

FastAPI

Flask

Neo4j

Azure SQL Database

Milvus

FAISS

Job description

We have an urgent requirement for a Junior Data Scientist (Python and Azure Databricks) for our client based in Qatar.

Key Responsibilities

• Develop Python-based backend services for document parsing, information extraction, and data enrichment (CVs, JDs, etc.).
• Design and optimize automated data pipelines on Azure Databricks for real-time and batch processing.
• Create and maintain RESTful APIs using FastAPI for internal and external data consumption.
• Implement prompt engineering techniques with OpenAI APIs to extract structured insights from unstructured text.
• Model and query graph data using Neo4j for relationship analysis and graph-based reasoning.
• Design and manage Azure SQL Databases for storing and querying structured datasets.
• Collaborate with cross-functional teams to deliver reliable and scalable data solutions.
• Write clean, testable, and maintainable code with proper documentation.
• Lead the rapid development of Proof-of-Concepts (POCs) to test, validate, and showcase innovative backend and AI-enabled solutions.

Required Skills

• Proficiency in Python for scripting, backend development, and data processing.
• Experience building APIs using FastAPI or Flask.
• Good knowledge of Azure Databricks and Azure SQL database.
• Familiarity with Graph Databases (preferably Neo4j) and Cypher queries.
• Experience with OpenAI APIs / LLM-based applications and prompt engineering.
• Good understanding of ETL workflows, version control (Git), and software development best practices.
• Good understanding of vector databases like Milvus or FAISS.

This job posting appears to be active and not expired.