Data Engineer LLM

CORNERSTONE GLOBAL PARTNERS PTE. LTD.; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

A leading recruitment firm in Singapore is seeking an experienced Data Engineer to develop cloud-based data pipelines and build interactive dashboards for cybersecurity applications. The ideal candidate has 2-3 years of experience with Python, LangChain, and AI-driven solutions. This role offers a chance to work in a dynamic environment focused on advanced security analytics.

Qualifications

• 2–3 years’ hands-on experience in Python, LangChain, NLP, and Computer Vision.
• Building and deploying AI/LLM-powered applications and agentic workflows.
• Experience with CI/CD practices and cloud platforms.

Responsibilities

• Develop and maintain cloud-based data pipelines for cybersecurity applications.
• Build and manage interactive dashboards for monitoring security analytics.
• Integrate LLM APIs to enhance security workflows.

Skills

Python programming

LangChain

Natural Language Processing (NLP)

Computer Vision

Vector databases (Pinecone, PGVector, FAISS)

CI/CD tools (Git)

Cloud platforms (AWS, Azure, GCP)

Containerization (Docker, Kubernetes)

Cloud AI services (AWS SageMaker/Bedrock, Google Vertex AI)

Data warehousing (Amazon Redshift, Google BigQuery)

Data pipeline development

Dashboard development (Tableau or equivalent)

Open-source automation frameworks (Flowise)

Education

Bachelor’s degree or higher in Computer Science, Data Science, Machine Learning, or related field

Job description

Key Responsibilities

• Develop and maintain cloud-based data pipelines to ingest, transform, and integrate data from multiple sources for cybersecurity applications.
• Build and manage interactive dashboards (e.g., Tableau or equivalent) for monitoring and reporting on security analytics.
• Integrate LLM APIs via LangChain and leverage Cloud AI services to enhance AI-driven agent capabilities in security workflows.
• Design, deploy, and manage vector databases (e.g., Pinecone, PGVector, FAISS) to support AI search and retrieval tasks.
• Create agentic workflows using LangChain and open-source tools (e.g., Flowise) to automate complex cyber operations.
• Implement human-in-the-loop approval processes for critical decision validation.
• Orchestrate agent-to-agent workflows to enable autonomous collaboration between AI agents.
• Apply prompt engineering best practices to optimize LLM performance for cybersecurity use cases.
• Implement and maintain CI/CD pipelines using Git for integration, deployment, and testing of AI solutions.
• Deliver end-to-end solutions—from experimentation to production—for SOC automation, detection, and human-in-the-loop processes.
• Collaborate with cross-functional teams to deliver secure, scalable, and impactful AI solutions.

Requirements

• Education: Bachelor’s degree or higher in Computer Science, Data Science, Machine Learning, or related field.
• Experience:
  2–3 years’ hands-on experience in:
  Python, LangChain, NLP, and Computer Vision.
  Building and deploying AI/LLM-powered applications and agentic workflows.
  Vector database technologies (Pinecone, PGVector, FAISS).
  CI/CD practices and tools (Git preferred).
  Cloud platform expertise (AWS, Azure, or GCP) with containerization skills (Docker, Kubernetes).
  Experience with Cloud AI services (AWS SageMaker/Bedrock or Google Vertex AI).
  Advantageous: Familiarity with data warehousing (Amazon Redshift, Google BigQuery) and open-source automation tools (Flowise).
• Other: Proficiency in English.

Technical Skills

• Python programming
• LangChain
• Natural Language Processing (NLP)
• Computer Vision
• Vector databases (Pinecone, PGVector, FAISS)
• CI/CD tools (Git)
• Cloud platforms (AWS, Azure, GCP)
• Containerization (Docker, Kubernetes)
• Cloud AI services (AWS SageMaker/Bedrock, Google Vertex AI)
• Data warehousing (Amazon Redshift, Google BigQuery)
• Data pipeline development
• Dashboard development (Tableau or equivalent)
• Open-source automation frameworks (Flowise)

If you believe you fit the requirements for the role, please submit your application below or drop us an email directly quoting the job title.

Due to an anticipated high volume of applicants, we regret that only shortlisted candidates will be notified. The information provided is for recruitment purposes only.

Know someone who would be a great fit for this role? Refer them to us and get rewarded.

Cornerstone Global Partners (EA License Number: 19C9859) is an affirmative equal-opportunity employer and recruitment firm. We evaluate qualified applicants without regard to race, colour, religion, creed, gender, sexual orientation, gender identity, marital status, national origin, age, veteran status, disability, or any other protected class.

Eugene Then
[e-mail]

EA Registration Number: R22104742.

Cornerstone Global Partners Pte Ltd (EA License: 19C9859)