Data Engineer

Thalus Technologies Pvt Ltd; Margao; Sur place; INR 1 200 000 - 2 500 000; Plein temps

Résumé du poste

Thalus Technologies Pvt Ltd in Goa is seeking a data engineer to design, build, and optimize data pipelines and infrastructure for its AI-driven solutions. The role emphasizes hands-on ETL, cloud platforms, and scalable data processing.

You will collaborate with data scientists and engineers to support model training and deployment, ensure data quality, security, and regulatory compliance, and contribute to real-time data systems and secure data sharing.

Qualifications

• Bachelor’s or Master’s degree required in CS or data engineering.
• 3+ years of hands-on data engineering experience.
• Proficiency in Python, SQL, and distributed data processing.
• Experience with cloud platforms (AWS, GCP, Azure) and data storage.
• Knowledge of data privacy laws (GDPR, CCPA, India) and compliance.
• Strong problem-solving and collaboration skills.

Responsabilités

• Design, develop, and maintain scalable ETL pipelines for AI-powered applications.
• Implement and optimize data storage solutions on cloud platforms (AWS/GCP/Azure).
• Collaborate with data scientists and AI engineers for model training and deployment.
• Ensure data quality, security, and regulatory compliance.
• Build and maintain data lakes, warehouses, and real-time streaming systems.
• Develop and optimize API integrations for data exchange.
• Automate data workflows with CI/CD pipelines.
• Participate in data governance initiatives with cross-functional teams.

Connaissances

Python

SQL

Big data frameworks

ETL development

Data governance

Communication

Team collaboration

Formation

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

Outils

AWS

GCP

Azure

Spark

Kafka

Git

CI/CD

APIs

Description du poste

• Job Type: Full-Time
• Experience Level: 3+
• Industry: Artificial Intelligence / Data Engineering / Technology

Job Summary:

We are seeking a skilled Data Engineer to design, build, and optimize data pipelines and infrastructure for our AI-driven solutions. The ideal candidate will have strong expertise in cloud platforms, big data technologies, and data privacy regulations to ensure secure and scalable data processing. This role requires hands‑on experience in data engineering, ETL pipelines, and data governance best practices.

Key Responsibilities:

• Design, develop, and maintain scalable ETL pipelines for AI-powered applications.
• Implement and optimize data storage solutions using cloud platforms (AWS, GCP, or Azure).
• Work closely with data scientists and AI engineers to support model training and deployment.
• Ensure data quality, security, and compliance with global regulations (GDPR, CCPA, India, LATAM).
• Build and maintain data lakes, warehouses, and real‑time streaming systems.
• Develop and optimize API integrations for seamless data exchange.
• Monitor and improve data processing performance and scalability.
• Automate data workflows and processes using CI/CD pipelines.
• Collaborate with cross‑functional teams to define data governance strategies.
• Stay updated on emerging data engineering tools and best practices.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• [Specify Years] years of experience in data engineering, big data, or cloud computing.
• Strong proficiency in Python, SQL, and distributed data processing frameworks (Spark, Kafka, etc.).
• Hands‑on experience with cloud services (AWS, GCP, Azure) and data storage solutions.
• Knowledge of data privacy laws (GDPR, CCPA, India, LATAM) and compliance best practices.
• Experience in building scalable data pipelines and real‑time data processing solutions.
• Familiarity with MLOps, API development, and data security protocols.
• Strong problem‑solving and analytical skills with an attention to detail.
• Excellent communication and collaboration skills.
• Experience with version control (Git) and Agile methodologies.