Data Engineer

Thalus Technologies Pvt Ltd; Margao; On-site; Full time

Job description

Job Type: Full-Time
Experience Level: 3+
Industry: Artificial Intelligence / Data Engineering / Technology

Job Summary:

We are seeking a skilled Data Engineer to design, build, and optimize data pipelines and infrastructure for our AI-driven solutions. The ideal candidate will have strong expertise in cloud platforms, big data technologies, and data privacy regulations to ensure secure and scalable data processing. This role requires hands-on experience in data engineering, ETL pipelines, and data governance best practices.

Key Responsibilities:

Design, develop, and maintain scalable ETL pipelines for AI-powered applications.
Implement and optimize data storage solutions using cloud platforms (AWS, GCP, or Azure).
Work closely with data scientists and AI engineers to support model training and deployment.
Ensure data quality, security, and compliance with global regulations (GDPR, CCPA, India, LATAM).
Build and maintain data lakes, warehouses, and real-time streaming systems.
Develop and optimize API integrations for seamless data exchange.
Monitor and improve data processing performance and scalability.
Automate data workflows and processes using CI/CD pipelines.
Collaborate with cross-functional teams to define data governance strategies.
Stay updated on emerging data engineering tools and best practices.

Requirements:

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
[Specify Years] years of experience in data engineering, big data, or cloud computing.
Strong proficiency in Python, SQL, and distributed data processing frameworks (Spark, Kafka, etc.).
Hands-on experience with cloud services (AWS, GCP, Azure) and data storage solutions.
Knowledge of data privacy laws (GDPR, CCPA, India, LATAM) and compliance best practices.
Experience in building scalable data pipelines and real-time data processing solutions.
Familiarity with MLOps, API development, and data security protocols.
Strong problem-solving and analytical skills with an attention to detail.
Excellent communication and collaboration skills.
Experience with version control (Git) and Agile methodologies.