Data Engineer

Doyensystems; Chennai; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Doyensystems is seeking an experienced Data Engineer to support data pipelines, ETL/ELT development, and Snowflake-based workloads. You will handle Matillion orchestration, SFTP integrations, and API/JSON interfaces in a scalable offshore support model.

The role requires strong SQL, data validation, and troubleshooting skills, with exposure to Kafka and messaging systems. L2/L3 candidates receive senior guidance and mentorship.

Qualifications

• 38 years of experience in Data Engineering, ETL, Data Integration, or Production Support.
• Strong hands-on experience with Snowflake.
• Experience in ETL/ELT development and support.
• Matillion experience is mandatory for candidates at L2/L3 level; basic Matillion exposure is preferred for L1.
• Strong SQL skills for data validation and troubleshooting.
• Experience with production support, incident management, and troubleshooting.
• Good understanding of SFTP and file-based integrations.
• Exposure to API/JSON integrations.
• Exposure to Kafka or other messaging/integration platforms.
• Strong written and verbal communication skills.
• Ability to work in an offshore support model aligned with customer shifts.

Responsibilities

• Monitor scheduled jobs, Matillion workflows, SFTP transfers, and data pipeline executions.
• Investigate and resolve ETL failures, data quality issues, load errors, and transformation problems.
• Write SQL queries for data validation, reconciliation, troubleshooting, and root-cause analysis.
• Develop and troubleshoot Matillion jobs and orchestration workflows.
• Work with SFTP/file-based integrations, including file transfers, formats, and processing dependencies.
• Support and troubleshoot API integrations, JSON payloads, authentication, and error handling.
• Troubleshoot Kafka or integration pipeline issues and message processing failures.
• Perform incident triage, log analysis, root-cause analysis, and resolution of production issues.
• Participate in deployments, testing, change management, and production handover activities.
• Maintain technical documentation, runbooks, knowledge articles, and incident records.
• Collaborate with L1/L2/L3 teams and other technical stakeholders for issue resolution.
• For senior-level candidates, provide technical guidance, review ETL implementations, optimize Snowflake workloads, and mentor junior team members.
• Participate in customer discussions and support high-priority production incidents when required.

Skills

SQL

Data validation

Troubleshooting

Communication

Tools

Snowflake

Matillion

Kafka

Job description

Role & responsibilities

• Monitor scheduled jobs, Matillion workflows, SFTP transfers, and data pipeline executions.


• Investigate and resolve ETL failures, data quality issues, load errors, and transformation problems.


• Write SQL queries for data validation, reconciliation, troubleshooting, and root-cause analysis.


• Develop and troubleshoot Matillion jobs and orchestration workflows.


• Work with SFTP/file-based integrations, including file transfers, formats, and processing dependencies.


• Support and troubleshoot API integrations, JSON payloads, authentication, and error handling.


• Troubleshoot Kafka/integration pipeline issues and message processing failures.


• Perform incident triage, log analysis, root-cause analysis, and resolution of production issues.


• Participate in deployments, testing, change management, and production handover activities.


• Maintain technical documentation, runbooks, knowledge articles, and incident records.


• Collaborate with L1/L2/L3 teams and other technical stakeholders for issue resolution.


• For senior-level candidates, provide technical guidance, review ETL implementations, optimize Snowflake workloads, and mentor junior team members.


• Participate in customer discussions and support high-priority production incidents when required.

Preferred candidate profile

• 38 years of experience in Data Engineering, ETL, Data Integration, or Production Support.


• Strong hands-on experience with Snowflake.


• Experience in ETL/ELT development and support.


• Matillion experience is mandatory for candidates at L2/L3 level; basic Matillion exposure is preferred for L1.


• Strong SQL skills for data validation and troubleshooting.


• Experience with production support, incident management, and troubleshooting.


• Good understanding of SFTP and file-based integrations.


• Exposure to API/JSON integrations.


• Exposure to Kafka or other messaging/integration platforms.


• Strong written and verbal communication skills.


• Ability to work in an offshore support model aligned with customer shifts.