Data Engineer

FastSwitch - Great Lakes Pvt Ltd.; Chennai; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

FastSwitch - Great Lakes Pvt Ltd. in Chennai seeks an experienced Data Engineer to design and deploy cloud-based data platforms on GCP. You will work with SQL, Java, Python, and modern data pipelines to enable scalable analytics.

Candidates should have 5-7 years in data or software engineering, hands-on GCP experience, and an understanding of SOA and microservices. The role emphasizes cost optimization, data governance, and AI-ready data products.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Information Systems, Data Analytics, or a related field (or equivalent combination of education and experience).
• 5-7 years of experience in Data Engineering or Software Engineering, with at least 2 years of hands-on experience building and deploying cloud-based data platforms (GCP preferred).
• Strong proficiency in SQL, Java, and Python, with practical experience in designing and deploying cloud-based data pipelines using GCP services like BigQuery, DataForm, Dataflow, and DataProc.
• Solid understanding of SOA and microservices, and their application within a cloud dataplatform.
• Experience with relational databases (e.g., PostgreSQL, MySQL), NoSQL databases, and columnar databases (e.g., BigQuery).
• Knowledge of data governance frameworks, data encryption, and data masking
• Experience with unstructured data manipulation and extraction
• Experience building AI-ready data products
• Familiarity with CI/CD pipelines, Infrastructure as Code (IaC) tools like Terraform and Tekton, and other automation frameworks.
• Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data platform and microservices issues.
• Experience in monitoring and optimizing cost and compute resources for processes in GCP technologies (e.g., BigQuery, Dataflow, Cloud Run, DataProc).
• A passion for data, innovation, and continuous learning.

Skills

SQL

Java

Python

GCP BigQuery

GCP Dataflow

GCP DataProc

SOA & microservices

Relational databases

NoSQL databases

Terraform

Tekton

CI/CD

Automation frameworks

Cost optimization

Unstructured data

AI-ready data products

Education

Bachelor's degree in Computer Science / Information Technology / Information Systems / Data Analytics or related field

Tools

BigQuery

Dataflow

DataProc

Terraform

Tekton

Job description

Bachelor's degree in Computer Science, Information Technology, Information Systems, Data Analytics, or a related field (or equivalent combination of education and experience)

• 5-7 years of experience in Data Engineering or Software Engineering, with at least 2 years of hands-on experience building and deploying cloud- based data platforms (GCP preferred).
• Strong proficiency in SQL, Java, and Python, with practical experience in designing and deploying cloud-based data pipelines using GCP services like BigQuery, DataForm, Dataflow, and DataProc.
• Solid understanding of Service-Oriented Architecture (SOA) and microservices, and their application within a cloud dataplatform.
• Experience with relational databases (e.g., PostgreSQL, MySQL), NoSQL databases, and columnar databases (e.g., BigQuery).
• Knowledge of data governance frameworks, data encryption, and data masking
• Experience with unstructured data manipulation and extraction
• Experience building AI-ready data products
• Familiarity with CI/CD pipelines, Infrastructure as Code (IaC) tools like Terraform and Tekton, and other automation frameworks.
• Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data platform and microservices issues.
• Experience in monitoring and optimizing cost and compute resources for processes in GCP technologies (e.g., BigQuery, Dataflow, Cloud Run, DataProc).
• A passion for data, innovation, and continuous learning.