Data Engineer

Saturam; Bengaluru; On-site; INR 800,000 - 1,500,000; Full time

Job summary

Saturam in Bengaluru, India is looking for a Data Engineer to design and manage data flows within a cloud environment. The ideal candidate will have strong programming skills in Python and SQL, along with experience in leveraging big data technologies.

Candidates should possess at least 4 years of relevant experience, proficiency in ETL frameworks, and a solid understanding of AWS services. A Bachelor's or Master's degree in Computer Science or related fields is required.

Qualifications

• 4+ years of experience in data flow and management on a big data tech stack.
• Strong programming skills in Python and SQL.
• Experience with ETL pipelines and frameworks.
• Familiarity with AWS cloud services.

Responsibilities

• Design and architect data flows in a cloud environment.
• Develop scalable data management solutions.
• Collaborate with cross-functional teams on projects.
• Implement best practices for version control and documentation.

Skills

Python

SQL

Spark

Kafka

GIT

ETL frameworks

AWS (Glue, Athena)

Agile methodologies

Education

Bachelor's or Master's degree in Computer Science/Information Systems

Tools

Airflow

Jenkins

Job description

Responsibilities

• Design and architect data flows and data management in a cloud environment that are scalable, repeatable, and eliminate time-consuming steps.
• Strong programming skills in Python and SQL; experience with data processing leveraging Python, SQL, Spark.
• In-depth understanding of the Kafka platform for (real-time) data ingestion and processing of high-volume data.
• Clear skills in using version control systems like GIT and developing (technical) documentation (e.g., in WIKI).
• Experiences with infrastructure components as code for robust deployment, replication, and uniform management.
• Effective collaboration and communication skills to engage with cross-functional teams.
• A proactive mindset with the ability to drive tasks to completion.
• Proficiency in Agile/Scrum/Kanban methodologies for efficient product delivery and management.
• Familiarity with AWS cloud services like Glue, Athena, etc.
• Open to learning and implementing new technologies.
• Ability to think and perform data engineering workstreams with a product mindset.

Qualifications

• Bachelor's or Master's degree in Computer Science/Information Systems.
• At least 4+ years of experience in building data flow and data management on a modern big data tech stack.
• Strong experience in using ETL frameworks (e.g., Airflow, Jenkins) to build and deploy production-quality ETL pipelines.
• Knowledge of data structures.
• Fluency in English.