Data Engineer

ConveGenius; Dadri; On-site; INR 1,300,000 - 2,000,000; Full time

Job summary

ConveGenius is seeking a skilled Data Engineer to design, build, and maintain core data infrastructure powering BI and ML initiatives. You will work with data scientists and product teams to ensure data is clean, reliable, and accessible for analysis.

The role emphasizes ETL development, data warehousing, and governance, with collaboration across analytics and engineering teams. Opportunity to impact education-focused platforms.

Qualifications

• Bachelor’s degree or Master’s in CS/IT/EC/Data Engineering or related field.
• Programming: Python proficiency and expert SQL skills.
• Relational databases experience (PostgreSQL, MySQL, SQL Server, etc).
• AWS knowledge and familiarity with GCP/Azure and Spark-based big data tools.
• Databricks knowledge; familiarity with AWS Glue.
• Orchestration tools: AWS Lambda, Step Functions, Airflow, etc.
• Strong problem-solving and analytical mindset; able to troubleshoot data bottlenecks.
• Min 5 years of relevant experience; govt/education projects preferred.

Responsibilities

• Design, build, and maintain scalable ETL pipelines.
• Develop and optimize data warehouses and data lakes.
• Ensure data quality with validation checks and monitoring.
• Collaborate with analysts and data scientists for clean datasets.
• Tune queries and data storage to reduce latency and costs.
• Apply security controls and governance for enterprise data.

Skills

Python

SQL

MS Excel

Big Data

AWS

Databricks

Airflow

API Testing

Data Visualization

BigQuery

Education

Bachelor's or Master's in CS/IT/Data Engineering

Tools

Databricks

AWS Glue

PostgreSQL

MySQL

SQL Server

Job description

We are looking for a skilled Data Engineer to design, build, and maintain our core data infrastructure. In this role, you will make data clean, reliable, and accessible. You will work closely with data scientists, analysts, and product teams to power business intelligence and machine learning initiatives.

Key Responsibilities

• Pipeline Development: Build, test, and maintain scalable ETL (Extract, Transform, Load) pipelines to move data from various sources into centralized storage.
• Data Warehousing: Design and optimize data warehouses, data lakes, and database systems for high performance.
• Data Quality: Implement validation checks, error-handling routines, and monitoring tools to ensure high data integrity and reliability.
• Collaboration: Partner with data analysts and data scientists to understand data needs and deliver clean, analysis-ready datasets.
• Optimization: Fine-tune big data queries, storage structures, and processing workflows to reduce latency and infrastructure costs.
• Security & Governance: Apply security protocols, access controls, and data privacy policies to keep enterprise data safe.

Required Skills & QualificationsEducation:

• Bachelor’s degree or Master's degree in CS, IT, EC, Data Engineering, or a related technical field (or equivalent work experience).
• Programming: Strong proficiency in Python, plus expert-level SQL skills.
• Database Knowledge: Experience with relational databases (PostgreSQL, MySQL, SQL Server, etc)
• Big Data & Cloud Tools: Must have AWS knowledge. Familiarity with other cloud platforms (GCP, & Azure) and big data frameworks (Apache Spark).
• ETL: Must have Databricks knowledge. Familiarity with AWS Glue.
• Workflow Automation: Experience with orchestration tools like AWS Lambda, Step Function, Airflow, etc.
• Problem-Solving: Strong analytical mindset with an ability to troubleshoot complex data bottlenecks.
• Minimum 5 years of Relevent Experience.
• Experience of having worked on education project(s) or eGovernance projects at State / Central govt. programs, preferred

Required Skills

SQL Advanced MS Excel Impact & Results Orientation API Testing BigQuery Coding AWS Ownership & Accountability Problem-Solving & Decision Making Data Visualization / Dashboarding