Data Engineer

ConveGenius; Uttar Pradesh; On-site; INR 900,000 - 2,000,000; Full time

Benefits offered by this job

Job summary

ConveGenius is seeking a skilled Data Engineer to design, build, and maintain core data infrastructure in India. You will enable clean, reliable data for BI and ML initiatives, collaborating with data scientists, analysts, and product teams.

Responsibilities include ETL pipeline development, data warehousing, data quality, and governance to optimize performance and costs while ensuring secure access to enterprise data.

Qualifications

• Bachelor’s or Master’s degree in CS/IT/EC/Data Engineering or related field.
• Strong Python programming and expert SQL skills.
• Experience with PostgreSQL, MySQL, SQL Server, etc.
• AWS knowledge; familiarity with GCP/Azure and Spark.
• Databricks knowledge; familiarity with AWS Glue.
• Experience with orchestration tools like Airflow, Lambda, Step Functions.
• Strong problem-solving and analytical mindset.
• Minimum 5 years of relevant experience.
• Experience on education or eGovernance projects preferred.

Responsibilities

• Build, test, and maintain ETL pipelines from diverse sources to centralized storage.
• Design and optimize data warehouses, data lakes, and databases for performance.
• Implement data quality checks, error handling, and monitoring for data integrity.
• Collaborate with analysts and scientists to deliver clean, analysis-ready datasets.
• Tune big data queries, storage layouts, and processing workflows to reduce latency.
• Enforce security controls and data governance policies to protect enterprise data.

Skills

SQL

MS Excel

Impact & Results

API Testing

BigQuery

Coding

AWS

Ownership

Problem-Solving

Data Visualization

Dashboarding

Education

Bachelor's or Master's in CS/IT/EC/Data Eng

Tools

Databricks

AWS Glue

Airflow

AWS Lambda

Step Functions

Spark

Job description

We are looking for a skilled Data Engineer to design, build, and maintain our core data infrastructure. In this role, you will make data clean, reliable, and accessible. You will work closely with data scientists, analysts, and product teams to power business intelligence and machine learning initiatives.

Key Responsibilities

• Pipeline Development: Build, test, and maintain scalable ETL (Extract, Transform, Load) pipelines to move data from various sources into centralized storage.
• Data Warehousing: Design and optimize data warehouses, data lakes, and database systems for high performance.
• Data Quality: Implement validation checks, error-handling routines, and monitoring tools to ensure high data integrity and reliability.
• Collaboration: Partner with data analysts and data scientists to understand data needs and deliver clean, analysis-ready datasets.
• Optimization: Fine-tune big data queries, storage structures, and processing workflows to reduce latency and infrastructure costs.
• Security & Governance: Apply security protocols, access controls, and data privacy policies to keep enterprise data safe.

Required Skills & QualificationsEducation:

• Bachelor’s degree or Master's degree in CS, IT, EC, Data Engineering, or a related technical field (or equivalent work experience).
• Programming: Strong proficiency in Python, plus expert-level SQL skills.
• Database Knowledge: Experience with relational databases (PostgreSQL, MySQL, SQL Server, etc)
• Big Data & Cloud Tools: Must have AWS knowledge. Familiarity with other cloud platforms (GCP, & Azure) and big data frameworks (Apache Spark).
• ETL: Must have Databricks knowledge. Familiarity with AWS Glue.
• Workflow Automation: Experience with orchestration tools like AWS Lambda, Step Function, Airflow, etc.
• Problem-Solving: Strong analytical mindset with an ability to troubleshoot complex data bottlenecks.
• Minimum 5 years of Relevent Experience.
• Experience of having worked on education project(s) or eGovernance projects at State / Central govt. programs, preferred

Required Skills

SQL Advanced MS Excel Impact & Results Orientation API Testing BigQuery Coding AWS Ownership & Accountability Problem-Solving & Decision Making Data Visualization / Dashboarding