Data Engineer

Comviva

Gurugram District

On-site

INR 1,200,000 - 2,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Comviva is seeking a data engineer to analyze and organize raw data from multiple sources, and to design data systems and pipelines using tools like Apache NiFi. You will translate business needs into technical requirements and interpret trends for advanced analytics and modeling.

The role emphasizes data quality using Spark, PySpark scheduling with Airflow, and collaboration with data scientists on diverse projects. A strong background in data modeling and SQL is required.

Qualifications

  • 4–6 years of experience as a Data Engineer.
  • Strong technical expertise in data models, data mining, and segmentation techniques.
  • Proficiency in Java, Python and Spark.
  • Hands-on experience with SQL database design and optimization.
  • Solid numerical and analytical skills.
  • Apache Kafka & Spark Streaming is a plus.
  • Bachelor’s degree in CS/IT or related field; Master’s preferred.
  • Data engineering certification (e.g., IBM Certified Data Engineer) is a plus.
  • Preferred tools: NiFi, Spark, Airflow, SQL, MySQL, Java, Python; Cloud platforms AWS/GCP/Azure.

Responsibilities

  • Analyze and organize raw data from multiple sources.
  • Design and build data systems and pipelines using tools like Apache NiFi.
  • Evaluate business needs and translate them into technical requirements.
  • Interpret trends and patterns through complex data analysis and reporting.
  • Prepare data for prescriptive and predictive modeling. Develop algorithms and prototypes for data-driven solutions.
  • Enhance data quality and reliability using Spark and schedule PySpark jobs with Airflow.
  • Identify opportunities for data acquisition and integration. Build analytical tools and programs to support business objectives.
  • Collaborate with data scientists and architects on various projects.

Skills

Data modeling
Data mining
Segmentation techniques
Java
Python
Spark
SQL
Numerical analysis

Education

Bachelor’s degree in Computer Science, IT, or related field

Tools

Apache NiFi
Apache Spark
Airflow
SQL / MySQL
Java
Python
Cloud platforms (AWS, GCP, Azure)

Job description

  • Analyze and organize raw data from multiple sources.
  • Design and build data systems and pipelines using tools like Apache NiFi.
  • Evaluate business needs and translate them into technical requirements.
  • Interpret trends and patterns through complex data analysis and reporting.
  • Prepare data for prescriptive and predictive modeling. Develop algorithms and prototypes for data-driven solutions.
  • Enhance data quality and reliability using Spark and schedule PySpark jobs with Airflow.
  • Identify opportunities for data acquisition and integration. Build analytical tools and programs to support business objectives.
  • Collaborate with data scientists and architects on various projects.
Key Responsibilities
  • Analyze and organize raw data from multiple sources.
  • Design and build data systems and pipelines using tools like Apache NiFi.
  • Evaluate business needs and translate them into technical requirements.
  • Interpret trends and patterns through complex data analysis and reporting.
  • Prepare data for prescriptive and predictive modeling. Develop algorithms and prototypes for data-driven solutions.
  • Enhance data quality and reliability using Spark and schedule PySpark jobs with Airflow.
  • Identify opportunities for data acquisition and integration. Build analytical tools and programs to support business objectives.
  • Collaborate with data scientists and architects on various projects.
Must-Have Skills
  • Experience: 4-6 years as a Data Engineer.
  • Strong technical expertise in data models, data mining, and segmentation techniques.
  • Proficiency in programming languages such as Java,Python and Spark
  • Hands-on experience with SQL database design and optimization.
  • Solid numerical and analytical skills.
  • apache kafka & apache spark streaming is a plus.
  • Educational Qualification: Bachelor’s degree in Computer Science, IT, or related field (Master’s preferred).
  • Data engineering certification (e.g., IBM Certified Data Engineer) is a plus.
  • Preferred Tools & Technologies: Apache NiFi, Spark, Airflow SQL, MySQL Java, Python Cloud platforms (AWS, GCP, or Azure)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Meril • Vapi

On-site
INR 800,000 - 1,200,000
Data Engineer - SQL/PySpark
Data Engineer - SQL/PySpark

Forward Eye Technologies • Dadri

On-site
INR 1,200,000 - 1,800,000
Data Engineer - SQL/PySpark
Data Engineer - SQL/PySpark

Forward Eye Technologies • Pune District

On-site
INR 1,200,000 - 1,800,000
Data Engineer (Platform Focus)
Data Engineer (Platform Focus)

Comviva • Gurugram District

On-site
INR 900,000 - 1,500,000
Data Engineer
Data Engineer

AppSierra • Mumbai

On-site
INR 900,000 - 1,300,000
Data Engineer
Data Engineer

Amplicomm • Bengaluru

On-site
INR 1,500,000 - 2,800,000
Data Engineer
Data Engineer

The Walt Disney Company • Bengaluru

On-site
INR 1,800,000 - 2,800,000
Data Engineer
Data Engineer

Mahindra and Mahindra Limited [Automotive and Farm Equipment Business] • Chengalpattu

On-site
INR 2,500,000 - 4,000,000
Data Engineer
Data Engineer

Bacancy Technology Inc • Ahmedabad District

On-site
INR 1,500,000 - 3,000,000
Data Engineer
Data Engineer

Imagevision • Hyderabad

On-site
INR 1,200,000 - 1,800,000