Big Data Engineer // 6y

Techno-Comp Computer Services Pvt. Ltd.; Hyderabad; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

A technology solutions company is seeking a Mid-Senior Level Data Engineer in Hyderabad. The ideal candidate will have over 6 years of experience with Big Data technologies, AWS services, SQL, and strong analytical skills. Responsibilities include developing applications and validating data outputs. This is a full-time position offering opportunities for professional growth.

Qualifications

• 6+ years experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, etc.
• 6+ years experience with SQL and NoSQL databases.
• Experience with Spark programming paradigms and Java/Scala.
• Familiarity with Python and Unix/Linux shells.
• Strong analytical skills and advanced SQL knowledge.

Responsibilities

• Write SQL queries to validate dashboard output.
• Perform code reviews and pair programming.
• Support and enhance current applications.
• Design, develop, test, and implement applications.

Skills

Big Data technologies

SQL queries

AWS Services

Java

Python

Scala

DevOps

Education

B.Tech / B.E / MCA

Tools

AWS RDS

Apache Spark

Kafka

MySQL

Postgres

Elasticsearch

Bitbucket

Bamboo

Job description

Direct message the job poster from Techno-Comp Computer Services Pvt. Ltd.

Responsibilities

• Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)
• Write SQL queries to validate the dashboard output
• Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.
• Performing code reviews and pair programming
• Supporting and enhancing current applications
• Design, develop, test, and implement the application; investigate and resolve complex issues while supporting existing applications.

Qualifications

B.Tech /B.E /MCA

Experience

• 6+ year’s experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala, Hive and AWS etc.
• 6+ year’s experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch
• 6+ year’s experience with Spark programming paradigms (batch and stream-processing)
• 6+ year’s experience in Java, Scala. Familiarity with a scripting language like Python as well as Unix/Linux shells
• 6+ year’s experience with strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.

Skills and Competencies

• Profound understanding of Big Data core concepts and technologies – Apache Spark, Kafka, Spark streaming, spark, Scala, Hive and AWS etc.
• Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).
• Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.
• Programming experience with Python/Scala, Shell scripting.
• Experience with DevOps and Continuous Integration/Delivery (CI/CD) concepts and tools such as Bitbucket and Bamboo.
• Good understanding of business and operational processes.
• Capable of problem/issue resolution, able to think creatively to solve problems.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Engineering and Information Technology

Get notified about new Big Data Developer jobs in Hyderabad, Telangana, India.

Data engineer (Data brick, Python and Pyspark) - GO/JC/891/2025

Data Engineer I, Business Data Technologies

DATA ENGINEER – AZURE DATA FACTORY (ADF) RESOURCE

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.