Data Engineer

Deccan Ai; Hyderabad; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Deccan AI in Hyderabad is seeking a Data Engineer to design and implement scalable data pipelines and architectures that power business intelligence and analytics.

You will collaborate with cross-functional teams, develop large-scale data systems with high performance, security, and reliability, and implement data quality checks while staying current with industry trends and emerging technologies in data engineering.

Qualifications

• Proficiency in data structures and algorithms.
• Experience with big data technologies (Hadoop, Spark, NoSQL).
• Strong programming skills in Python, Java, or C++.
• Ability to analyze complex data and derive insights.
• Excellent communication and teamwork, especially in distributed teams.

Responsibilities

• Design and develop scalable data pipelines and architectures to support BI and analytics.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain large-scale data systems with high performance, security, and reliability.
• Analyze complex data sets to extract insights and inform business decisions.
• Implement data quality checks and validation processes to ensure accuracy and integrity.
• Stay up-to-date with industry trends and emerging technologies in data engineering and analytics.

Skills

Data structures & algorithms

Software design patterns

Collaboration in distributed teams

Problem solving

Tools

Hadoop

Spark

NoSQL

Python

Java

C++

Job description

We are looking for a highly skilled Data Engineer to join our team at Deccan AI, playing a crucial role in driving business growth through data-driven insights. The ideal candidate will have a strong background in data engineering and analytics.

Roles and Responsibility

• Design and develop scalable data pipelines and architectures to support business intelligence and analytics.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain large-scale data systems, ensuring high performance, security, and reliability.
• Analyze complex data sets to extract valuable insights and trends, informing business decisions.
• Implement data quality checks and validation processes to ensure accuracy and integrity.
• Stay up-to-date with industry trends and emerging technologies in data engineering and analytics.

Job Requirements

• Strong understanding of data structures, algorithms, and software design patterns.
• Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Proficiency in programming languages like Python, Java, or C++.
• Excellent problem-solving skills with the ability to analyze complex issues and develop creative solutions.
• Strong communication and collaboration skills, with experience working with distributed teams.
• Ability to work in a fast-paced environment, delivering high-quality results under tight deadlines.