Sr Data Engineer

ServCrust Private Limited; Hyderabad; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

ServCrust Private Limited in Hyderabad is looking for a Sr Data Engineer with over 6 years of experience. The role involves leading the design of scalable data solutions, optimizing ETL processes, and collaborating with data scientists. Candidates should have a Bachelor's in Computer Science and expertise in Python, SQL, and big data technologies like Hadoop and Spark. This position emphasizes data quality and reliability while contributing to the strategic planning of data infrastructure.

Qualifications

• 6+ years of experience in data engineering or a related role.
• Expertise in programming languages such as Python, Java, or Scala.
• Advanced experience with SQL and database technologies.
• Proven expertise in designing and optimizing ETL processes.
• Deep understanding of data modeling, database design principles, and data architecture.
• Extensive hands-on experience with big data technologies.

Responsibilities

• Lead the design and development of scalable and robust data solutions.
• Architect, develop, and optimize ETL processes.
• Implement advanced data modeling techniques and design efficient databases.
• Ensure data quality and integrity through rigorous validation.
• Collaborate with data scientists and analysts for data integration.
• Manage big data technologies for large-scale data processing.
• Optimize and enhance data processing pipelines' performance.
• Mentor junior engineers and lead best practice initiatives.

Skills

Python

SQL

Java

Scala

Hadoop

Spark

Apache Airflow

Data Modeling

ETL processes

Problem-solving

Education

Bachelor's degree in Computer Science or related field

Tools

PostgreSQL

MySQL

Job description

Sr Data Engineer

Experience Level: 6+ years

Responsibilities

• Lead the design and development of scalable, robust data solutions that meet cross-functional teams' data requirements.
• Architect, develop, and optimize ETL (Extract, Transform, Load) processes to seamlessly integrate data from multiple sources into our data warehouse.
• Implement advanced data modeling techniques and design efficient, optimized databases to support complex business needs.
• Ensure the highest levels of data quality and integrity through rigorous data validation and cleansing processes.
• Collaborate closely with data scientists and analysts to provide clean, structured data for advanced analytics and machine learning models.
• Oversee and manage big data technologies and frameworks, including Hadoop, Spark, and Apache Airflow, to handle large-scale data processing tasks.
• Optimize, troubleshoot, and enhance the performance, scalability, and reliability of data processing pipelines.
• Mentor junior engineers and lead initiatives to integrate industry best practices and emerging technologies in data engineering into our workflows.
• Contribute to the strategic planning of data infrastructure to support the company's growing data needs.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 6+ years of experience in data engineering or a related role.
• Expertise in programming languages such as Python, Java, or Scala.
• Advanced experience with SQL and database technologies (e.g., PostgreSQL, MySQL).
• Proven expertise in designing and optimizing ETL processes and tools.
• Deep understanding of data modeling, database design principles, and data architecture.
• Extensive hands‑on experience with big data technologies and distributed computing environments.
• Strong problem‑solving and analytical skills, with a proven ability to lead complex projects.
• Demonstrated ability to optimize and scale data processing pipelines for performance and reliability.