Expert Data Engineer

Ciklum; Chennai; Hybrid; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Comprehensive company-paid medical insurance

Tailored education path with internal events and certifications

Hybrid work mode

Opportunities for career growth and project changes

Job summary

Ciklum is seeking an Expert Data Engineer for a full-time role in Chennai. This position requires extensive experience in data architectures and cloud platforms, focusing on building scalable data solutions. The candidate will be essential in enhancing analytics capabilities and supporting cross-functional teams to meet business needs.

Qualifications

• 5+ years coding in SQL, Java, Python; solid CS fundamentals.
• 3+ years in production deployments as a team lead.
• Experience with Hadoop, Spark, Kafka, AWS/Azure/GCP.

Responsibilities

• Build and maintain analytics solutions for big data.
• Contribute to data ingestion, real-time streaming, and batch processing.
• Cross-train team members on technologies being developed.

Skills

SQL

Java

Python

Scala

Data Governance

Cloud Data Platforms

Data Warehousing

Agile Methodology

Education

Undergraduate degree in Computer Science or Engineering

Masters preferred

Tools

Hadoop

Spark

Kafka

Databricks

Snowflake

Kubernetes

Job description

Join to apply for the Expert Data Engineer role at Ciklum

Join to apply for the Expert Data Engineer role at Ciklum

Direct message the job poster from Ciklum

Talent matchmaker, opportunity creator. Helping companies and candidates grow together! Recruitment Consultant Specializing in Strategic Sourcing at…

Ciklum is looking for an Expert Data Engineer to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As an Expert Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow.

Responsibilities:

• Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales
• Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storages
• Owns components of the engineering infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
• Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
• Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
• Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
• Works directly with business analysts and data scientists to understand and support their use-cases
• Contribute in the Unit’s activities and community building, participate in conferences, provide excellence in exercise and best practices
• Help in sales activities, customer meetings and digital services

Requirements:

We know that sometimes, you can’t tick every box. We would still love to hear from you if you think you’re a good fit!

• 5+ years of experience coding in SQL, Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design
• 3+ years contributing to production deployments of large backend data processing and analysis systems as a team lead
• 2+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra
• 3+ years of experience in cloud data platforms (AWS, Azure, GCP)
• Detailed knowledge and understanding of Data Governance process definition, development and deployment. This should include data quality, security and other data management standards & practices
• Demonstrable experience in leading development teams including managing the teams backlog and assigning tasks to team members, leading on maintaining development standards & the peer review process
• Ability to work on and manage multiple projects simultaneously while adapting to changing priorities in a fast-paced environment
• Knowledge of SQL and MPP databases (e.g. Vertica, Netezza, Greenplum, Aster Data)
• Knowledge of professional software engineering best practices for the full software
• Knowledge of Data Warehousing, design, implementation and optimization
• Knowledge of Data Quality testing, automation and results visualization
• Knowledge of BI reports and dashboards design and implementation (PowerBI, Tableau)
• Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Experience participating in an Agile software development team, e.g. SCRUM
• Experience designing, documenting, and defending designs for key components in large distributed computing systems
• A consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projects
• Demonstrated ability to learn new technologies quickly and independently
• Understanding of cloud infrastructure design and implementation
• Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred
• Experience with supporting data scientists and complex statistical usecases highly desirable
• Experience in data science and machine learning
• Experience in backend development and deployment
• Experience in CI/CD configuration
• Good knowledge of data analysis in enterprises
• Experience with Databricks, Snowflake
• Experience with Kubernetes

What's in it for you?

• Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, as well as financial and legal consultation
• Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy licence, language courses and company-paid certifications
• Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally
• Flexibility: hybrid work mode at Chennai or Pune
• Opportunities: we value our specialists and always find the best options for them. Our Resourcing Team helps change a project if needed to help you grow, excel professionally and fulfil your potential
• Global impact: work on large-scale projects that redefine industries with international and fast-growing clients
• Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building events

About us:

At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.

India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.

Want to learn more about us? Follow us on Instagram, Facebook, LinkedIn.

Explore, empower, engineer with Ciklum!

Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology and Engineering

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Ciklum by 2x

Get notified about new Data Engineer jobs in Chennai, Tamil Nadu, India.

Vendasta - Data Engineer - ETL/Data Warehousing

Cavin Infotech - AI/ML Engineer - Data Modeling

Interesting Job Opportunity: Senior Data Engineer - Informatica ICS

Lumel Technologies LLP - Junior Backend Developer - Data Structure & Algorithm

BigThinkCode - Senior Software Engineer - Python/Django/Flask

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.