Data Engineer (Spark, Java, Cloud)

Redolent Infotech Pvt. Ltd.; Bengaluru; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Redolent Infotech Pvt. Ltd. is seeking a Data Engineer in Bangalore or remote to design and deploy scalable data solutions. You will work with Spark, Hadoop, Java, and cloud platforms to build high-performance data pipelines and analytics.

The role involves collaborating with global teams, evaluating open-source tools, and delivering features that drive data-driven decisions. A strong background in distributed systems and cloud deployments is essential.

Qualifications

• Expertise in BigData ecosystem with Java, Hadoop, Spark, Cassandra and NoSQL.
• Experience with distributed architecture and MPP engines (Spark, Impala).
• Bachelor's degree with 4+ years or Master’s with 3+ years in CS or related field.
• Experience building scalable, highly available distributed systems in production.
• Experience with SOA & Microservice architecture and CI/CD practices.
• Knowledge of Azure / GCP offerings is a plus and SQL Server familiarity.
• Excellent communication and presentation skills.

Responsibilities

• Design, build, test and deploy data solutions at scale for a global user base.
• Collaborate with client engineering teams across geographies to share expertise.
• Work with product management to set priorities and deliver features.
• Evaluate open source tools and run POCs to extend capabilities.
• Develop features enabling data analytics at scale for client platforms.
• Deploy and monitor data products on cloud platforms.
• Establish monitoring to ensure data applications meet SLAs.
• Communicate with customers to address needs across regions.
• Coordinate with vendor partners and provide SME support for apps.

Skills

Spark

Hadoop

Java

GCP

Azure

BigData

Cassandra

NoSQL

SQL Server

Education

Bachelor's Degree (CS/related) +4+ yrs

Master's Degree +3+ yrs

Tools

CI/CD

Logs Monitoring

Cloud Deployments

Microservices

Job description

One of our direct client is urgently looking for Data Engineer.

Title: DataEngineer (Spark, Java, Cloud)

Location: Bangalore, India OR Remote

Duration: 1+ year ( Contractto hire option is available )

Must have skills: Spark, Hadoop, Java, GCP/Azure, BigData.

Our Team

As the biggest company in the world (Fortune #1), we just don’t design solutions that work. Our software solutions solve for performance and complexity of scale. On a weekly basis, there are 260+ Million customers who visit our stores across the globe. We have 6 petabytes ofdata(entire internet archive is 15 Petabyte) and tables having 200+ Billion rows.

The team at Bangalore has an open fun culture where each idea is challenged as well as respected. If you are a software geek, who loves to solve complex problems and are interested to learn new things daily then Client is the place for you.

As part of the Delivery Services we offer specific services to Internal Projects /Customers.

Your Responsibility

• Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide drive value fromdataat Client Scale
• Interact with Clientengineeringteams across geographies to leverage expertise and contribute to the tech community.
• Engage with Product Management and Business to drive the agenda, set your priorities and deliver awesome product features to keep platform ahead of market scenarios.
• Identify right open source tools to deliver product features by performing research, POC/Pilot and/or interacting with various open source forums
• Develop and/or Contribute to add features that enabledataanalytics at Client scale
• Deploy and monitor products on Cloud platforms
• Develop and implement best-in-class monitoring processes to enabledataapplications meet SLAs
• Communicate effectively with Customers across geographies to serve their needs
• Work with vendor partners and lead them in resolving the issues. Will be point of contact for vendors and provide SME support for applications

Our Ideal Candidate

If you love solving complex problems, facing unique technical challenges, making quick decisions and thinking on your feet then this is the role for you! Your passion for technology, solving and troubleshooting complex issues/risks will help you grow and excel in this role.

Your Qualifications

• Expertise in BigDataEcosystem with deep experience in Java, Hadoop, Spark, Cassandra, NoSQL etc.
• Expertise in distributed architecture and knowledge of MPP engine (Spark, Impala etc).
• Bachelor's Degree and 4+ yrs. of experience or Master’s Degree with 3+ years of experience in Computer Science or related field
• Experience in building scalable/highly available distributed systems in production.
• Experience with SOA & Microservice architecture.
• Knowledge of SoftwareEngineeringbest practices with experience on implementing CI/CD, Log aggregation/Monitoring/alerting for production system.
• Working Knowledge of Azure / GCP offerings is a plus.
• Familiarly with SQL Server
• Should have excellent Communication and Presentation skills.