Senior Hadoop & Big Data Engineer

Tata Consultancy Services Limited; Newark (DE); On-site; USD 80,000 - 90,000; Full time

Job summary

Tata Consultancy Services in Newark, DE is seeking a Senior Hadoop Developer to design and implement data warehousing architectures and Hadoop-based solutions. You will work with Cloudera, Hive, Spark, Python, and Scala in a production environment to deliver robust data processing capabilities.

Responsibilities include optimizing SQL queries, ingesting data from multiple sources, and collaborating with cross-functional teams in an Agile setting.

Qualifications

• 4+ years of experience in data warehousing architectural approaches.
• Minimum of 4 years in big data (Cloudera).
• Sound understanding and experience with the Hadoop ecosystem (Cloudera).
• Able to understand and explore the constantly evolving tools within the Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
• Experience working with a Big Data implementation in a production environment.
• Must have experience with Big Data technologies such as Hadoop, Hive, Spark, Python, Scala, etc.
• Experience in Python and Unix shell scripting.
• Experience with a scheduling tool such as Autosys.
• Understanding of Agile methodologies and technologies.
• Sound knowledge of relational databases (SQL) and experience with large SQL-based systems.
• Exposure to and strong working knowledge of distributed systems.
• Excellent understanding of client-service models and customer orientation in service delivery.
• Candidate should have in-depth knowledge of Hadoop technologies, SQL, and ETL processes.

Responsibilities

• Excellent understanding of client-service models and customer orientation in service delivery.
• Ability to grasp the "big picture" for a solution by considering all potential options in the impacted area.
• Aptitude to understand and adapt to newer technologies.
• Ability to work with teammates collaboratively to achieve a mission.
• Experience in query optimization and performance tuning of complex SQL queries.
• Benchmark and debug critical issues with algorithms and software as they arise.
• Previous experience in the financial services industry.
• Broad technical experience and good understanding of existing testing/operational processes, with an open mind on how to enhance those processes.
• Understanding of industry trends and relevant application technologies.
• Experience in designing and implementing analytical environments and business intelligence solutions.
• The team is looking for an experienced Senior Hadoop Developer.
• Candidate should possess excellent analytical capabilities, gain a deep understanding of the data, and build correlations between various data elements/objects.
• The team is also responsible for ingesting data from multiple sources. The candidate should be able to support the ingestion process using Big Data tools and frameworks.

Skills

Hadoop ecosystem

Hive

Spark

Python

Scala

Unix shell scripting

Autosys

Agile methodologies

SQL

ETL processes

Distributed systems

SQL-based systems

Tools

Autosys

Job description

Tata Consultancy Services in Newark, DE is seeking a Senior Hadoop Developer to design and implement data warehousing architectures and Hadoop-based solutions. You will work with Cloudera, Hive, Spark, Python, and Scala in a production environment to deliver robust data processing capabilities.

Responsibilities include optimizing SQL queries, ingesting data from multiple sources, and collaborating with cross-functional teams in an Agile setting.