Big Data Engineer

Stem Xpert; New York (NY); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology solutions company is seeking a skilled Java developer in New York to implement solutions for large data processing using NoSQL and Hadoop. The ideal candidate will have strong server-side Java experience and be involved in architectural discussions. Responsibilities include collaborating with architects, ensuring quality deliveries, and conducting technical trainings. Experience with open source technologies and large databases is essential for this role.

Qualifications

• Very strong server-side Java experience in open source, data-intensive environments.
• Experience with open source products and contributions.
• In-depth knowledge of Java, J2EE, and EAI patterns.
• Experience with large data processing projects.
• Good understanding of architectural concepts and NFRs.
• Knowledge of database principles and working with large databases.
• Exposure to complete SDLC and PDLC.
• Ability to work individually and in teams.

Responsibilities

• Implementation of solutions for large data processing over NoSQL and Hadoop.
• Participate in architecture and design discussions with big data customers.
• Work with architects and provide implementation details.
• Conduct technical sessions and write whitepapers.
• Ensure timely and quality deliveries.
• Share knowledge and train other groups.

Skills

Server-side Java

Open source contributions

Java, J2EE, EAI patterns

Complex project implementation

Architectural concepts (Multi-tenancy, SOA, SCA)

Algorithms and data structures

Database principles and SQL

Batch processing and real-time systems

Tools

Hadoop

NoSQL

Kafka

Storm

Solr

Job description

TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process.

Job Description

Primary Skills:

1. Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments.
2. Should have worked on open source products and contribution towards it would be an added advantage.
3. Implemented and in-depth knowledge of various java, J2EE and EAI patterns.
4. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity.
5. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc).
6. Good understanding of algorithms, data structure, and performance optimization techniques.
7. Knowledge of database principles, SQL, and experience working with large databases beyond just data access.
8. Exposure to complete SDLC and PDLC.
9. Capable of working as an individual contributor and within team too.
10. Self-starter & resourceful personality with ability to manage pressure situations.
11. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc.

Role & Responsibilities

• Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products
• Active participation in the various Architecture and design calls with bigdata customers.
• Working with Sr. Architects and providing implementation details to offshore.
• Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData
• Responsible for Timely and quality deliveries.
• Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings