Senior Cloud Data Engineer 3 Big Data & Distributed Systems

J&T Business Consulting; Annapolis (MD); On-site; USD 199,000 - 238,000; Full time

Benefits offered by this job

Health, Dental, Vision Insurance

401(k) with company match

Paid Time Off and Holidays

Tuition Reimbursement

Job summary

J&T Business Consulting seeks a senior Cloud Software Engineer 3 to design and optimize large-scale Big Data cloud architectures in Annapolis, MD. You will develop distributed back-end processing, implement MapReduce analytics, and integrate with HDFS, Bigtable, and ZooKeeper.

You will lead in building RESTful services, manage multi-node Linux environments, and ensure secure distributed applications while guiding software trade-offs and JVM performance optimizations.

Qualifications

• Bachelor’s degree in Computer Science or related field plus 12 years of software engineering experience (with at least 4 years focused on Big Data cloud technologies and/or distributed computing)
• Or 16 years of relevant software engineering experience without a degree
• Master’s degree substitutes for 2 years of experience
• Cloudera Certified Hadoop Developer substitutes for 1 year of cloud experience
• 2+ years in Cloud/Distributed Information Retrieval
• 1+ year in Cloud Bigtable development and HDFS
• 1+ year in complex MapReduce analytics and distributed coordination frameworks
• Proficiency in Java, Maven, J2EE, RESTful services, Linux/CentOS
• Experience with SIGINT domain dataflow and cloud architectures
• Cloud platforms (AWS, Azure) and container tech (Docker, Kubernetes)

Responsibilities

• Architect, develop, test, and maintain distributed Big Data cloud systems and back-end processing pipelines.
• Implement Java applications, RESTful services, and MapReduce analytics for large-scale data sets.
• Integrate with Cloud Bigtable, HDFS, and ZooKeeper.
• Design workflows for ingesting, parsing, normalizing, and indexing diverse data formats.
• Manage multi-node cloud installations across Linux/CentOS environments.
• Secure distributed apps with PKI, firewalls, and identity services.
• Provide technical leadership on hardware/software trade-offs and component reuse.
• Profile and optimize JVM memory and application performance.

Skills

Java programming

Distributed computing

RESTful services

Linux

Mentoring / leadership

Education

Bachelor’s degree in Computer Science or related field

16 years of relevant software engineering experience without a degree

Tools

Maven

J2EE

HDFS

HBase

Apache Lucene

Apache Solr

MongoDB

Docker

Kubernetes

ZooKeeper

NiFi

Elasticsearch

Job description

J&T Business Consulting seeks a senior Cloud Software Engineer 3 to design and optimize large-scale Big Data cloud architectures in Annapolis, MD. You will develop distributed back-end processing, implement MapReduce analytics, and integrate with HDFS, Bigtable, and ZooKeeper.

You will lead in building RESTful services, manage multi-node Linux environments, and ensure secure distributed applications while guiding software trade-offs and JVM performance optimizations.