Big Data Architect

Oxford Global Resources; Gaithersburg (MD); On-site; USD 117,000 - 152,000; Full time

Job summary

Oxford Global Resources in Gaithersburg, MD is seeking a Senior Big Data Engineer to develop, integrate, test, and maintain large-scale Hadoop-based solutions. You will work with Java or Python, Spark, and related technologies on a production Hadoop cluster, delivering robust data pipelines and analytics capabilities.

The role requires 10–15 years IT experience with 3–5 years in Big Data projects, strong Hadoop knowledge, and the ability to lead a small team through design reviews, code reviews,

Qualifications

• 10-15 years of IT experience with at least 3-5 years in BigData project experience.
• Strong Hadoop ecosystem technical knowledge.
• Extensive hands on experience in designing, developing, and maintaining software solutions in Hadoop cluster.
• Experience with UNIX shell scripting, Sqoop, Eclipse, HCatalog, Pig scripts, Hive QL, UDF - design & development.
• Hands-on experience with Spark and Scala - design & development.
• Experience in Kafka.
• Demonstrate strong knowledge in Hadoop Best Practices, Troubleshooting and Performance tuning.
• Demonstrates broad knowledge of technical solutions, design patterns, and code for medium/complex applications deployed in Hadoop production.
• Experience with change management / DevOps tools (Github / Jenkins etc.).
• Participate in design reviews, code reviews, unit testing and integration testing.
• Experience in SDLC Methodology (Agile / Scrum / Iterative Development).
• Mentoring / leading a team and provide technical guidance.
• Good communication skills. Will need to communicate with client IT PMs, client lead and architects.
• Working experience with developing MapReduce programs running on the Hadoop cluster using Java/Python.
• Experience with NoSQL Databases like HBASE, Mongo or Cassandra.
• Experience using Talend with Hadoop technologies.
• Working experience in the data warehousing and Business Intelligence systems.
• Business requirements management and Systems change / configuration management.
• Familiarity with JIRA.
• Experience in ZENA (or any other scheduling tool).

Responsibilities

• Develop, integrate, test, and maintain existing and new applications.
• Own and deliver assigned components for self and a small team.
• Communicate with client IT PMs, leads, and architects.
• Mentor and guide junior team members through design and code reviews.

Skills

BigData experience

Hadoop ecosystem

Spark & Scala

Java/Python MapReduce

Unix shell scripting

NoSQL databases

Talend with Hadoop

Kafka

ETL & data warehousing

Agile / Scrum

Mentoring / leadership

Tools

GitHub

Jenkins

Sqoop

Eclipse

HCatalog

Jira

ZENA

Job description

Summary

Responsible for developing, integrating, testing, and maintaining existing and new applications; knowing one or more programming languages; knowing one or more development methodologies and delivery models.

Project Details

• Responsible for developing, integrating, testing, and maintaining existing and new applications
• Responsible for knowing one or more programming languages
• Responsible for knowing one or more development methodologies and delivery models
• Ownership and accountability for the assigned deliverables for him/herself and small (3-5 member) team

Job Experience

• 10-15 years of IT experience with at least 3-5 years in BigData project experience
• Strong Hadoop eco system technical knowledge
• Extensive hands on experience in designing, developing, and maintaining software solutions in Hadoop cluster
• Experience with strong UNIX shell scripting, SQOOP, eclipse, HCatalog, Pig scripts, Hive QL, UDF - design & development
• Hands-on experience with Spark and Scala - design & development
• Experience in Kafka
• Demonstrate strong knowledge in Hadoop Best Practices, Troubleshooting and Performance tuning
• Demonstrates broad knowledge of technical solutions, design patterns, and code for medium/complex applications deployed in Hadoop production.
• Experience with change management / DevOps tools (Github / Jenkins etc.)
• Participate in design reviews, code reviews, unit testing and integration testing
• Experience in SDLC Methodology (Agile / Scrum / Iterative Development)
• Mentoring / leading a team and provide technical guidance
• Good communication skills. Will need to communicate with client IT PMs, client lead and architects
• Working experience with developing MapReduce programs running on the Hadoop cluster using Java/Python
• Experience with NoSQL Databases like HBASE, Mongo or Cassandra
• Experience using Talend with Hadoop technologies
• Working experience in the data warehousing and Business Intelligence systems
• Business requirements management and Systems change / configuration management
• Familiarity with JIRA
• Experience in ZENA (or any other scheduling tool)
• Hourly Rate: 85-110
• Language Required: English

Oxford is an Equal Employment Opportunity Employer. All qualified applications will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law. Oxford will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. Oxford provides supplemental medical (we do not offer major medical), dental, vision, life, and disability benefit plans along with a 401(k) Retirement Savings Plan. Paid holidays based on eligibility and paid sick leave for applicable jurisdiction, as required. Oxford is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. If you need special assistance or an accommodation while seeking employment, please email [e-mail]. We will make a determination on your request for reasonable accommodation on a case-by-case basis.