Big Data Solution Engineer

Summitworks; Durham (NC); On-site; USD 90,000 - 120,000; Full time

Job summary

Summitworks is looking for a skilled software engineer to architect and develop Big Data applications for Fortune 100 companies. The role involves designing data processing pipelines using Hadoop tools, implementing data lake solutions, and traveling to client sites as needed.

The ideal candidate will have at least 4 years of experience in building large-scale applications, proficiency in Scala, Python, or Java, and excellent communication skills to work effectively with clients and teams.

Qualifications

• Solid software engineer with excellent analytical and troubleshooting skills.
• 4+ years of experience building large-scale big data applications.
• Proficiency in Scala, Python, or Java.

Responsibilities

• Architect and develop Big Data applications for Fortune 100 companies.
• Design and build data processing pipelines for structured and unstructured data.
• Implement and configure tools for Hadoop-based data lake implementations.

Skills

Analytical skills

Troubleshooting skills

Communication skills

Eager to learn new technologies

Tools

Spark

Hive

Java

Scala

Python

Shell scripting

Job description

Architect and develop Big Data applications for fortune 100 companies around the globe.

Design and build data processing pipelines for structured and unstructured data using tools and frameworks in the Hadoop ecosystem.

Implement and configure tools for Hadoop based data lake implementations and Proof of concepts.

Need to travel to client side when required.

Qualifications

• Solid software engineer with excellent analytical and troubleshooting skills.
• 4 + years of experience building production large scale big data applications.
• Proficiency in a programming language, ideally Scala, Python, or Java.
• Experience with big data technologies like Spark, Hive, or Impala.
• Excellent communication skills with clients and internal engineering teams.
• Eager to learn new technologies.

Preferred qualifications

• Experience with Spark, SQL, Scala, Python, Java, Shell scripting.
• Understanding of Data Integrations and ETL projects.

will be kept confidential according to EEO guidelines.