Senior Big Data Engineer

TechDigital Group; Jersey City (NJ); On-site; USD 90,000 - 120,000; Full time

Job summary

TechDigital Group is seeking a Senior Technical Specialist in Jersey City, NJ. This role requires expertise in Apache Spark, Scala, and Python to develop technical solutions that meet organizational goals. Key responsibilities include developing data processing frameworks, writing efficient code, and collaborating with teams to implement scalable data solutions. Relevant certifications in these technologies are a plus. This position offers opportunities to stay updated with big data advancements.

Qualifications

• Proficiency in Apache Spark for developing data processing frameworks.
• Strong programming skills in Scala and Python for data analysis and manipulation.
• Experience in handling big data and implementing scalable solutions.

Responsibilities

• Develop and implement data processing frameworks using Apache Spark.
• Write efficient code in Scala and Python for data analysis and manipulation.
• Collaborate with cross-functional teams to design and implement scalable data solutions.
• Troubleshoot and resolve technical issues related to Apache Spark, Scala, and Python applications.

Skills

Proficiency in Apache Spark

Strong programming skills in Scala

Strong programming skills in Python

Experience in handling big data

Collaboration skills

Tools

Apache Spark

Scala

Python

Job description

The Senior Technical Specialist will be responsible for providing expertise in Apache spark, scala, and python. They will play a key role in developing and implementing technical solutions using these tools to meet the organization's objectives.

Key Responsibilities

1. Develop and implement data processing frameworks using Apache spark.
2. Write efficient code in scala and python for data analysis and manipulation.
3. Collaborate with cross functional teams to design and implement scalable data solutions.
4. Troubleshoot and resolve technical issues related to apache spark, scala, and python applications.
5. Stay updated with the latest trends and advancements in big data technologies.

Skill Requirements

1. Proficiency in apache spark for developing data processing frameworks.
2. Strong programming skills in scala and python for data analysis and manipulation.
3. Experience in handling big data and implementing scalable solutions.
4. Knowledge of data engineering concepts and methodologies.
5. Ability to collaborate effectively with teams and communicate technical concepts clearly.

Certifications

Relevant certifications in Apache Spark, Scala, or Python are a plus.