Data Engineer - PySpark

Cognizant; São Paulo; Híbrido; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading technology services firm is looking for a Data Engineer to work with PySpark, Python, and SQL to drive innovative projects. This hybrid role requires strong analytical skills, collaboration in cross-functional teams, and effective remote work management. Candidates should have a Bachelor's degree and proficiency in relevant technologies. The position offers a flexible work environment focusing on employee wellbeing.

Qualificações

• Advanced English required.
• Proficiency in Python LakeHouse, Spark Job Definition, OneLake, SQL, and PySpark is essential.
• Strong analytical and problem-solving abilities are needed.

Responsabilidades

• Develop and implement solutions using Python and Spark.
• Design and optimize data pipelines with OneLake and SQL.
• Analyze datasets using PySpark and provide insights.

Conhecimentos

Python LakeHouse

SQL

PySpark

Analytical skills

Problem-solving skills

Communication skills

Collaboration skills

Formação académica

Bachelor’s degree

Ferramentas

Apache Spark Certification

Descrição da oferta de emprego

Data Engineer – PySpark

About the role

Join our dynamic team as a Developer where you will leverage your expertise in Python LakeHouse Spark Job Definition OneLake SQL and PySpark to drive innovative solutions. With a focus on network domain skills you will work remotely in a day shift contributing to impactful projects that enhance our companys technological capabilities and societal impact.

In this role, you will:

• Develop and implement robust solutions using Python LakeHouse and Spark Job Definition to meet project requirements and enhance system performance.
• Collaborate with cross-functional teams to design and optimize data pipelines using OneLake and SQL ensuring efficient data flow and storage.
• Utilize PySpark to process and analyze large datasets providing actionable insights that drive business decisions.
• Ensure code quality and maintainability by adhering to best practices and conducting thorough testing and debugging.
• Participate in code reviews and provide constructive feedback to peers fostering a culture of continuous improvement and learning.
• Stay updated with the latest industry trends and technologies applying new knowledge to improve existing systems and processes.
• Document technical specifications and project progress ensuring transparency and effective communication with stakeholders.
• Troubleshoot and resolve technical issues promptly minimizing downtime and ensuring seamless operations.
• Contribute to the development of innovative solutions that align with the companys strategic goals and enhance its competitive edge.
• Engage in knowledge sharing sessions and workshops promoting a collaborative and inclusive work environment.
• Support the integration of network domain skills into projects enhancing the overall quality and relevance of deliverables.
• Work independently and manage time effectively in a remote work setting maintaining productivity and meeting deadlines.
• Collaborate with team members to identify opportunities for process improvement and implement solutions that increase efficiency.

Work model: Hybrid

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a hybrid position requiring 1 or 2 days a week in a client or Cognizant office in Sao Paulo, SP. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

What you need to have to be considered

• Bachelor’s degree
• Advanced English
• Demonstrate proficiency in Python LakeHouse Spark Job Definition OneLake SQL and PySpark with a proven track record of successful project delivery.
• Possess strong analytical and problem-solving skills with the ability to translate complex requirements into practical solutions.
• Exhibit excellent communication and collaboration skills with experience working in cross-functional teams.
• Show a keen interest in network domain skills with the ability to integrate this knowledge into relevant projects.
• Display a proactive approach to learning and professional development staying abreast of industry advancements.
• Maintain a high level of attention to detail and accuracy in all aspects of work.
• Demonstrate the ability to work effectively in a remote setting with strong self-motivation and time management skills.

These will help you stand out

• Certified Python Developer Apache Spark Certification

Please, upload your resume in English.

We're excited to meet people who share our mission and can make an impact in a variety of ways. Don't hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.