Data Engineer

RE Partners; Manaus; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A fast-growing technology consultancy in Recife, Brazil, seeks a Senior Data Engineer to drive value for clients through effective data engineering and modeling. Responsibility includes leading automated data engineering pipelines and implementing modern code development practices. The ideal candidate has extensive expertise in RDBMS, Python, SQL, and Google Cloud technologies. Join a diverse and inclusive team focused on transforming business technology and improving client outcomes.

Serviços

Referral bonus

Inclusive workplace

Qualificações

• Extensive expertise of RDBMS, Python, Hadoop, SQL and Pyspark.
• GCP experience, including Dataproc and Dataflow.
• Hands on Java experience.
• Experience of ETL/ELT technical design and automated testing.

Responsabilidades

• Lead the design and orchestration of automated data engineering pipelines.
• Build quality by design into data engineering practices.
• Implement modern code development and data engineering orchestration.

Conhecimentos

RDBMS

Python

Hadoop

SQL

Pyspark

Ferramentas

GCP

Dataproc

Dataflow

Java

Descrição da oferta de emprego

Hello from RE Partners!

Who We Are:

We are a fast growing business and technology consultant company co-founded in 2019. We offer a custom-tailored, white-glove engineering service fit for our clients, because a digital transformation is more than just technology. With a successful track record of being a preferred vendor for Fortune 500 companies and as a trusted partner for some of the industry’s leading companies, our global talent has helped many clients achieve their goals.

The 3 G’s of RE:

“Get Shit Done.”

“Get Over Shit.”

“Give a Shit.”

Senior Data Engineer

This role exists to drive value for our customers and business functions through effective data engineering, modelling, and data transformations by leading the delivery of strategic data solutions whilst setting up resilient data architecture and engineering foundations and supporting junior members of the data engineering team.

Responsible for:

• Leading the design and orchestration of modularized, automated, event-driven data engineering pipelines and data modeling approaches.
• Building in quality by design into data engineering practices, enabling a scalable and flexible data architecture and feature rich dataset to support the wider Data function and the entire business.
• Implementing modern code development and data engineering orchestration strategies to target and streamline our data engineering processes.
• Embedding new data techniques into the business through coaching, training, and providing experiment design oversight to more junior data engineers.
• Working with third party partners and software providers to improve and/or implement new data solutions and processes.
• Being the gatekeeper for customer data, aware of our usage and alignment to data privacy standards, in collaboration with Data Governance to ensure best practice standards are applied/maintained.

Accountable for:

• Working closely with our Lead Data and ML Engineers to drive the adoption of DevOps and modern code development practices across the Data function.
• Collaborating with Quality and Software Engineering and System teams to drive cross-function visibility and reduction of technical debt across the teams.
• Ensuring that our data engineering processes and pipelines are resilient and future-proof.
• Developing a strong knowledge of all data sources and maintaining relationships with data users/processors across the company.
• Being a Senior Data Engineer, supporting more junior data engineering colleagues from a technical skills development perspective.

Essential skills and experience:

• Extensive expertise of RDBMS, Python, Hadoop, SQL and Pyspark.
• GCP experience, including Dataproc and Dataflow
• Hands on Java experience
• Hands on experience in modern code development practices (Infrastructure-as-Code) and data engineering in the Google Cloud
• Experience of ETL/ELT technical design, automated testing of engineering pipelines, quality assurance and documentation.
• Proven experience of data warehousing, data wrangling and data modelling approaches.
• Proven experience coaching junior members of data engineering teams and supporting their skills development.
• Proven experience working collaboratively with System, Quality Engineering and Software Engineering teams.
• Demonstrable experience of critical thinking, communication and problem-solving ability and stakeholder management
• Demonstrate delivery under pressure and to deadline.
• Experience working in an e-commerce/retail market would be beneficial.

Preferred skills and experience:

• Willingness to learn new tools and techniques; proactively keeping up to date with latest thinking and practices.
• Able to establish what does/doesn’t align to business/functional strategies/priorities and communicate dependencies clearly.
• Able to drive the adoption of best practice approaches to data engineering, coaching, and supporting the wider data engineering team.
• Embrace change with a positive outlook.
• Confident to challenge, and receptive to being challenged.
• The ability to thrive in a fast-paced environment.

Join Our Global Team:

We invite you to apply for the position at RE Partners. Join us in shaping the future of business technology consulting and transforming the way organizations thrive in a digital world. As a diverse, woman-owned global business, we pride ourselves on keeping talent happy – our 7% attrition rate speaks volumes. Bring your talented friends along and earn a referral bonus

Equal Opportunity Employer:

We are an equal opportunity employer and welcome applications from all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or veteran status.