Senior Data Engineer

PODEAN; São Paulo; Presencial; BRL 60.000 - 100.000; Tempo integral

Resumo da oferta

An innovative agency is on the lookout for a Senior Data Engineer to join their dynamic team. In this role, you will be at the forefront of designing and implementing scalable data solutions that interact with major marketplace APIs. Your expertise will help build robust data pipelines and ensure high-quality, real-time data delivery for business intelligence. This role offers a fantastic opportunity to work with cutting-edge technologies in a collaborative environment, where your contributions will directly impact the success of various brands on platforms like Amazon and Walmart. If you are passionate about data engineering and API integration, this position is perfect for you!

Qualificações

• 6+ years of experience in data engineering focusing on API integration.
• Proficiency in Python, Java, or another programming language for data engineering.

Responsabilidades

• Develop and maintain integrations with marketplace APIs like Amazon Selling Partner API.
• Design, build, and optimize ETL/ELT pipelines for data processing.

Conhecimentos

Python

Java

SQL

API Integration

Data Pipeline Development

Problem Solving

Communication Skills

Ferramentas

AWS S3

Redshift

DynamoDB

Google BigQuery

Tableau

Looker

Power BI

Descrição da oferta de emprego

Podean is the leading global marketplace marketing agency. We work with progressive brands across the globe to unlock potential on Amazon, Target, Walmart, and other marketplaces. Our services span eCommerce strategy, content creation and optimization, media management, retail operations, data and analytics, consulting, and social commerce. Recent award wins include Digiday’s Best Employer for Remote Employees and Amazon’s Global Expansion Partner Award.

We are seeking an experienced Senior Data Engineer to join our growing team! As a Data Engineer focusing on Marketplace APIs, you will be responsible for designing, implementing, and maintaining scalable data solutions that interact with APIs from platforms like Amazon, , Walmart, and others. You will ensure seamless data integration, build robust pipelines, and create systems that deliver high-quality, real-time data to support business intelligence and decision-making processes.

What You'll Do:

• API Integration:
  • Develop and maintain integrations with marketplace APIs such as Amazon Selling Partner API
  • Handle API authentication, rate limits, pagination, and error handling.
• Data Pipeline Development:
  • Design, build, and optimize ETL/ELT pipelines for ingesting and processing data from multiple marketplaces.
  • Automate data workflows to ensure reliable and timely updates.
• Data Modeling and Storage:
  • Design and implement data models to support analytical and operational use cases.
  • Utilize data storage solutions such as AWS S3, Redshift, DynamoDB, or Google BigQuery.
• Performance and Scalability:
  • Monitor and optimize API calls to handle large-scale data operations efficiently.
  • Ensure the system can scale as data volumes and integration points grow.
• Collaboration:
  • Work closely with data analysts and product teams to deliver actionable insights and solutions.
  • Communicate technical concepts to non-technical stakeholders.
• Security and Compliance:
  • Manage API keys, tokens, and access credentials securely.

What We're Looking For:

• 6+ years of experience in a data engineering or similar role, with a focus on API integration.
• Proficiency in Python, Java, or another programming language suitable for API integration and data engineering.
• Expertise in SQL and experience with data warehouses (e.g., Redshift, Snowflake, BigQuery).
• Hands-on experience with workflow orchestration tools
• Proven track record of building scalable data pipelines and systems.
• Strong problem-solving abilities and attention to detail.
• Excellent communication skills and a collaborative mindset.
• Ability to manage multiple projects in a fast-paced environment
• Nice to Haves:
  • Experience with distributed data processing frameworks
  • Familiarity with monitoring tools for API performance and system health.
  • Knowledge of data visualization tools (e.g., Tableau, Looker, Power BI).