Lead Data Engineer, Remote

GXO Logistics; Teletrabalho; BRL 150.000 - 200.000; Tempo integral

Resumo da oferta

A leading logistics company seeks a Lead Data Engineer to design and optimize data pipelines on cloud platforms like Google Cloud Platform and Snowflake. The ideal candidate will have over five years of experience in data engineering, strong skills in Python and SQL, and knowledge of best practices in data quality and visualization. This role involves collaboration with cross-functional teams to meet data needs and ensure robust data infrastructure. Competitive salary and comprehensive benefits are offered.

Serviços

Full health insurance (medical, dental and vision)

401(k) plan

Life insurance

Disability

Company incentive plan

Qualificações

• 5+ years in designing and building data pipelines on cloud platforms like GCP and Snowflake.
• Expertise in modern data warehousing solutions including Snowpipe Streaming.
• Strong scripting skills in Python with advanced SQL knowledge.
• Experience in building, deploying, and optimizing DAGs in Airflow.
• Knowledge of data privacy laws including GDPR and CCPA.

Responsabilidades

• Lead the design, implementation, and maintenance of data pipelines on GCP and Snowflake.
• Collaborate with stakeholders to understand data requirements and deliver solutions.
• Optimize and enhance the performance of existing data pipelines.
• Implement best practices for data quality and validation.
• Create and maintain comprehensive documentation for data pipelines.

Conhecimentos

Data Pipeline Design

Cloud Platforms (GCP)

Snowflake

Python

Advanced SQL

Data Modeling

ETL/ELT Processes

Apache Airflow

GitHub

Data Visualization

Data Privacy Regulations

Formação académica

Bachelor’s degree in Computer Science, Data Science, or equivalent

Ferramentas

GCP

Snowflake

dbt

Apache Airflow

Superset

Descrição da oferta de emprego

Logistics at full potential.

At GXO, we’re constantly looking for talented individuals at all levels who can deliver the caliber of service our company requires. You know that a positive work environment creates happy employees, which boosts productivity and dedication. On our team, you’ll have the support to excel at work and the resources to build a career you can be proud of.

As the Lead Data Engineer, you will lead the design and development of robust and scalable data pipelines on a modern data platform. You will work closely with cross‑functional teams to understand data requirements, implement efficient solutions, and ensure the reliability and performance of our data infrastructure. The ideal candidate will have a strong background in data engineering, expertise in working with cloud platforms such as Google Cloud Platform (GCP), and experience with modern data warehousing solutions like Snowflake. The Lead Data Engineer will mentor less experienced developers and collaborate with cross‑functional teams, stakeholders, and vendors to achieve project milestones and deliver a robust and scalable data lake solution.

Pay, benefits and more.

We are eager to attract the best, so we offer competitive compensation and a generous benefits package, including full health insurance (medical, dental and vision), 401(k), life insurance, disability and the opportunity to participate in a company incentive plan.

What you’ll do on a typical day:

• Data Pipeline Design and Development: Lead the design, implementation, and maintenance of data pipelines to support data ingestion, transformation, and storage on GCP and Snowflake.
• Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet business objectives.
• Platform Optimization: Optimize and enhance the performance, scalability, and reliability of existing data pipelines, ensuring efficient data processing and storage.
• Technology Stack: Stay abreast of industry trends and emerging technologies in data engineering and incorporate them into the data architecture where applicable. Experience with the following modern data stack highly preferred: GCP, Snowflake, Fivetran, and dbt.
• Quality Assurance: Implement best practices for data quality, validation, and testing to ensure the accuracy and integrity of data throughout the pipeline.
• Documentation: Create and maintain comprehensive documentation for data pipelines, ensuring knowledge transfer and supportability.

What you need to succeed at GXO:

At a minimum, you’ll need:

• Bachelor’s degree in Computer Science, Data Science, or equivalent related work
• 5+ years in designing and building data pipelines on cloud platforms, preferably GCP and Snowflake.
• Expertise in working with modern data warehousing solutions such as Snowflake, i.e., Snowpipe Streaming, Warehouse Optimization, and clustering. Highly preferred, real-time data processing experience using Kafka.
• Python and Advanced SQL: Must be adept at scripting in Python, particularly for data manipulation and integration tasks, and have a solid grasp of advanced SQL techniques for querying, transformation, and performance optimization.
• Data Modeling: Understanding of best practices for data modeling, including star schemas, snowflake schemas, and data normalization techniques. A good understanding of the data structures that support email targeting.
• ETL/ELT Processes: Experience in designing, building, and optimizing ETL/ELT pipelines to process large datasets using dbt.
• Apache Airflow: Experience in building, deploying, and optimizing DAGs in Airflow or a similar tool.
• GitHub: Experience with version control, branching, and collaboration on GitHub.
• Data Visualization: Knowledge of tools like Superset, Looker or Python visualization libraries (Matplotlib, Seaborn, Plotly…etc)
• Collaboration and Communication: Ability to work closely with data scientists, analysts, and other stakeholders to translate business requirements into technical solutions. Strong documentation skills for pipeline design and data flow diagrams.
• Data Privacy: Knowledge of data privacy laws including an understanding of GDPR, CCPA, and other regulations to ensure compliance in data privacy practices.

It’d be great if you also have:

• Master’s degree
• Snowflake Certification (highly preferred)
• GCP Certification (highly preferred)

We engineer faster, smarter, leaner supply chains.

GXO is a leading provider of cutting‑edge supply chain solutions to the most successful companies in the world. We help our customers manage their goods most efficiently using our technology and services. Our greatest strength is our global team – energetic, innovative people of all experience levels and talents who make GXO a great place to work.

We are proud to be an Equal Opportunity employer including Disabled/Veterans.

GXO adheres to CDC, OSHA and state and local requirements regarding COVID safety. All employees and visitors are expected to comply with GXO policies which are in place to safeguard our employees and customers.

All applicants who receive a conditional offer of employment may be required to take and pass a pre‑employment drug test.

The above statements are intended to describe the general nature and level of work being performed by people assigned to this classification. They are not intended to be construed as an exhaustive list of all responsibilities, duties and skills required of personnel so classified. All employees may be required to perform duties outside of their normal responsibilities from time to time, as needed. Review GXO's candidate privacy statement here.