Data Engineer Lead

FedEx Dataworks; Plano (TX); On-site; USD 101,000 - 190,000; Full time

Job summary

FedEx Dataworks seeks a Data Engineer Lead to shape data platforms and drive scalable data pipelines across business units. You will collaborate with data scientists, software engineers, and stakeholders to implement robust data solutions.

Responsibilities include leading pipeline design and deployment, ensuring data quality and governance, and mentoring teams while delivering production-grade data systems for real-time and batch processing in a large enterprise environment.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Mathematics, Engineering, or a related field, or equivalent training/experience.
• 5–7 years of related experience in data engineering, analytics, or big data projects.

Responsibilities

• Design and implement data pipelines to collect, process, and store data at scale.
• Ensure data quality, governance, and security across pipelines.
• Collaborate with data scientists, engineers, and stakeholders to understand data needs and schemas.
• Lead code reviews and drive best practices for CI/CD and deployment of data products.
• Build robust, production-grade data systems and support large-scale data processing.

Skills

Distributed systems

Cloud environments

Azure tooling

Big data tools

Data pipelines

Data governance & security

Spark/PySpark

SQL/NoSQL

Code reviews

Python data tools

Education

Bachelor’s degree in Computer Science/Info Systems/Engineering

Tools

Hadoop

Spark

BigQuery

GCP

MySQL

PostgreSQL

MongoDB

Cassandra

ElasticSearch

Job description

Summary

The Data Engineer Lead plays a pivotal role within Dataworks, focused on creating and driving engineering innovation within Dataworks, helping define and build the Dataworks organization and facilitate the delivery of key business initiatives. S/he acts as a “universal translator” between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer Lead will contribute to the creation of and adherence to technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the Dataworks platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within FedEx and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code reviews and large-scale deployments. Under minimal supervision, supports the design, build, test and maintain data pipelines at big data scale. Assists with updating data from multiple data sources. Other functionalities under close supervision are to work on batch processing of collected data and match its format to the stored data, make sure that the data is ready to be processed and analyzed. Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data related problems and provide L3 support. Independently implements parsers, validators, transformers, and correlators to reformat, update and enhance the data. Provides recommendations to highly complex problems. Provides guidance to those in less senior positions.

Additional Summary and Preferred Skills

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholders, utilizing big data tools, implementing real-time data processing, ensuring data governance and security, documenting data architecture, and delivering data-driven insights.

• 1. Design and implement data pipelines to collect, process, and store data efficiently.
• 2. Ensure data quality, integrity, and accessibility.
• 3. Create data models to support business analytics and reporting.
• 4. Work with data scientists, analysts, and other stakeholders to understand data needs, and design schemas.
• 5. Build and manage ETL (Extract, Transform, Load) processes for data integration and automate data ingestion and transformation tasks.
• 6.Administer and optimize databases (both SQL and NoSQL). Monitor database performance and troubleshoot issues.
• 7. Collaborate with software engineers to integrate data systems with applications.
• 8. Utilize big data tools for processing large datasets, such as Hadoop or Spark.
• 9. Implement distributed systems for real-time data processing.
• 10. Ensure data governance and security through compliance with data governance policies and data security standards.
• 11. Implement data access controls and encryption techniques.
• 12. Document data architecture, pipelines, and processes.
• 13. Provide reports and insights based on data analysis.
• 14. Working knowledge of DataBricks, BigQuery, and GCP

Job Description

Understanding in depth both the business and technical problems Dataworks aims to solve

Building tools, platforms and pipelines to enable teams to clearly and cleanly analyze data, build models and drive decisions

Scaling up from “laptop-scale” to “cluster scale” problems, in terms of both infrastructure and problem structure and technique

Delivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplines

Codifying best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases Interacting with senior technologists from the broader enterprise and outside of FedEx (partner ecosystems and customers) to create synergies and ensure smooth deployments to downstream operational systems

Minimum Education

Bachelor’s degree in Computer Science, Information Systems, Mathematics, Engineering, or a related quantitative field — or equivalent formal training and professional experience.

Minimum Experience

Five to Seven (5 - 7) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analytics. A related advanced degree may offset the related experience requirements.

Knowledge, Skills and Abilities

• Technical background in computer science, software engineering, database systems, distributed systems
• Fluency with distributed and cloud environments and a deep understanding of how to balance computational considerations with theoretical properties
• Detailed knowledge of the Microsoft Azure tooling for large-scale data engineering efforts and deployments is highly preferred
• A compelling track record of designing and deploying large scale technical solutions, which deliver tangible, ongoing value
• Direct experience having built and deployed robust, complex production systems that implement modern, data scientific methods at scale
• Ability to context-switch, to provide support to dispersed teams which may need an “expert hacker” to unblock an especially challenging technical obstacle, and to work through problems as they are still being defined
• Demonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver value
• An ‘engineering’ mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact
• Comfort with working with distributed teams on code-based deliverables, using version control systems and code reviews
• Ability to conduct data analysis, investigation, and lineage studies to document and enhance data quality and access
• Use of agile and devops practices for project and software management including continuous integration and continuous delivery
• Demonstrated expertise working with some of the following common languages and tools: Spark (Scala and PySpark), HDFS, Kafka and other high-volume data tools
• SQL and NoSQL storage tools, such as MySQL, Postgres, Cassandra, MongoDB and ElasticSearch
• Pandas, Scikit-Learn, Matplotlib, TensorFlow, Jupiter and other Python data tools.
• Extensive knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelines.
• Extensive knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems.
• Experience providing leadership in a general planning or consulting setting.
• Experience as a leader or a senior member of multi-function project teams. Strong oral and written communication skills.

Pay Transparency Ranges

USA: $9,025/month - $19,346/month, AR, AZ, FL, IA, IN, KS, KY, LA, MO, MS, NE, OH, OK, SC, TN, UT: $9,025/month - $15,477/month, HI, MD, MN, NV, OR, RI: $9,345/month - $16,251/month, AK: $9,790/month - $17,025/month, DC: $10,680/month - $18,572/month, AL, GA, MI, NC, WI: $9,025/month - $16,251/month, CO, IL, PA, TX: $9,025/month - $17,025/month, NY, VA: $9,025/month - $18,572/month, CT, MA, WA: $9,345/month - $17,799/month, CA: $9,345/month - $19,346/month, NJ: $9,790/month - $18,572/month

Domicile Information

The preferred candidate will be domiciled in Plano, TX, Memphis, TN, or Pittsburgh, PA.

Equal Opportunity Statement

FedEx Dataworks is an Equal Opportunity Employer including, Vets/Disability.

• Know Your Rights
• Pay Transparency

Dataworks does not discriminate against qualified individuals with disabilities in regard to job application procedures, hiring, and other terms and conditions of employment. Further, Dataworks is prepared to make reasonable accommodations for the known physical or mental limitations of an otherwise qualified applicant or employee to enable the applicant or employee to be considered for the desired position, to perform the essential functions of the position in question, or to enjoy equal benefits and privileges of employment as are enjoyed by other similarly situated employees without disabilities, unless the accommodation will impose an undue hardship. If a reasonable accommodation is needed, please contact [e-mail].