Associate Data Engineer

Stanford University; Palo Alto (CA); On-site; USD 138,402 - 163,985; Full time

Benefits offered by this job

Tuition reimbursement

Health/wellbeing benefits

Flexible work options

Job summary

Stanford University in California's Palo Alto is seeking a Data Engineer to design, develop, and maintain data pipelines and warehousing systems. You will work on data integration across cloud and hybrid environments, translating complex requirements into scalable solutions.

You will mentor junior developers, apply best practices in ETL/ELT, and collaborate with stakeholders to deliver reliable data platforms that enable analytics and decision making. Strong AWS and Python skills are essential.

Qualifications

• Bachelor’s degree with five years of relevant data engineering experience.
• Expertise in designing, developing, testing and deploying applications.
• Strong problem solving for highly technical applications.
• Hands-on experience with AWS, Snowflake, and ETL/ELT pipelines.
• Experience with Python/PySpark for ELT, APIs.
• Experience with data modeling, and data migration/integration.
• Excellent communication with technical and non-technical stakeholders.

Responsibilities

• Conceptualize and implement data engineering solutions independently.
• Design and optimize data pipelines for real-time and batch processing.
• Develop scalable data warehousing and data lake architectures.
• Document builds and configurations; maintain documentation.
• Mentor junior developers and lead projects of moderate scope.
• Translate requirements into architecture and high-performing software.

Skills

Advanced SQL

PySpark

Python

AWS

Snowflake

Kafka

Airflow

Fivetran

Oracle Cloud

Data Modeling

Data Warehousing

Data Pipelines

Scala

R

Communication

Education

Bachelor's degree + 5 years experience

Tools

AWS

Snowflake

Fivetran

Kafka

Airflow

Oracle Cloud

Job description

Execute all programming tasks, including programming, analyzing, designing, developing, implementing, modifying, and maintaining computer programs. Work on systems of small to moderate size and complexity or segments of larger systems.

Core Duties

• Conceptualize design, implement and develop solutions for complex system/programs independently.
• Design and develop applications that may involve sophisticated data manipulation. Implementation and maintenance of complex Data Store/ Data Lake/Lake house and Data warehousing systems and data-intensive solutions that are scalable, optimised and fault‑tolerant.
• Document system builds and application configurations; maintain and update documentation as needed.
• Provide technical analysis, design, development, conversion and implementation work.
• Work as a project leader, as needed, for projects of moderate complexity.
• Serve as a technical resource for all Data Engineering applications.
• Compare, evaluate and implement new features and technologies, and integrate them into the computing environment.
• Follow team software development methodology.
• Mentor lower‑level software developers.
• Design and implement Data Migration and Data Integration across cloud and hybrid environments.
• Mastery and hands‑on experience with Data Engineering technologies and scripting languages.
• Ability to translate complex functional and technical requirements into detailed architecture, design and high‑performing software.
• Design, build and optimise pipelines for data collection for storage, access and analytics.

Qualifications

Minimum Requirements:

Education and Experience: Bachelor’s degree and five years of relevant experience, or a combination of education, training and relevant experience.

Knowledge, Skills and Expertise:

• Expertise in designing, developing, testing and deploying applications.
• Ability to define and solve logical problems for highly technical applications.
• Hands‑on experience and training in Advanced SQL, Advanced Python programming, AWS Services (such as S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC and others), SnowFlake, FiveTran, KAFKA, Airflow, Oracle Cloud and other open‑source tools.
• Experience in writing reusable complex Python/PySpark scripts for ELT, Business Logic or APIs. Other coding experience such as Scala and R programming is a plus.
• Hands‑on development work on all aspects of data analysis, data provisioning, modelling, performance tuning and optimisation.
• Experience in working on AWS cloud environment, using the marketplace for the right tool, efficient utilisation of them to meet business requirements.
• Build scalable data pipelines for both real‑time and batch using best practices in data modelling, ETL/ELT processing using various technology stack.
• Experienced in Data Modeling, Data Migration and Data Integration. Know the pain points in Data integration across SaaS applications and implement the best solution that fits the organisation.
• Strong communication skills with both technical and non‑technical clients.

Physical Requirements

• Constantly perform desk‑based computer tasks.
• Frequently sit, grasp lightly/fine manipulation.
• Occasionally stand/walk, use a telephone.
• Rarely writing by hand, lift/carry/push/pull objects that weigh up to 10 pounds.

Consistent with its obligations under the law, the University will provide reasonable accommodation to any employee with a disability who requires accommodation to perform the essential functions of the job.

Working Conditions

• May work extended hours, evenings and weekends.

Work Standards

• Interpersonal skills: Demonstrates the ability to work well with Stanford colleagues and clients and with external organisations.
• Promote culture of safety: Demonstrates commitment to personal responsibility and value for safety; communicates safety concerns; uses and promotes safe behaviours based on training and lessons learned.
• Subject to and expected to comply with all applicable University policies and procedures, including but not limited to the personnel policies and other policies found in the University’s Administrative Guide, http://adminguide.stanford.edu.

The expected pay range for this position is $138,402 to $163,985 per annum. Stanford University provides pay ranges representing its good faith estimate of the salary or hourly wage the university reasonably expects to pay for a position upon hire. The pay offered to a selected candidate will be determined based on factors such as (but not limited to) the scope and responsibilities of the position, the qualifications of the selected candidate, departmental budget availability, internal equity, geographic location and external market pay for comparable jobs. At Stanford University, base pay represents only one aspect of the comprehensive rewards package.

Why Stanford Is for You

Stanford University has revolutionised the way we live and enrich the world. Supporting this mission is our diverse and dedicated 17,000 staff. We seek talent driven to impact the future of our legacy. Our culture and unique perks empower you with:

• Freedom to grow. We offer career development programmes, tuition reimbursement, or audit a course. Join a TedTalk, film screening, or listen to a renowned author or global leader speak.
• A caring culture. We provide superb retirement plans, generous time‑off and family care resources.
• A healthier you. Climb our rock wall or choose from hundreds of health or fitness classes at our work‑class exercise facilities. We also provide excellent health care benefits.
• Discovery and fun. Stroll through historic sculptures, trails and museums.
• Enviable resources. Enjoy free commuter programmes, ridesharing incentives, discounts and more!
• Redwood City. Our new Stanford Redwood City campus, opened in 2019, will be the workplace for approximately 2,700 staff, including University IT, whose jobs are important to supporting the University’s mission. The campus will offer amenities such as onsite cafes and a dining pavilion, a high‑end fitness facility with an outdoor pool and a childcare centre for Stanford families.

These job duties listed are typical examples of work performed by positions in this job classification and are not designed to contain or be interpreted as a comprehensive inventory of all duties, tasks and responsibilities. Specific duties and responsibilities may vary depending on department or programme needs without changing the general nature and scope of the job or level of responsibility. Employees may also perform other duties as assigned.

Consistent with its obligations under the law, the University will provide reasonable accommodations to applicants and employees with disabilities. Applicants requiring a reasonable accommodation for any part of the application or hiring process should contact Stanford University Human Resources by submitting a contact form.

Stanford is an equal employment opportunity and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status or any other characteristic protected by law.