Data Engineer

Arsenault; San Diego (CA); On-site; USD 80,000 - 120,000; Full time

Job summary

A technology company in San Diego is seeking a skilled Data Engineer to manage and optimize data pipelines and databases. The ideal candidate will have experience in Java, Python, and cloud environments like AWS or Azure. Responsibilities include collaborating with business users to understand data requirements, maintaining high-performance data systems, and performing quality assurance testing. Strong communication and multitasking skills are essential for success in this team-oriented environment.

Qualifications

• At least 1 year experience in basic-level administration of data infrastructure.
• At least 1 year coding experience in Java, Python, R or equivalent.

Responsibilities

• Work with business users to understand their requirements.
• Hands on coding of data pipelines.
• Maintain existing databases and big data systems.
• Ensure high performance of data systems.
• Provide quality assurance testing for all work performed.

Skills

Java

Python

SQL

NoSQL

Data infrastructure administration

Cloud experience (AWS, GCP, Azure)

Oral and written communication

Job description

• Work with business users to understand business requirements, issues and business and/or client processes
• Hands on coding of data pipelines
• Hands on administration of existing databases and big data systems
• Develop, test, maintain, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards
• Perform quality assurance testing for all work performed
• Prepare required documentation as outlined by departmental standards
• Meet with agile teams as required to define and document application requirements
• Maintain industry standards and best practices
• Maintain security and organization of the companys data
• Provide off-hour support as assigned
• Provide high level estimates for new business requirements/features
• Work with manager to ascertain the companys data requirements
• Install new databases, data pipelines, maintain existing databases and data pipelines
• Design and implement processes and solutions for data distribution and data archiving
• Develop and implement backup and recovery plans to mitigate the possibility of data loss
• Monitor storage space, storage capacity, and system performance
• Identify, analyze and repair data problems as needed

Technical Skills And Experience

• Must have at least 1 year experience in basic-level administration of both data infrastructure and data
• Must have at least 1 year coding experience in Java, Python, R or other equivalent programming language
• Knowledge of SQL, Relation DB, NoSQL DB, Hadoop
• General data-specific concepts, frameworks and processes
• Working within an SDLC

Other Skills And Experience

• Cloud experience, such as AWS, GCP or Azure
• Excellent oral and written communication
• Multi-tasking and managing multiple priorities
• Working well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience