Senior Elasticsearch Database Admin

CatchProbe Intelligence Technologies; San Francisco (CA); Remote; USD 130,000 - 180,000; Full time

Job summary

A leading technology firm is seeking an Elastic Engineer to design and support a large-scale Elastic (ELK) system in a remote setting. The ideal candidate will leverage their expertise in Elasticsearch management, cloud environments, and strong communication skills to onboard various logging applications efficiently. Responsibilities include optimizing performance, performing technical troubleshooting, and mentoring team members in using Elastic technologies.

Qualifications

• 4+ years of experience with Elastic (ELK) platform.
• Experience in managing Elasticsearch configurations and performance tuning.
• Deep understanding of Linux and containerization.

Responsibilities

• Design and implement scalable Elastic (ELK) infrastructures.
• Support and maintain Enterprise Monitoring Tools.
• Optimize performance and troubleshoot complex Elastic (ELK) issues.

Skills

Debugging skills

Analytical skills

Problem solving

Communication

Scripting languages (Python, Shell)

Education

Bachelor's Degree in Computer Science

Tools

Python

Shell

Docker

Job description

Workplace Type : Remote -Region : San Francisco, CA

Job Requirements

• Requires experience in Developing Elastic (ELK) Dashboards, Report, Alerts, Visualizations and Optimize searches
• Effective verbal and written communication skills to consult with management, partners, and vendors
• Effective organizational skills and the ability to manage frequent interruptions and multiple priorities
• Design data models to store and scale with peta-bytes of data
• Productize novel AI models and define data flow in our pipeline
• Design configurable platform to deploy and run different AI models
• Design and build scalable microservices
• Implement and test recovery techniques
• Diagnose and troubleshoot Elasticsearch environment
• Fine-tune Elasticsearch environment or make tuning recommendations
• Writing and optimizing Elasticsearch queries
• Ability to relate well with coworkers and vendor representatives, providing guidance
• Performing Elastic (ELK) Admin/Production Support with the team and assist with duties as an architect
• Requires understanding of Elastic (ELK) to assist components to include but not limited to: Elastic (ELK) Search Processing Language (SPL), Enterprise Security (ES), HTTP Event Collector (HEC), Deployment Servers, Universal Forwarders (UF), Indexer, and Heavy Forwarders (HF)
• Looking for an Elastic Engineer. They are working to onboard about 80-100 applications and infrastructure logs into Elastic
• They will have a lot of face time with the business, so need solid communication skills
• They'll need an elastic background
• Will be engaging with app and infra teams, required to present to them the framework and help them onboard their logs into elastic. Will work with a tenured elastic engineer

Qualifications

• 4+ years of experience in setting up Elastic cluster, management, and monitoring on both Elastic cloud and on-premise environment.
• Proven experience in managing Elasticsearch database configurations
• Excellent understanding of relevant search-related concepts
• Experience in tuning the Elasticsearch search performance and query optimization on petabytes of data.
• Experience in tuning the Elasticsearch indexing performance to have an indexing rate of 100k documents per second or more.
• Experience in optimization of text search queries, relevance scoring, tokenizers, analyzers for searching
• Experience in cross cluster replication, index lifecycle management and hot-warm architectures
• Architect, design, install, support, and maintain Elastic (ELK) infrastructure for a highly available and disaster recovery configuration
• Assist with duties as an Administer Elastic (ELK) and Elastic (ELK) Application for Enterprise Monitoring and Tools (EMT)
• Performance tuning, index lifecycle and maintenance
• Standardize Elastic (ELK) agent deployment, configuration and maintenance across a variety of UNIX and Windows platforms
• Troubleshoot Elastic (ELK) server and agent problems and issues
• Assist internal users of Elastic (ELK) in designing and maintaining production-quality dashboards
• Mentor members of the technical staff to support and assist in Elastic (ELK)-related activities
• Mentor users and other groups on their use of Elastic (ELK)
• Monitor the agent and server infrastructure for capacity planning and optimization
• Design core systems performance and troubleshooting logs
• Support Elastic (ELK) on Unix and Linux platforms
• Solve complex Integration challenges and debug complex configuration issues
• Technical writing/creation of formal documentation such as architecture diagrams, technical designs, and SOPs
• Agile Methodology
• Knowledge of user interface frameworks, Java, Application servers
• Knowledge of full software development lifecycle
• Strong analytical and problem solving skills
• A positive goal orientated attitude with a focus on delivery
• Requires experience in building and maintaining large-scale 7.x Elastic (ELK) platforms
• Requires experience on-boarding new Elastic (ELK) logs
• Requires experience with administration, architecture, and engineering
• Requires Linux Administration experience
• Bachelor's Degree in Computer Science, Information Systems or other related field or equivalent work experience
• 4 to 7 plus years of direct work related experience Knowledge and Skills
• Demonstrates independent thinking and decision-making abilities
• Excellent written and verbal communication skills
• Excellent problem solving/problem resolution skills
• Ability to balance priorities in order to meet multiple requirements and deadlines while ensuring priority objectives receive proper emphasis.
• Able to think and react positively and professionally even in stressful situations.

Required Skills And Experience

• Deep understanding of Linux
• Skills in scripting languages, particularly Python and Shell
• Excellent debugging skills
• Experience with CI/CD pipelines for compiled software & a history of automating and optimizing workflows
• Fluency in SCM (e.g. Perforce, Git) and build systems (e.g. make, cmake, bazel)
• Experience working with containers (Docker)
• 5+ year's of experience in Infrastructure or related field