Data Operations Engineer II

AccuWeather; Pennsylvania; On-site; USD 70,000 - 110,000; Full time

Job summary

An established industry player is seeking a detail-oriented Data Operations Engineer II to enhance data operations through scripting and automation. This role involves developing complex scripts, maintaining data infrastructures, and ensuring the efficiency of data processes. Candidates will collaborate with cross-functional teams while leveraging their expertise in scripting languages like Python and Bash. This is an excellent opportunity for those looking to grow within a dynamic team focused on innovative data management solutions. If you are passionate about automation and eager to make an impact, we encourage you to apply and be part of a forward-thinking organization.

Qualifications

• 3-5 years of experience in data operations, scripting, and automation.
• Proficient in Python and PowerShell for automation tasks.

Responsibilities

• Develop and optimize scripts for automating data collection and monitoring.
• Maintain data infrastructures and ensure reliability of data processes.

Skills

Scripting Languages (Python, Bash)

Automation Techniques

Analytical Skills

Communication Skills

Problem Solving

Education

Bachelor's degree in Computer Science

Tools

DataDog

Databricks

Git

AWS

Azure

GCP

Job description

POSITION SUMMARY
To support AccuWeather’s continued focus on innovation and generating superior weather products, we are seeking an experienced and detail-oriented individual to join our team as a Data Operations Engineer II with a specialization in scripting and deployment automation. This mid-level position is ideal for someone with a solid background in leveraging scripting languages and automation tools to optimize data processes. As a Data Operations Engineer II, you will play a crucial role in enhancing the efficiency and reliability of our data operations through advanced scripting and automation techniques.

KEY RESPONSIBILITIES

• Scripting and Automation: Develop, maintain, and optimize complex scripts using languages such as Python, Bash, or similar, to automate data collection and monitoring.
• Maintain Systems and Processes: Responsible for improving and maintaining data infrastructures and ensuring the reliability and efficiency of data processes. Troubleshoot and resolve issues within these systems to ensure continuous operation and data integrity.
• Monitoring and Troubleshooting: Build and manage end-to-end monitoring systems and automated alert mechanisms to ensure the health and performance of data pipelines. Implement tools and processes to proactively identify and address potential issues before they impact operations.
• Documentation: Create and maintain comprehensive documentation of scripts, automation and monitoring workflows, data pipelines, and deployment procedures for knowledge sharing and future reference.
• Collaboration: Collaborate closely with cross-functional teams, providing support for scripting needs and contributing to the development of an effective automation strategy.

QUALIFICATIONS:

• Educational Background: Bachelor's degree in Computer Science, Information Technology, or a related field.
• Experience:
  • Minimum of 3-5 years of professional experience in data operations, scripting, and automation.
• Technical Skills:
  • Advanced proficiency in scripting languages such as Python, PowerShell, or similar.
  • Proficiency in Object-Oriented Programming (OOP) languages such as C++, Java, or similar.
  • In-depth understanding of data processing concepts and data integration tools.
  • Experience managing relational databases such as SQL.
  • Experience working with cloud platforms (e.g., AWS, Azure, GCP).
• Analytical Skills: Exceptional analytical and problem-solving skills with meticulous attention to detail.
• Communication Skills: Excellent communication skills with the ability to collaborate effectively within a team environment.
• Adaptability: Ability to adapt to changing priorities and manage multiple tasks simultaneously.
• Initiative: Proactive mindset with a strong willingness to learn and explore new technologies.
• Problem Solving: Demonstrated ability to debug systems, tracing issues back to their source.
• Preferred Qualifications:
  • Experience with DataDog for monitoring and performance tracking.
  • Familiarity with Databricks for data engineering and analytics.
  • Experience of version control systems (e.g., Git).
  • Demonstrated experience related to scripting and automation in a data context.
  • Experience working with deployment automation (CI/CD) tools and processes.

WHY JOIN US:
This mid-level position offers a pathway for career growth within our Data Operations team. Successful candidates may have opportunities to advance to senior-level roles, gaining more responsibilities and specialization within the field of data engineering.
If you are enthusiastic about scripting, automation, and data operations, and are eager to contribute to a forward-thinking team, we invite you to apply for the Data Operations Engineer II position. Join us in shaping the future of data management through innovative scripting and automation solutions!