Data Engineer

Onyx Premier Inc.; Albuquerque (NM); Presencial; USD 100.000 - 136.000; Jornada completa

Descripción de la vacante

Onyx Premier Inc. in Albuquerque, NM is seeking a Data Engineer to design, build, and maintain robust data pipelines to support analytics and machine learning initiatives.

You will collect, process, and store large data from diverse sources, ensure quality and integrity, and optimize workflows for performance and cost. Collaborate with data science and software teams to ensure scalable data infrastructure, and contribute to ETL, data warehousing, and modeling efforts.

Formación

• Bachelor's degree in Computer Science, Data Engineering, or a related field.
• 3-5 years of experience in data engineering or a similar role.
• Proficiency in Python, SQL, and at least one programming language such as Java or Scala.
• Experience with big data technologies like Hadoop, Spark, or Kafka.
• Familiarity with cloud platforms (AWS, Azure, GCP).

Responsabilidades

• Design and implement data pipelines and ETL processes to extract, transform, and load data from various sources.
• Develop and maintain data warehouses and databases using SQL and NoSQL technologies.
• Optimize data storage and processing to improve performance and reduce costs.
• Collaborate with data scientists and software engineers to integrate data pipelines with ML models.
• Monitor and troubleshoot data pipeline issues to ensure data quality and availability.
• Stay up-to-date with emerging data engineering technologies and best practices.

Conocimientos

Python

Java

Scala

SQL

Data pipelines

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Apache Airflow

Kafka

Spark

Hadoop

AWS / Azure / GCP

Descripción del empleo

Onyx Premier Inc. is currently seeking a skilled Data Engineer to join their team in Albuquerque, New Mexico, for a full-time position. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that are essential for supporting the company's analytics and machine learning initiatives. Your primary tasks will include collecting, processing, and storing large volumes of data from various sources, ensuring data quality and integrity throughout the pipeline. You will also be involved in optimizing data workflows to improve performance and efficiency, as well as troubleshooting and resolving any issues that may arise. Additionally, you will collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. The ideal candidate will have a strong background in data engineering, proficiency in relevant tools and technologies, and a passion for leveraging data to drive insights and decision-making.

The Data Engineer will collaborate with data science and software engineering teams to ensure data infrastructure is robust, scalable, and efficient. Tasks include data extraction, transformation, and loading, as well as pipeline optimization and troubleshooting.

You will work in a team environment at our Albuquerque office, collaborating with colleagues from various departments to achieve common goals. The role requires strong problem-solving skills, allowing you to tackle complex issues and find innovative solutions. Additionally, you will need the ability to work independently, managing your own tasks and projects efficiently. Simultaneously, you will also need to work as part of a team, contributing your unique skills and perspectives to group efforts. This dual approach ensures a balanced and productive work environment, fostering both individual growth and collective success.

The annual salary range for this position is between $100,000 and $136,242, providing a competitive compensation package. Employees can expect comprehensive health insurance coverage, including medical, dental, and vision plans, to support their well-being. Additionally, the company offers robust retirement plans, such as a 401(k) with matching contributions, to help employees save for their future. For professional growth, the role includes access to various training programs, workshops, and certifications, allowing individuals to enhance their skills and advance their careers within the organization.

Candidates should have a bachelor's degree in Computer Science, Data Engineering, or a related field. Experience with data pipeline tools such as Apache Airflow, Kafka, or Spark is required. Proficiency in SQL and Python is essential.

What You Will Do:

• Design and implement data pipelines and ETL processes to extract, transform, and load data from various sources.
• Develop and maintain data warehouses and databases using technologies like SQL, NoSQL, and big data platforms.
• Optimize data storage and processing to improve performance and reduce costs.
• Collaborate with data scientists and software engineers to integrate data pipelines with machine learning models.
• Monitor and troubleshoot data pipeline issues to ensure data quality and availability.
• Stay up-to-date with emerging technologies and best practices in data engineering.

What You Bring:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3-5 years of experience in data engineering or a similar role.
• Strong programming skills in Python, Java, or Scala.
• Experience with big data technologies like Hadoop, Spark, or Kafka.
• Familiarity with cloud platforms like AWS, Azure, or GCP.
• Knowledge of data modeling and database design principles.