Big Data Engineer III (60641)

AAA Northeast; Village of Garden City (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

AAA Northeast in New York is seeking a Big Data Engineer III to design, build, and maintain large-scale data processing systems. You will architect ETL processes, create advanced data models, and optimize data pipelines to deliver actionable insights for analysts and data scientists.

Collaborate with data teams, implement cloud-based data solutions using Snowflake, DBT, and Airflow, and mentor junior engineers while advancing our data architecture and performance.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering or a related field.
• 6-8 years of additional relevant experience required
• Master's Degree Computer science, Information Technology, Engineering, or a related field or 5+ YOE of direct experience. preferred

Responsibilities

• Data Engineering: Architect and optimize ETL processes for complex data requirements. Design advanced data models to support sophisticated data processing needs. Design and manage robust, scalable data pipelines.
• Database Management: Oversee the management and optimization of databases. Utilize advanced SQL techniques for complex data operations. Oversee the implementation and management of NoSQL databases. Architect and manage data warehousing solutions.
• Big Data and Cloud Technologies: Lead the implementation and optimization of big data technologies. Manage and optimize distributed computing resources for large-scale data processing. Build, maintain, and manage data pipelines using cloud technologies, Snowflake, Fivetran, DBT, Airflow. Utilize cloud platforms for scalable data processing and storage.
• DevOps and Security: Apply DevOps practices to automate and streamline data engineering workflows. Implement containerization solutions for data processing jobs. Implement data security measures to protect sensitive information. Optimize the performance of data processing and storage systems.
• Leadership: Mentor and guide junior engineers, fostering a collaborative and innovative work environment.

Skills

ETL

SQL

NoSQL

Data warehousing

Cloud

Snowflake

Airflow

DBT

Education

Bachelor's degree in CS/IT/Engineering

Master's degree or 5+ years experience

Tools

Snowflake

DBT

Airflow

Azure

Job description

Are you interested in joining a team that is continuously innovating to create the best experiences for members? Would you like to work for a company that has been rated a top employer and best place to work across the Northeast year over year? Do you want to be part of a company that is committed to giving back to the community?

At AAA Northeast, as we continue to grow, our mission remains the same: helping and serving is a way of life. It’s why we’ve earned the trust of millions, and why AAA Northeast has remained a resilient and reliable brand for over a century.

Big Data Engineer III is responsible for designing, developing, and maintaining large-scale data processing systems. This role includes building and optimizing data pipelines and ETL processes, designing and maintaining data models and architectures, and conducting performance tuning and optimization of data processing systems. Collaboration with data scientists and analysts is essential to deliver actionable insights.

What You Will Do

• Data Engineering: Architect and optimize ETL processes for complex data requirements. Design advanced data models to support sophisticated data processing needs. Design and manage robust, scalable data pipelines.
• Database Management: Oversee the management and optimization of databases. Utilize advanced SQL techniques for complex data operations. Oversee the implementation and management of NoSQL databases. Architect and manage data warehousing solutions.
• Big Data and Cloud Technologies: Lead the implementation and optimization of big data technologies. Manage and optimize distributed computing resources for large-scale data processing. Build, maintain, and manage data pipelines using cloud technologies, Snowflake, Fivetran, DBT, Airflow. Utilize cloud platforms for scalable data processing and storage.
• DevOps and Security: Apply DevOps practices to automate and streamline data engineering workflows. Implement containerization solutions for data processing jobs. Implement data security measures to protect sensitive information. Optimize the performance of data processing and storage systems.
• Leadership: Mentor and guide junior engineers, fostering a collaborative and innovative work environment.

Qualifications

Education

• Bachelor's Degree Computer science, Information Technology, Engineering, or a related field. required or
• 6-8 years of additional relevant experience required
• Master's Degree Computer science, Information Technology, Engineering, or a related field or 5+ YOE of direct experience. preferred

Experience

• 5+ years Experience in data engineering or a related field required

Licenses and Certifications

• While not required, there are a variety of certifications that prove skillset (Big data certs, Azure cloud certs, Snowflake certs)

AAA Northeast is proud of our diverse culture, fostered by the many talents, skills, passions, and expertise of our employees. We are an equal opportunity employer. We do not discriminate in recruiting, hiring, or promotion based on race, color, creed or religion, national origin, sex, age, sexual orientation, veteran’s status, gender identity or expression, disability, genetic information, marital status, pregnancy, or membership in any other protected class. We thrive when our team members bring their whole selves to work.