Data Engineer

BeaconFire Inc; East Windsor Township, Northern (NJ, KY); Hybrid; USD 110,000 - 150,000; Full time

Job summary

BeaconFire Inc. is seeking a skilled Data Engineer to design and optimize our data infrastructure from East Windsor, NJ. You will build and maintain data pipelines, assemble large datasets, and automate processes to enhance scalability and efficiency.

You will work with cross-functional teams to deliver data-driven insights, ensure data security across regions, and create analytics tools for the data science group. This role focuses on robust data engineering and strategic data delivery.

Qualifications

• Advanced SQL knowledge and experience with relational databases.
• Experience building and optimizing big data pipelines and datasets.
• Ability to perform root cause analysis on data and processes to answer business questions.
• Strong analytics with unstructured datasets.
• Build processes for data transformation and workload management.
• Experience extracting value from large, disconnected datasets.
• Knowledge of message queuing and stream processing at scale.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets to meet business requirements.
• Identify and implement internal process improvements (automation, scalability).
• Build infrastructure for ETL using SQL and AWS big data technologies.
• Develop analytics tools that enable insights on customer acquisition and operational metrics.
• Collaborate with stakeholders to support data infrastructure needs.
• Ensure data security across regions and multiple data centers.

Skills

Advanced SQL

Big data pipelines

Root cause analysis

Unstructured data analytics

Data transformation

Disparate datasets handling

Message queuing & stream processing

Cross-functional collaboration

Project management

Tools

AWS

SQL

Job description

We are looking for a skilled and enthusiastic Data Engineer to help design and optimize our data infrastructure.

JOB REQUIREMENTS:

• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.

BASIC QUALIFICATIONS:

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing 'big data' data pipelines, architectures and data sets.
• Experience performingroot cause analysison internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.

Location:East Windsor, NJ

We will provide work visa sponsorship for qualified candidates.

Security & Data Privacy Responsibilities:

All employees are responsible for protecting company, customer, employee, and other confidential information entrusted to the organization. This role is expected to:

• Follow company information security, data privacy, acceptable-use, and confidentiality policies.
• Access company systems and data only as necessary to perform assigned job responsibilities and in accordance with authorized access.
• Protect credentials, devices, confidential information, and personal data from unauthorized access, disclosure, alteration, or loss.
• Handle, store, transmit, and dispose of sensitive information according to company policies and approved systems and procedures.
• Promptly report suspected security incidents, privacy incidents, phishing attempts, unauthorized access, or loss or disclosure of sensitive information through established reporting channels.
• Complete required security and privacy awareness training and comply with applicable security controls and procedures.