Data Engineer II

Coda Search│Staffing; Miami (FL); On-site; USD 95,000 - 140,000; Full time

Job summary

Coda Search│Staffing is seeking a Data Engineer to analyze large business data, build scalable data pipelines, and drive insights across Jira, Portal, and Salesforce. You will partner with product managers, software engineers, and BI engineers to automate analytics and deliver actionable metrics at scale.

You will own large datasets, implement pipelines, and help shape BI infrastructure while improving reporting processes and data security practices.

Qualifications

• Bachelor's degree in CS, IT or related field.
• 3-5 years of data engineering experience delivering data solutions.
• Proficient in SQL with complex queries and optimization.
• Experience with NoSQL databases (MongoDB, Cassandra, DynamoDB).
• Strong programming in Python, Java or Scala with Spark/Hadoop.
• Experience with AWS, Azure or GCP and data services like Redshift, Synapse or BigQuery.
• Knowledge of Hadoop, Spark, Kafka, HBase for distributed processing.
• Familiarity with Airflow for scheduling data workflows.
• Experience with data versioning/testing tools (DVC, dbt).
• Understanding of data security practices (encryption, access controls).

Responsibilities

• Design, implement and support an analytical data infrastructure.
• Build and maintain scalable data pipelines and ETL processes.
• Optimize data storage, retrieval, and cost efficiency.
• Manage AWS resources including EC2, S3, Glue, Lambda, IAM, and CloudWatch.
• Interface with teams to load data from varied sources using SQL and AWS tech.
• Collaborate with Data Scientists and BI Engineers on reporting best practices.
• Develop advanced SQL and Python solutions; write complex queries.
• Ensure reporting platforms and internal tools meet user needs.
• Contribute to BI tool development, data warehousing, and analytics platforms.

Skills

SQL

Python/Java/Scala

Data Modeling

ETL/BI pipelines

CI/CD

Performance tuning

Advanced analytics concepts

Data governance

Cloud data concepts

Collaborative skills

Education

Bachelor's degree in Computer Science, Information Technology, or related field

Tools

Snowflake

Hadoop

Spark

Kafka

HBase

DynamoDB

MongoDB

Cassandra

Airflow

AWS data services (S3, Glue, Redshift)

Job description

As a Data Engineer, you are responsible for analyzing large amounts of business data, solving real world problems, and developing metrics and business cases that will enable Business Insights. This is done by leveraging data from various platforms such as Jira, Portal, Salesforce. You will work with a team of Product Managers, Software Engineers and Business Intelligence Engineers to automate and scale the analysis, and to make the data more actionable to manage business at scale. You will own many large datasets, implement new data pipelines that feed into or from critical data systems.A career with purpose.

Your Responsibilities on the Team

• Design, implement and support an analytical data infrastructure and working knowledge of Modern Data Warehouse concepts.
• Design, build, and maintain efficient and scalable data pipelines and ETL processes to process large volumes of structured and unstructured data.
• Optimize data storage and retrieval methods to ensure performance, scalability, and cost-efficiency.
• Manage AWS resources including EC2, S3, Glue, Lambda, API’s, IAM, Cloud Watch etc.
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies
• Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
• Collaborate with Data Scientists and Business Intelligence Engineers (BIEs) to recognize and help adopt best practices in reporting and analysis
• Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
• Maintain internal reporting platforms/tools including troubleshooting and development. Interact with internal users to establish and clarify requirements in order to develop report specifications.
• Work with Engineering partners to help shape and implement the development of BI infrastructure including Data Warehousing, reporting and analytics platforms.
• Contribute to the development of the BI tools, skills, culture and impact.
• Write advanced SQL queries and Python code to develop solutions.
• Working Knowledge of Snowflake.
• Collaborate across teams to align AI initiatives with organizational goals and understanding of AI concepts
• Knowledge on continuous integration/continuous delivery (CI/CD) pipelines and working on deployments when necessary.

Requirements

Bachelor's degree in Computer Science, Information Technology, or a related field.

3-5 years of experience in data engineering or a related role, with demonstrated success in delivering data solutions.

Proficient in SQL, with the ability to write complex queries, perform query optimization, and conduct performance tuning.

Experience with NoSQL databases, such as MongoDB, Cassandra, or DynamoDB, and an understanding of their appropriate use cases.

Strong programming skills in Python, Java, or Scala, with experience in data processing frameworks (e.g., Apache Spark, Hadoop).

Experience with cloud platforms (AWS, Azure, GCP) and data services, such as AWS Redshift, Azure Synapse, or Google BigQuery.

Knowledge of big data technologies, including Hadoop, Spark, Kafka, and HBase, with experience in distributed data processing.

Familiarity with data orchestration tools, such as Apache Airflow for scheduling and managing data workflows.

Experience with data versioning and testing tools, such as DVC (Data Version Control) and dbt (data build tool).

Understanding of data security practices, including encryption, access controls, and data masking.