A leading staffing firm in Tampa is seeking a Big Data Developer to design and develop efficient data pipelines. Responsibilities include ensuring system reliability, performance optimization, and data integration from various sources. The ideal candidate should have over 10 years of experience, strong proficiency in big data technologies like Hadoop and Spark, and excellent problem-solving skills. The role offers competitive medical benefits and a full-time employment structure.
Qualifications
10+ years experience for Big Data Developer.
12+ years experience for Big Data Lead.
Responsibilities
Design, develop, and maintain data pipelines.
Create architecture of the big data platform.
Integrate data from diverse sources ensuring quality.
Optimize data processing for system efficiency.
Skills
Data Pipeline Development
System Design and Architecture
Data Integration and Processing
Performance Optimization
Programming Languages
Big Data Technologies
Database Management
Data Analysis and Visualization
Problem-Solving and Analytical Skills
Communication and Collaboration
Tools
Hadoop
Spark
Kafka
Hive
Job description
Base pay range
$120.00/yr - $120.00/yr
Data Pipeline Development: Designing, developing, and maintaining data pipelines to efficiently move and transform large datasets from various sources.
System Design and Architecture: Creating the overall architecture of the big data platform and ensuring its scalability, performance, and reliability.
Data Integration and Processing: Integrating data from diverse sources, ensuring data quality, and implementing data processing workflows.
Performance Optimization: Monitoring system performance, identifying bottlenecks, and optimizing data processing for efficiency.
Programming Languages: Proficiency in languages like Java, Python, Scala.
Big Data Technologies: Experience with frameworks like Hadoop, Spark, Kafka, Hive, and other related tools.
Database Management: Knowledge of database design, data modeling, and various database technologies.
Data Analysis and Visualization: Understanding of data analysis techniques and data visualization tools.
Problem-Solving and Analytical Skills: Ability to analyze complex data problems and develop effective solutions.
Communication and Collaboration: Effective communication and teamwork skills.
Experience: 10+ years experience for Big data developer and 12+ years experience for Big data lead.