Data Engineer

  • Tampa, FL
  • Posted 2 days ago | Updated 2 days ago

Overview

On Site
$100,000 - $120,000
Full Time

Skills

Apache HBase
Apache Hadoop
Apache Hive
Apache Kafka
Data Engineer
Scala
Spark
Big Data
Apache Spark
Cloudera
Cloudera Impala
Collaboration
Continuous Delivery
Continuous Integration
Data Integrity
Data Processing
HDFS
Version Control

Job Details

We're looking for a Data Engineer - Scala/Spark with deep expertise in big data processing and distributed systems to join our growing team! If you're passionate about building scalable data solutions and thrive in fast-paced environments, this could be the perfect opportunity.

Key Responsibilities:
Develop, test, and deploy data processing applications using Apache Spark and Scala.
Optimize and tune Spark applications for better performance on large-scale data sets.
Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
Design and implement high-performance data processing and analytics solutions.
Ensure data integrity, accuracy, and security across all processing tasks.
Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
Implement version control and CI/CD pipelines for Spark applications.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.