Big Data Engineer

Overview

On Site
Full Time

Skills

Design
Security management
Amazon Web Services
Amazon EC2
Electronic Health Record (EHR)
Software development
Python
Scala
SQL
Data
Big data
Amazon S3
HDFS
Apache Spark
Extract
transform
load
Data Science
Machine Learning (ML)
Finance

Job Details

Senior Data Engineer
Remote- must work standard EST hours
Long term contract/ contract to hire

Our client is seeking a Senior Data Engineer to accelerate data sharing between applications, engineers, and data scientists. The successful candidate will demonstrate mature programming and design ability. The Data Engineer role supports data delivery, serving, design, monitoring, and security management for data science, graph, and machine learning engineering teams.

Requirements
7+ years of relevant experience
Demonstrable AWS knowledge - EC2, ECS, Lambda, S3, EMR
Strong programming ability in Python or Scala
Experience with SQL and relational data
3+ years experience in one or more big data technology : S3, HDFS, Spark, Presto, etc. SPARK preferred
Experience designing and implementing ETL pipelines to support Data Science and/or Machine Learning.

Nice to have
Feature Store build experience and Dagster
Financial industry experience
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

About ConsultNet, LLC