Data Streaming Engineer

Overview

On Site
USD160,000 - USD180,000
Full Time
Contract - W2

Skills

Senior
Distributed
Systems
Engineer

Job Details

Title: Data Streaming Engineer
Location: Scottsdale, AZ

We are seeking a Data Streaming Engineer specializing in Distributed Systems to design and build software for distributed systems management. This role involves developing internal automation scripts, system software for component interaction and management, and infrastructure for data streaming and publish/subscribe architectures. You will play a pivotal part in defining our client s technological future.


Your role:


  • Manage and enhance scripts for RSIM, the company s optimization engine.
  • Lead the selection, deployment, and ongoing support of a new data streaming platform.
  • Contribute to and maintain stream-based data pipelines.
  • Provide training and support to developers.


What you ve got:


  • Minimum of 3 years of hands-on experience in developing or managing distributed systems.
  • A bachelor s degree in computer science, engineering, or a related field is preferred.
  • Proven expertise with at least one of the following: Apache Kafka, Google Pub/Sub, Amazon Kinesis, or Azure Event Bus, with Kafka preferred.
  • Proficiency in Unix-based systems, particularly Ubuntu Linux.
  • Strong understanding of data marshalling and inter-process communication protocols.
  • Familiarity with cloud infrastructure management (preferably Google Cloud Platform) and agile development tools (git and Atlassian suite).
  • Scripting expertise in languages such as Bash, Python, or Perl, with a preference for Python.
  • Knowledge of information security practices.
  • Experience with integration and performance testing.


Preferred Skills:


  • Windows system administration experience.
  • Proficiency in programming languages like C, C#, or Python.
  • Database management and data science experience.
  • Advanced knowledge in information security.


To find more great tech-centric jobs, please visit ;/p>

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.