Overview
Remote
Accepts corp to corp applications
Contract - 12
Skills
Kafka Architect
Zookeeper
Kafka Confluent Control Center
Confluent Platform Metadata Service (MDS)
Job Details
Role: Kafka Architect
Location : Florida Remote
Duration : 1 Year
Location : Florida Remote
Duration : 1 Year
We are looking for an Architect with 12 + years of experience in Middleware, Data analytics background. He/she should have minimum 5 plus years' experience in architect and designing streaming (Not at Admin level) technology using Kafka, Zookeeper, Kafka Confluent Control Center, Confluent Platform Metadata Service (MDS). Expert in upgradation and migration of Kafka infrastructure from on-premises to AWS cloud. Hands on experience in Upgradation, Debugging the error and performance issue, capacity planning, road map definition, lead pro-active improvements etc.
Job description:
Seasoned messaging expert with established track record with Kafka technology, with hands-on production experience and a deep understanding of the Kafka architecture and internals of how it works, along with interplay of architectural components: brokers, Zookeeper, producers/consumers, Kafka Connect, Kafka Streams.
Knowledge of Building Kafka ecosystem by creating a framework for leveraging technologies such as Kafka Connect, KStreams/KSQL, Schema Registry, and other streaming-oriented technology.
Strong fundamentals in Kafka administration, configuration, and troubleshooting.
Mandatory experience implementing Kafka Multi Region Cluster (MRC) architecture.
Experience enabling observability on Kafka cluster through Datadog
Knowledge of Kafka clustering, and its fault-tolerance model supporting HA and DR
Practical experience with how to scale Kafka, Streams, and Connector infrastructures, with the motivation to build efficient platforms.
Best practices to optimize the Kafka ecosystem based on use-case and workload, e.g. how to effectively use topic, partitions, and consumer groups to provide optimal routing and support of QOS.
Experience with Kafka Streams / KSQL architecture and associated clustering mode.
Deep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architectures
Experience analysing production issues with authentication, consumer rebalancing, and latency variation, as well as any others that are encountered.
Experience with no-downtime Kafka infrastructure upgrades
Experience Benchmarking existing and potential infrastructure options to provide a scale-out plan.
Strong knowledge of the Kafka Connect framework, with experience using several connector types: HTTP REST proxy, JMS, File, SFTP, JDBC, Splunk, Salesforce, and how to support wire-format translations. Knowledge of connectors available from Confluent and the community
Hands-on experience in designing, writing, and operationalizing new Kafka Connectors using the framework.
Strong familiarity of wire formats such as XML, JSON, Avro, CSV, etc. along with serialization/deserialization options Knowledge of messaging protocols and associated APIs
Strong background in integration patterns.
Knowledge of Building Kafka ecosystem by creating a framework for leveraging technologies such as Kafka Connect, KStreams/KSQL, Schema Registry, and other streaming-oriented technology.
Strong fundamentals in Kafka administration, configuration, and troubleshooting.
Mandatory experience implementing Kafka Multi Region Cluster (MRC) architecture.
Experience enabling observability on Kafka cluster through Datadog
Knowledge of Kafka clustering, and its fault-tolerance model supporting HA and DR
Practical experience with how to scale Kafka, Streams, and Connector infrastructures, with the motivation to build efficient platforms.
Best practices to optimize the Kafka ecosystem based on use-case and workload, e.g. how to effectively use topic, partitions, and consumer groups to provide optimal routing and support of QOS.
Experience with Kafka Streams / KSQL architecture and associated clustering mode.
Deep understanding of different messaging paradigms (pub/sub, queuing), as well as delivery models, quality-of-service, and fault-tolerance architectures
Experience analysing production issues with authentication, consumer rebalancing, and latency variation, as well as any others that are encountered.
Experience with no-downtime Kafka infrastructure upgrades
Experience Benchmarking existing and potential infrastructure options to provide a scale-out plan.
Strong knowledge of the Kafka Connect framework, with experience using several connector types: HTTP REST proxy, JMS, File, SFTP, JDBC, Splunk, Salesforce, and how to support wire-format translations. Knowledge of connectors available from Confluent and the community
Hands-on experience in designing, writing, and operationalizing new Kafka Connectors using the framework.
Strong familiarity of wire formats such as XML, JSON, Avro, CSV, etc. along with serialization/deserialization options Knowledge of messaging protocols and associated APIs
Strong background in integration patterns.
GATE INSIGHT INC is a leader in the provision of Staffing and Consulting Services. We have the qualified talent across the IT industry to help deliver the best possible results for your business. We specialize in practicing the highest ethical and professional standards in operating a diversified staffing that is engaged in providing excellence and quality service to all.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.