Kafka Administrator

  • Contract
  • Atlanta, GA
  • Applications have closed

MaxJobsClub Contractor

Job Description:

  • At least 5+ years of Hands-on development experience and a deep understanding of the Kafka architecture and internals of how it works, along with the interplay of architectural components: brokers, Zookeeper, Producers/Consumers, Kafka Connect, Kafka Streams
  • Experience with Kafka Streams / KSQL architecture and associated clustering model
  • Strong fundamentals and experience in Kafka administration, configuration, and troubleshooting
  • Understand and experience with Kafka clustering, and its fault-tolerance model supporting HA and DR

Practical experience with how to scale Kafka, KStreams, and Connector infrastructures, with the motivation to build efficient platforms

  • Experience with developing KSQL queries and best practices of using KSQL vs streams
  • Strong knowledge of the Kafka Connect framework, with experience using several connector types: HTTP REST proxy, JMS, File, SFTP, JDBC, Splunk, Salesforce
  • Have developed KStreams pipelines, as well as deployed KStreams clusters
  • Knowledge of connectors available from Confluent and the community
  • The familiarity of the Schema Registry and its management
  • Best practices to optimize the Kafka ecosystem based on use-case and workload, e.g. how to effectively use topic, partitions, and consumer groups to provide optimal routing and support of UDF and UDAF
  • Scripting proficiency with Java/Scala/node.js and best practices in development
  • Experience with monitoring Kafka infrastructure along with related components (Connectors, KStreams, and other producers/consumer apps)
  • Familiarity with Confluent Control Center