{"id":168,"date":"2020-02-19T18:39:15","date_gmt":"2020-02-19T10:39:15","guid":{"rendered":"https:\/\/www.zeroheart.xyz\/wordpress\/?p=168"},"modified":"2020-02-19T18:39:15","modified_gmt":"2020-02-19T10:39:15","slug":"kafka%e4%b8%80%e4%ba%9b%e5%9f%ba%e7%a1%80","status":"publish","type":"post","link":"https:\/\/www.zeroheart.xyz\/wordpress\/?p=168","title":{"rendered":"kafka\u4e00\u4e9b\u57fa\u7840"},"content":{"rendered":"\n

kafka\u91cc\u9762\u7684\u4e00\u4e9b\u6982\u5ff5<\/h4>\n\n\n\n

broker<\/strong> kafka\u96c6\u7fa4\u4e2d\u7684\u5b9e\u4f8b<\/p>\n\n\n\n

topic<\/strong> kafka\u4e2d\u4e00\u7c7b\u6d88\u606f\u7684\u96c6\u5408<\/p>\n\n\n\n

partition<\/strong> \u7269\u7406\u6982\u5ff5\uff0ctopic\u53ef\u4ee5\u5b58\u50a8\u5728\u4e00\u4e2a\u6216\u8005\u591a\u4e2apartition\u4e2d\uff0c\u6bcf\u4e00\u4e2apartition\u5305\u542b\u4e00\u4e2a\u6587\u4ef6\u5939\uff0c\u5176\u4e2d\u6709\u7d22\u5f15\u6587\u4ef6<\/strong>\u548c\u65e5\u5fd7\u6587\u4ef6<\/strong>\u3002<\/p>\n\n\n\n

producer<\/strong> \u4ea7\u751f\u6d88\u606f\u7684\u7a0b\u5e8f<\/p>\n\n\n\n

consumer<\/strong> \u6d88\u8d39\u8005\uff0c\u53ef\u4ee5\u8bbe\u7f6econsumer group\uff0c\u4e00\u4e2a\u6d88\u606f\u53ea\u80fd\u88ab\u4e00\u4e2agroup\u4e2d\u7684\u4e00\u4e2aconsumer\u6d88\u8d39\uff0c\u4f46\u662f\u53ef\u4ee5\u88ab\u4e0d\u540cgroup\u6d88\u8d39\u3002<\/p>\n\n\n\n

\u6d88\u606f\u7684\u751f\u4ea7\u548c\u6d88\u8d39<\/h4>\n\n\n\n

\u91c7\u7528pull\u6a21\u5f0f\uff0c\u6d88\u8d39\u8005\u81ea\u884c\u51b3\u5b9a\u6d88\u8d39\u7684\u901f\u5ea6\u3002\u6d88\u8d39\u8005\u53ef\u4ee5\u901a\u8fc7\u4fee\u6539offset\uff0c\u6765\u91cd\u590d\u6d88\u8d39\u6d88\u606f\u3002\u597d\u5904\u662f\u9632\u6b62\u6d88\u8d39\u8005\u6d88\u8d39\u80fd\u529b\u4e0d\u8db3\u9020\u6210\u7684\u963b\u585e\u3002<\/p>\n\n\n\n

partition\u7684\u4f7f\u7528\u4f7f\u5f97topic\u7684\u5b58\u50a8\u5f97\u5230\u6c34\u5e73\u6269\u5c55\uff0c\u540c\u4e00\u4e2atopic\u7684\u4e0d\u540c\u6d88\u606f\uff0c\u6309\u7167\u4e00\u5b9a\u7684\u89c4\u5f8b\uff0c\u5206\u914d\u5230\u4e0d\u540c\u7684partition\u4e2d\uff0c\u63d0\u9ad8\u4e86\u541e\u5410\u91cf\u3002\u6d88\u606f\u53ef\u4ee5\u643a\u5e26\u4e00\u4e2akey\uff0c\u8fd9\u4e2akey\u7ed3\u5408\u76f8\u5e94\u7684\u5206\u533a\u7b56\u7565\uff0c\u5c3d\u91cf\u4fdd\u8bc1\u6bd4\u8f83\u5206\u6563\u3002partition\u7684\u5220\u9664\u7b56\u7565\uff0c\u53ef\u4ee5\u662f\u65f6\u95f4\u591a\u4e45\u540e\u5220\u9664\uff0c\u4e5f\u53ef\u4ee5\u662f\u5927\u5c0f\u8fbe\u5230\u591a\u5c11\u540e\u5220\u9664\u3002partition\u7684\u7d22\u5f15\u6587\u4ef6\u662f\u7a00\u758f\u7684\u7d22\u5f15\uff0c\u51cf\u5c11\u78c1\u76d8\u5360\u7528\u3002<\/p>\n\n\n\n

Replication \u526f\u672c\u673a\u5236<\/h4>\n\n\n\n

\u526f\u672c\u5c31\u662f\u6d88\u606f\u5b58\u591a\u4efd\uff0c\u589e\u52a0follower\u3002\u4f5c\u4e3aleader\u7684\u673a\u5668\u4f1a\u7ef4\u62a4\u4e00\u4e2a\u540c\u6b65\u5217\u8868\uff0cin sync replication\uff0cisr\u3002\u5728\u4e00\u4e9b\u914d\u7f6e\u4e0b\u9762\uff0c\u53ea\u6709isr\u4e2d\u7684\u673a\u5668\u624d\u80fd\u6210\u4e3aleader\u3002<\/p>\n\n\n\n

producer\u6d88\u606f\u53d1\u51fa\u540e\u6709\u51e0\u79cd\u4e0d\u540c\u7684\u65b9\u5f0f\u786e\u8ba4\u6d88\u606f\u7684\u63d0\u4ea4\uff0cack=1\uff0cack=0\uff0cack=all\uff0c\u5176\u4e2dack=1\u65f6\u5019\uff0cleader\u786e\u8ba4\u4fdd\u5b58\u4e86\u6d88\u606f\u5c31\u53ef\u4ee5\u4e86\u3002ack=0\uff0c\u4e0d\u9700\u8981\u56de\u590d\uff0c\u53d1\u9001\u4e86\u5c31\u884c\u3002ack=all\uff0c\u8868\u793aisr\u4e2d\u6240\u6709\u7684\u8282\u70b9\u6709\u590d\u5236\u4e86\u6d88\u606f\u624d\u7b97\u53d1\u9001\u6210\u529f\u3002<\/p>\n\n\n\n

leader\u9009\u4e3e<\/h4>\n\n\n\n

\u5e38\u89c1\u7684\u5206\u5e03\u5f0f\u7cfb\u7edf\u4e2d\uff0c\u4e00\u822c\u662f2n+1\u53f0\u673a\u5668\uff0c\u6700\u591a\u5141\u8bb8n+1\u53f0\u6302\u6389\uff0c\u4f1a\u5728\u5176\u4f59\u7684\u673a\u5668\u4e2d\u9009\u51faleader\u3002kafka\u662f\u4eceisr\u4e2d\u9009\u4e3eleader\u7684\uff0c\u5b95\u673a\u53d1\u751f\u65f6\u5019\uff0c\u53ea\u8981\u6709\u4e00\u53f0\u673a\u5668\u5c31\u80fd\u4fdd\u8bc1\u6d88\u606f\u4e0d\u4e22\u5931\u3002<\/p>\n\n\n\n

\u5982\u679c\u673a\u5668\u90fd\u6302\u4e86\uff0c\u6709\u4e24\u79cd\u9009\u62e9\uff0c\u4e00\u79cd\u662f\u7b49\u7b2c\u4e00\u4e2aisr\u673a\u5668\u6062\u590d\uff0c\u4e00\u79cd\u662f\u7b49\u7b2c\u4e00\u53f0\u673a\u5668\u6062\u590d\uff0c\u90fd\u53ef\u4ee5\u770b\u9700\u6c42\u6765\u5b9a\uff0c\u6709\u7684\u662f\u53ef\u4ee5\u63a5\u53d7\u6d88\u606f\u4e22\u5931\u7684\uff0c\u6bd4\u5982\u4e0d\u662f\u5f88\u91cd\u8981\u7684\u901a\u77e5\u77ed\u4fe1\uff0c\u6709\u7684\u5c31\u662f\u8fd9\u4e48\u505a\u7684\uff0c\u4fdd\u8bc1\u9ad8\u53ef\u7528\u6027\uff0c\u727a\u7272\u4e00\u70b9\u4e00\u81f4\u6027\u3002<\/p>\n\n\n\n

\u5f85\u7eed\u3002\u3002\u3002<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

kafka\u91cc\u9762\u7684\u4e00\u4e9b\u6982\u5ff5 broker kafka\u96c6\u7fa4\u4e2d\u7684\u5b9e\u4f8b topic kafka\u4e2d\u4e00\u7c7b\u6d88\u606f\u7684\u96c6\u5408 par […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"_links":{"self":[{"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/168"}],"collection":[{"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=168"}],"version-history":[{"count":14,"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/168\/revisions"}],"predecessor-version":[{"id":183,"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=\/wp\/v2\/posts\/168\/revisions\/183"}],"wp:attachment":[{"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=168"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=168"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.zeroheart.xyz\/wordpress\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=168"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}