node.js - Can Amazon's Kinesis Client Library consume multiple streams? -


i have quick question. kcl able consume multiple streams? should ever set multiple streams application, or individual stream supposed tied individual application? particular use case need consume data being produced backend , frontend. 1 of these produces data @ greater rates other, , reason think should produce separate streams processing. there way consume both streams same kcl process or need set two? help!

kcl open source project can modify consume events multiple streams, not recommended. better keep things simpler.

if have 2 different event streams, better have 2 different kinesis streams, 1 each. allows scale each stream independently each has different rate , possibly different peaks.

if need share information between streams, can use share state variables between them, using db such dynamodb or redis.

please note if have set of servers sending out these events, should expect of events of end, might processed before events front end. kcl (or lambda) code have process these events, can have different processing rates, different failure points , other out-of-synch events. take note of such potential dependencies , exceptions.


Comments

Popular posts from this blog

how to insert data php javascript mysql with multiple array session 2 -

multithreading - Exception in Application constructor -

windows - CertCreateCertificateContext returns CRYPT_E_ASN1_BADTAG / 8009310b -