First of all, thanks for considering my question. Hope this is not too stupid.
I'm just wondering if there is a way to filter data on a Kinesis stream at the time it receives a data record from the stream . AWS white paper says section key is used to
"allows the consumer to process a particular shard that should be designed with the assumption that records with the same partition key will be sent only to that user"
There is no way to specify (either using the REST API or using KCL ) which key section is of interest to me in writing data directly .
A data record with the same partition key will be hashed with the same fragments, but how could we know which fragment it is, just knowing the partition key?
The final question: How can I create a user who receives only the data of a particular key of the partition ? / How can I create a user who receives only the data that is of interest to him.
Thank you very much for your time, considering my question and sharing your thoughts!
source share