intelmq.bots.experts.deduplicator package¶
Submodules¶
intelmq.bots.experts.deduplicator.expert module¶
Deduplicator expert bot
param redis_cache_host: | |
---|---|
string | |
param redis_cache_port: | |
int | |
param redis_cache_db: | |
int | |
param redis_cache_ttl: | |
int | |
param redis_cache_password: | |
string. default: {None} | |
param filter_type: | |
string [“blacklist”, “whitelist”] | |
param bypass: | boolean default: False |
param filter_keys: | |
string with multiple keys separated by comma. Please note that time.observation key is never consider by the system because system will always ignore this key. |
-
intelmq.bots.experts.deduplicator.expert.
BOT
¶ alias of
intelmq.bots.experts.deduplicator.expert.DeduplicatorExpertBot
-
class
intelmq.bots.experts.deduplicator.expert.
DeduplicatorExpertBot
(bot_id: str, start: bool = False, sighup_event=None, disable_multithreading: bool = None)¶ Bases:
intelmq.lib.bot.ExpertBot
,intelmq.lib.mixins.cache.CacheMixin
Detection and drop exact duplicate messages. Message hashes are cached in the Redis database
-
bypass
= False¶
-
filter_keys
= None¶
-
filter_type
= 'blacklist'¶
-
init
()¶
-
process
()¶
-
redis_cache_db
= 6¶
-
redis_cache_host
= '127.0.0.1'¶
-
redis_cache_password
= None¶
-
redis_cache_port
= 6379¶
-
redis_cache_ttl
= 86400¶
-