intelmq.bots.collectors.http package

Submodules

intelmq.bots.collectors.http.collector_http module

HTTP collector bot

param http_url:
type http_url:string
param http_header:
 default: {}
type http_header:
 dictionary
param http_verify_cert:
 default: True
type http_verify_cert:
 boolean
param extract_files:
 value used to extract files from downloaded compressed file default: None all: True; some: string with file names separated by ,
param http_url_formatting:
 to turn on time formatting (and to specify delta to current time)
type http_url_formatting:
 bool|json
param http_username:
 
type http_username:
 string
param http_password:
 
type http_password:
 string
param http_proxy:
 
type http_proxy:
 string
param https_proxy:
 
type https_proxy:
 string
param http_timeout_sec:
 tuple of two floats or float
param http_timeout_max_tries:
 an integer depicting how often a connection attempt is retried
type http_timeout_max_tries:
 int
param verify_pgp_signatures:
 whether to download and check file signatures default: False
type verify_pgp_signatures:
 bool
param signature_url:
 
type signature_url:
 string
param signature_url_formatting:
 the same as http_url_formatting
param gpg_keyring:
 none (defaults to user’s GPG keyring) or string (path to keyring file)
intelmq.bots.collectors.http.collector_http.BOT

alias of intelmq.bots.collectors.http.collector_http.HTTPCollectorBot

class intelmq.bots.collectors.http.collector_http.HTTPCollectorBot(bot_id: str, start: bool = False, sighup_event=None, disable_multithreading: bool = None)

Bases: intelmq.lib.bot.CollectorBot, intelmq.lib.mixins.http.HttpMixin

Fetch reports from an URL

extract_files = False
format_url(url: str, formatting) → str
gpg_keyring = None
http_password = None
http_url = '<insert url of feed>'
http_url_formatting = False
http_username = None
init()
process()
rate_limit = 3600
signature_url = None
signature_url_formatting = False
ssl_client_certificate = None
verify_pgp_signatures = False
verify_signature(data: bytes)

Download signature file and verify the report data.

class intelmq.bots.collectors.http.collector_http.Time(delta=None)

Bases: object

__init__(delta=None)

Delta is a datetime.timedelta JSON string, ex: ‘{“days”=-1}’.

intelmq.bots.collectors.http.collector_http_stream module

HTTP collector bot

param http_url:string
param http_header:
 dictionary default: {}
param http_verify_cert:
 boolean default: True
param http_username, http_password:
 string
param http_proxy, https_proxy:
 string
param strip_lines:
 boolean
param http_timeout_sec:
 tuple of two floats or float
intelmq.bots.collectors.http.collector_http_stream.BOT

alias of intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot

class intelmq.bots.collectors.http.collector_http_stream.HTTPStreamCollectorBot(bot_id: str, start: bool = False, sighup_event=None, disable_multithreading: bool = None)

Bases: intelmq.lib.bot.CollectorBot, intelmq.lib.mixins.http.HttpMixin

Open a streaming connection to the URL and process data per line

http_password = None
http_url = '<insert url of feed>'
http_username = None
init()
process()
rate_limit = 3600
ssl_client_certificate = None
strip_lines = True

Module contents