Multi-source OSINT data collection and parallel processing tool. Indexes 4chan, Discord and IRC, reorganizes the data into a common format, annotates language, sentiment and tokens in multiple threads, and outputs the results to Elasticsearch.

Mark Veidemanis 49b0b9db46 Implement deduplicating channels		2022-08-16 22:01:35 +01:00
api	Detect queries if nick and channel are the same	2022-08-15 19:24:42 +01:00
commands	Implement deduplicating channels	2022-08-16 22:01:35 +01:00
conf/templates	Implement initial WHO loop delay	2022-08-14 20:58:41 +01:00
core	Implement deduplicating channels	2022-08-16 22:01:35 +01:00
docker	Switch to siphash	2022-08-18 07:20:30 +01:00
modules	Implement deduplicating channels	2022-08-16 22:01:35 +01:00
tests	Implement configurable chanlimit and add more fields about LIST output to Redis	2022-08-13 20:37:21 +01:00
utils	Switch to siphash	2022-08-18 07:20:30 +01:00
.env.example	Create separate production configuration	2022-07-29 08:01:48 +01:00
.gitignore	Fix Redis config path	2022-07-29 22:22:22 +01:00
.pre-commit-config.yaml	Reformat again	2022-07-21 13:40:09 +01:00
docker-compose.yml	Fix Redis config path	2022-07-29 22:22:22 +01:00
main.py	Reformat code	2022-07-29 17:28:19 +01:00
requirements.txt	Switch to siphash	2022-08-18 07:20:30 +01:00
runtest.sh	Improve channel allocation and write basic tests for it	2022-08-12 22:27:49 +01:00
threshold	Implement migrating networks	2022-08-12 23:32:00 +01:00