Multi-source OSINT data collection and parallel processing tool. Indexes 4chan, Discord and IRC, reorganizes the data into a common format, annotates language, sentiment and tokens in multiple threads, and outputs the results to Elasticsearch.
Mark Veidemanis
7a6e3338c0
* Low-key channel joining with incrementally increasing delay * Spin up needed instances to be able to cover a certain channel space * Fix provisioning functions to prevent race conditions with lots of relays being created at once * Tweakable switchover from covering all channels to only covering channels with more users than the mean of the cumulative user count |
||
|---|---|---|
| commands | ||
| conf | ||
| core | ||
| modules | ||
| utils | ||
| .gitignore | ||
| main.py | ||
| threshold | ||