Multi-source OSINT data collection and parallel processing tool. Indexes 4chan, Discord and IRC, reorganizes the data into a common format, annotates language, sentiment and tokens in multiple threads, and outputs the results to Elasticsearch.
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
Mark Veidemanis a198f2a487 Reformat legacy project 2 years ago
docker Moved files to subdirectory 2 years ago
legacy Reformat legacy project 2 years ago
schemas Alter schemas and 4chan performance settings 2 years ago
sources Increase thread delay time 2 years ago
.gitignore Moved files to subdirectory 2 years ago
.pre-commit-config.yaml Moved files to subdirectory 2 years ago
db.py Remove some debugging code 2 years ago
docker-compose.yml Moved files to subdirectory 2 years ago
monolith.py Remove development dotenv loading 2 years ago
requirements.txt Moved files to subdirectory 2 years ago
util.py Run processing in thread 2 years ago