This website requires JavaScript.
Explore
Help
Sign In
Pathogen
/
monolith
Watch
2
Star
0
Fork
You've already forked monolith
0
Code
Issues
Pull Requests
Projects
Releases
Wiki
Activity
Multi-source OSINT data collection and parallel processing tool. Indexes 4chan, Discord and IRC, reorganizes the data into a common format, annotates language, sentiment and tokens in multiple threads, and outputs the results to Elasticsearch.
468
Commits
1
Branch
1
Tag
8
MiB
Python
99.1%
Dockerfile
0.4%
Makefile
0.3%
Shell
0.2%
64ebcedd76
Go to file
HTTPS
Download ZIP
Download TAR.GZ
Download BUNDLE
Clone in VS Code
Cite this repository
APA
BibTeX
Cancel
Mark Veidemanis
64ebcedd76
Remove debugging code and fix regex substitution
2022-09-21 12:48:54 +01:00
docker
Change prod container names
2022-09-21 12:08:29 +01:00
legacy
Remove debugging code and fix regex substitution
2022-09-21 12:48:54 +01:00
processing
Remove debugging code and fix regex substitution
2022-09-21 12:48:54 +01:00
schemas
Implement threshold writing to Redis and manticore ingesting from Redis
2022-09-07 07:20:30 +01:00
sources
Remove commented code for debugging
2022-09-21 10:02:05 +01:00
.gitignore
Add config directories to gitignore
2022-09-08 09:45:18 +01:00
.pre-commit-config.yaml
Reinstate Redis cache
2022-09-04 21:38:53 +01:00
db.py
Remove commented code for debugging
2022-09-21 10:02:05 +01:00
docker-compose.yml
Remove debugging code and fix regex substitution
2022-09-21 12:48:54 +01:00
env.example
Document new PROCESS_THREADS setting in example file
2022-09-20 22:43:04 +01:00
environment
Remove debugging code and fix regex substitution
2022-09-21 12:48:54 +01:00
event_log.txt
Implement sentiment/NLP annotation and optimise processing
2022-09-16 17:09:49 +01:00
monolith.py
Remove commented code for debugging
2022-09-21 10:02:05 +01:00
requirements.txt
Implement sentiment/NLP annotation and optimise processing
2022-09-16 17:09:49 +01:00
util.py
Implement sentiment/NLP annotation and optimise processing
2022-09-16 17:09:49 +01:00