 Mark Veidemanis
|
02ff44a6f5
|
Use only one Redis key for the queue to make chunk size more precise for thread allocation
|
2 years ago |
|
Mark Veidemanis
|
2dd2360b4f
|
Add config file to Turnilo
|
2 years ago |
|
Mark Veidemanis
|
395dfb1e7b
|
Decrease memory requirements further and switch Kafka image
|
2 years ago |
|
Mark Veidemanis
|
ee79762c73
|
Set Kafka max heap size
|
2 years ago |
|
Mark Veidemanis
|
e58b9960b2
|
Set max memory for Metabase
|
2 years ago |
|
Mark Veidemanis
|
4a60dec964
|
Remove debugging code and fix regex substitution
|
2 years ago |
|
Mark Veidemanis
|
9ee55a720b
|
Change dev container names
|
2 years ago |
|
Mark Veidemanis
|
40a0c2d22e
|
Make performance settings configurable
|
2 years ago |
|
Mark Veidemanis
|
cb11ce9b12
|
Fix merge conflict
|
2 years ago |
|
Mark Veidemanis
|
a89b5a8b6f
|
Implement sentiment/NLP annotation and optimise processing
|
2 years ago |
|
Mark Veidemanis
|
f432e9b29e
|
Properly process Redis buffered messages and ingest into Kafka
|
2 years ago |
|
Mark Veidemanis
|
47c5f89914
|
Implement Apache Druid/Kafka and Metabase
|
2 years ago |
|
Mark Veidemanis
|
68fd5fa230
|
Switch to latest image for dev docker-compose
|
2 years ago |
|
Mark Veidemanis
|
fd90c233c2
|
Begin implementing Apache Druid
|
2 years ago |
|
Mark Veidemanis
|
9cf4e945d1
|
Set dev image back to the default
|
2 years ago |
|
Mark Veidemanis
|
04b5dec843
|
Treat text fields as string and try beta Kibana image
|
2 years ago |
|
Mark Veidemanis
|
c2bdb3fd15
|
Reformat
|
2 years ago |
|
Mark Veidemanis
|
79b1bee9e4
|
Implement ingesting to Redis from Threshold
|
2 years ago |
|
Mark Veidemanis
|
cd5eb61455
|
Improve DB performance with caching
|
2 years ago |
|
Mark Veidemanis
|
60c43b4eb5
|
Run processing in thread
|
2 years ago |
|
Mark Veidemanis
|
db23b31f30
|
Implement aiohttp
|
2 years ago |
|
Mark Veidemanis
|
f7860bf08b
|
Begin implementing aiohttp
|
2 years ago |
|
Mark Veidemanis
|
734a2b7879
|
Implement running Discord and 4chan gathering simultaneously
|
2 years ago |