Commit Graph

28 Commits

Author SHA1 Message Date
89dfc9604c Set Superset directory relative to Portainer Git root 2022-10-04 21:43:16 +01:00
29e6a64ecd Use one image for all the Druid services 2022-10-04 21:30:17 +01:00
cc6340acab Add persistent Redis data store and copy over Druid config to production 2022-10-04 20:26:58 +01:00
7b73229d5a Add Apache Superset and fix Druid resource usage 2022-10-04 20:17:04 +01:00
35ba2cc947 Add postgres config to Metabase 2022-10-02 14:29:40 +01:00
63081f68b7 Use only one Redis key for the queue to make chunk size more precise for thread allocation 2022-09-30 07:22:22 +01:00
c5c834da82 Add config file to Turnilo 2022-09-27 08:30:28 +01:00
40a215e6ec Decrease memory requirements further and switch Kafka image 2022-09-21 21:11:13 +01:00
7abf9a00cb Set Kafka max heap size 2022-09-21 20:26:05 +01:00
bd3f1ecd53 Set max memory for Metabase 2022-09-21 14:39:11 +01:00
64ebcedd76 Remove debugging code and fix regex substitution 2022-09-21 12:48:54 +01:00
3d293daad3 Change dev container names 2022-09-21 12:09:18 +01:00
2c5133a546 Make performance settings configurable 2022-09-20 22:22:13 +01:00
dab5e81715 Fix merge conflict 2022-09-16 17:45:24 +01:00
143f2a0bf0 Implement sentiment/NLP annotation and optimise processing 2022-09-16 17:09:49 +01:00
4ea77ac543 Properly process Redis buffered messages and ingest into Kafka 2022-09-14 18:32:32 +01:00
3c2adfc16e Implement Apache Druid/Kafka and Metabase 2022-09-13 22:17:32 +01:00
4c6fe87b88 Switch to latest image for dev docker-compose 2022-09-13 09:20:43 +01:00
79a430be04 Begin implementing Apache Druid 2022-09-08 07:20:30 +01:00
50a873dbba Set dev image back to the default 2022-09-12 08:43:18 +01:00
21182629b4 Treat text fields as string and try beta Kibana image 2022-09-12 08:27:13 +01:00
bf802d7fdf Reformat 2022-09-07 07:20:30 +01:00
49784dfbe5 Implement ingesting to Redis from Threshold 2022-09-07 07:20:30 +01:00
e092327932 Improve DB performance with caching 2022-09-05 07:20:30 +01:00
db46fea550 Run processing in thread 2022-09-04 21:29:00 +01:00
22cef33342 Implement aiohttp 2022-09-04 19:44:25 +01:00
663a26778d Begin implementing aiohttp 2022-09-04 13:47:32 +01:00
36de004ee5 Implement running Discord and 4chan gathering simultaneously 2022-09-02 22:30:45 +01:00