Mark Veidemanis
|
93a0be98ce
|
Further decrease Druid memory requirements
|
2022-09-19 17:07:15 +01:00 |
Mark Veidemanis
|
14322f5090
|
Bump production Kafka healthcheck timeout
|
2022-09-19 11:18:52 +01:00 |
Mark Veidemanis
|
d94da5ac5c
|
Decrease production Druid max memory size
|
2022-09-19 10:51:34 +01:00 |
Mark Veidemanis
|
a1382ee46d
|
Increase Kafka retries
|
2022-09-19 10:48:29 +01:00 |
Mark Veidemanis
|
5e6b962ea8
|
Change Metabase port
|
2022-09-18 13:15:10 +01:00 |
Mark Veidemanis
|
e8dd847b36
|
Add docker environment file
|
2022-09-18 13:05:08 +01:00 |
Mark Veidemanis
|
d68bcfaebd
|
Update production compose
|
2022-09-18 13:04:08 +01:00 |
Mark Veidemanis
|
143f2a0bf0
|
Implement sentiment/NLP annotation and optimise processing
|
2022-09-16 17:09:49 +01:00 |
Mark Veidemanis
|
3c2adfc16e
|
Implement Apache Druid/Kafka and Metabase
|
2022-09-13 22:17:32 +01:00 |
Mark Veidemanis
|
baea6aebeb
|
Use stable after all
|
2022-09-08 07:20:30 +01:00 |
Mark Veidemanis
|
eaecc5cdbe
|
Switch production image back to dev
|
2022-09-08 07:20:30 +01:00 |
Mark Veidemanis
|
764e36ef14
|
Lower memory requirements to prevent crashes
|
2022-09-08 07:20:30 +01:00 |
Mark Veidemanis
|
21182629b4
|
Treat text fields as string and try beta Kibana image
|
2022-09-12 08:27:13 +01:00 |
Mark Veidemanis
|
dfd71b6c64
|
Add Mysql port to ports instead of expose
|
2022-09-10 13:20:06 +01:00 |
Mark Veidemanis
|
1b0817b047
|
Expose the Mysql port
|
2022-09-10 13:16:19 +01:00 |
Mark Veidemanis
|
0ba4929294
|
Use dev image of manticore
|
2022-09-10 12:03:45 +01:00 |
Mark Veidemanis
|
caded433b7
|
Remove indexer block to attempt to prevent Manticore DB crash
|
2022-09-08 07:20:30 +01:00 |
Mark Veidemanis
|
89328a827a
|
Raise open files limit for Redis
|
2022-09-07 07:20:30 +01:00 |
Mark Veidemanis
|
cdd12cd082
|
Implement threshold writing to Redis and manticore ingesting from Redis
|
2022-09-07 07:20:30 +01:00 |
Mark Veidemanis
|
2aedcf77a0
|
Add aioredis
|
2022-09-08 09:44:27 +01:00 |
Mark Veidemanis
|
a6b5348224
|
Config relative to Git dir
|
2022-09-05 07:20:30 +01:00 |
Mark Veidemanis
|
d0fe2baafe
|
Store persistent database elsewhere
|
2022-09-05 07:20:30 +01:00 |
Mark Veidemanis
|
e092327932
|
Improve DB performance with caching
|
2022-09-05 07:20:30 +01:00 |
Mark Veidemanis
|
ecb8079b5b
|
Change Python to 3.10
|
2022-09-05 07:20:30 +01:00 |
Mark Veidemanis
|
6811ce4af5
|
Update production env file path
|
2022-09-05 07:20:30 +01:00 |
Mark Veidemanis
|
318a8ddbd5
|
Split thread list into chunks to save memory
|
2022-09-05 07:20:30 +01:00 |
Mark Veidemanis
|
db46fea550
|
Run processing in thread
|
2022-09-04 21:29:00 +01:00 |
Mark Veidemanis
|
663a26778d
|
Begin implementing aiohttp
|
2022-09-04 13:47:32 +01:00 |
Mark Veidemanis
|
36de004ee5
|
Implement running Discord and 4chan gathering simultaneously
|
2022-09-02 22:30:45 +01:00 |