78 Commits (master)

Author SHA1 Message Date
Mark Veidemanis 02071758b5
Send messages to Neptune Redis via PubSub 1 year ago
Mark Veidemanis 9d1e4b44e8
Add pathogen network 1 year ago
Mark Veidemanis 1993c8f1d2
Use Portainer Git directory for Redis config 1 year ago
Mark Veidemanis 9d35930b3b
Re-add Portainer Git dir 1 year ago
Mark Veidemanis 42a3f5da03
Remove tarred Docker definition 1 year ago
Mark Veidemanis 42657aeee0
Lower Python version due to gensim incompatibility 1 year ago
Mark Veidemanis 1c34aa4a01
Clean up legacy and debugging code 1 year ago
Mark Veidemanis 6f3db61532
Add debugging statements for Portainer 1 year ago
Mark Veidemanis 3c18858c48
Use relative path for code 1 year ago
Mark Veidemanis 78c6ef96d2
Use relative path for build directory 1 year ago
Mark Veidemanis d2a174c1c4
Remove Portainer Git volume 1 year ago
Mark Veidemanis 49f46c33ba
Fully implement Elasticsearch indexing 1 year ago
Mark Veidemanis 052631c71f
Remove infrastructure Docker definition 1 year ago
Mark Veidemanis 7edc231ea9
Remove Manticore and Superset stuff 1 year ago
Mark Veidemanis 51a9b2af79
Improve memory usage and fix 4chan crawler 2 years ago
Mark Veidemanis eaf9a3c937
Remove unused ssdb_data volume 2 years ago
Mark Veidemanis 054a7a3ccf
Don't mount the template directory 2 years ago
Mark Veidemanis e32b330ef4
Switch to SSDB for message queueing 2 years ago
Mark Veidemanis ab5e85c5c6 Begin switching away from Redis 2 years ago
Mark Veidemanis 7482064aee Clean up docker environment 2 years ago
Mark Veidemanis dccbc6b158 Remove dependencies on infra stuff 2 years ago
Mark Veidemanis 8cc1a48a25 Separate out infra in production 2 years ago
Mark Veidemanis 64cf7d0d4a Set Superset directory relative to Portainer Git root 2 years ago
Mark Veidemanis ae12e37e9b Set Superset path properly 2 years ago
Mark Veidemanis 5bb9bd3998 Use local storage in production 2 years ago
Mark Veidemanis d96dc573c5 Update production compose 2 years ago
Mark Veidemanis aea1c7faf6 Use one image for all the Druid services 2 years ago
Mark Veidemanis 2d6b3bb090 Set Superset volume relative to docker folder 2 years ago
Mark Veidemanis 83ffd6517c Switch quickstart setting to nano 2 years ago
Mark Veidemanis 8465e8fb77 Set Superset env file relative to docker directory 2 years ago
Mark Veidemanis d7d9958e54 Add persistent Redis data store and copy over Druid config to production 2 years ago
Mark Veidemanis 464c831686 Add Apache Superset and fix Druid resource usage 2 years ago
Mark Veidemanis 5ad6cd0354 Add postgres config to Metabase 2 years ago
Mark Veidemanis 06e80a9759 Time stuff and switch to gensim for tokenisation 2 years ago
Mark Veidemanis 02ff44a6f5 Use only one Redis key for the queue to make chunk size more precise for thread allocation 2 years ago
Mark Veidemanis a5d29606e9 Remove ujson 2 years ago
Mark Veidemanis a2f88e29e6 Implement uvloop 2 years ago
Mark Veidemanis e9ae499ce8 Fix indexer options 2 years ago
Mark Veidemanis b6f8dabccd Fix Java variable in indexer parameters 2 years ago
Mark Veidemanis 395dfb1e7b Decrease memory requirements further and switch Kafka image 2 years ago
Mark Veidemanis ee79762c73 Set Kafka max heap size 2 years ago
Mark Veidemanis e58b9960b2 Set max memory for Metabase 2 years ago
Mark Veidemanis 799286ca76 Change prod container names 2 years ago
Mark Veidemanis 0e62a5b4b8 Remove prod compose comment 2 years ago
Mark Veidemanis 740f93208b Make production volumes point to external storage 2 years ago
Mark Veidemanis 9f4d4784af Set memory size to 2.5GB 2 years ago
Mark Veidemanis 72c22ed91e Update DirectMemorySize to be 1.5GB 2 years ago
Mark Veidemanis ce62a84cec Make MaxDirectMemory 0.5*cores 2 years ago
Mark Veidemanis 41b5ca6afd Make max memory size 512m 2 years ago
Mark Veidemanis 7db3504251 Further decrease Druid memory requirements 2 years ago