Pathogen
/
monolith
2
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
531 Commits 1 Branch 1 Tag 8 MiB
Commit Graph

531 Commits

Author SHA1 Message Date
Mark Veidemanis 02071758b5
Send messages to Neptune Redis via PubSub 2023-01-12 07:20:43 +00:00
Mark Veidemanis 0ab67becff
Give option for only crawling some boards 2022-12-22 07:20:26 +00:00
Mark Veidemanis ebaf8c765d
Allow disabling modules in environment variables 2022-12-22 07:20:26 +00:00
Mark Veidemanis ce2d7684bc
Run ingest task first 2022-12-22 10:11:48 +00:00
Mark Veidemanis 508b00e471
Pre-create meta index 2022-11-23 19:02:31 +00:00
Mark Veidemanis 9d1e4b44e8
Add pathogen network 2022-11-23 18:23:20 +00:00
Mark Veidemanis 371bce1094
Remove print statements 2022-11-22 21:43:56 +00:00
Mark Veidemanis be0cf231b4
Fix mapping and make Threshold talk to SSDB 2022-11-22 21:42:35 +00:00
Mark Veidemanis 1993c8f1d2
Use Portainer Git directory for Redis config 2022-11-22 21:19:13 +00:00
Mark Veidemanis 9d35930b3b
Re-add Portainer Git dir 2022-11-22 21:15:19 +00:00
Mark Veidemanis 34346006ab
Remove leftover Docker files in legacy 2022-11-22 21:11:46 +00:00
Mark Veidemanis 42a3f5da03
Remove tarred Docker definition 2022-11-22 07:20:52 +00:00
Mark Veidemanis 42657aeee0
Lower Python version due to gensim incompatibility 2022-11-22 21:07:34 +00:00
Mark Veidemanis 1c34aa4a01
Clean up legacy and debugging code 2022-11-22 07:20:27 +00:00
Mark Veidemanis 6f3db61532
Add debugging statements for Portainer 2022-11-22 20:37:58 +00:00
Mark Veidemanis 3c18858c48
Use relative path for code 2022-11-22 20:35:13 +00:00
Mark Veidemanis 78c6ef96d2
Use relative path for build directory 2022-11-22 20:30:41 +00:00
Mark Veidemanis d2a174c1c4
Remove Portainer Git volume 2022-11-22 20:28:44 +00:00
Mark Veidemanis c53438d07b
Remove port variable 2022-11-22 20:17:51 +00:00
Mark Veidemanis 93353f34e7
Update env example file 2022-11-22 20:17:40 +00:00
Mark Veidemanis 6b1604b724
Remove old compose file 2022-11-22 20:17:28 +00:00
Mark Veidemanis 49f46c33ba
Fully implement Elasticsearch indexing 2022-11-22 20:15:02 +00:00
Mark Veidemanis 052631c71f
Remove infrastructure Docker definition 2022-11-22 18:41:29 +00:00
Mark Veidemanis 7edc231ea9
Remove Manticore and Superset stuff 2022-11-22 18:37:49 +00:00
Mark Veidemanis 44d6d90325
Update Druid spec 2022-11-21 18:59:53 +00:00
Mark Veidemanis 1c2ff41b56
Add ripsecrets to pre-commit hook 2022-11-03 07:20:30 +00:00
Mark Veidemanis 51a9b2af79
Improve memory usage and fix 4chan crawler 2022-10-21 07:20:30 +01:00
Mark Veidemanis 2d7b6268dd
Don't shadow previous iterator variable 2022-10-21 07:20:30 +01:00
Mark Veidemanis e5b5268f5c
Add example Druid spec 2022-10-21 07:20:30 +01:00
Mark Veidemanis dc1ed1fe10
Print the length of the flattened list in debug message 2022-10-21 07:20:30 +01:00
Mark Veidemanis eaf9a3c937
Remove unused ssdb_data volume 2022-10-21 07:20:30 +01:00
Mark Veidemanis 054a7a3ccf
Don't mount the template directory 2022-10-21 07:20:30 +01:00
Mark Veidemanis f774f4c2d2
Add some environment variables to control debug output 2022-10-21 07:20:30 +01:00
Mark Veidemanis e32b330ef4
Switch to SSDB for message queueing 2022-10-21 11:53:29 +01:00
Mark Veidemanis 8c596ec516
Update gitignore 2022-10-21 11:53:28 +01:00
Mark Veidemanis ab5e85c5c6 Begin switching away from Redis 2022-10-21 11:14:51 +01:00
Mark Veidemanis 7482064aee Clean up docker environment 2022-10-19 16:45:18 +01:00
Mark Veidemanis dccbc6b158 Remove dependencies on infra stuff 2022-10-11 11:16:24 +01:00
Mark Veidemanis 8cc1a48a25 Separate out infra in production 2022-10-11 11:04:03 +01:00
Mark Veidemanis 83e8fb0e38 Remove event log file 2022-10-05 12:52:30 +01:00
Mark Veidemanis 64cf7d0d4a Set Superset directory relative to Portainer Git root 2022-10-04 21:43:16 +01:00
Mark Veidemanis ae12e37e9b Set Superset path properly 2022-10-04 21:41:22 +01:00
Mark Veidemanis 5bb9bd3998 Use local storage in production 2022-10-04 21:33:08 +01:00
Mark Veidemanis d96dc573c5 Update production compose 2022-10-04 21:32:14 +01:00
Mark Veidemanis aea1c7faf6 Use one image for all the Druid services 2022-10-04 21:30:17 +01:00
Mark Veidemanis 2d6b3bb090 Set Superset volume relative to docker folder 2022-10-04 20:54:38 +01:00
Mark Veidemanis 83ffd6517c Switch quickstart setting to nano 2022-10-04 20:37:02 +01:00
Mark Veidemanis 8465e8fb77 Set Superset env file relative to docker directory 2022-10-04 20:30:14 +01:00
Mark Veidemanis d7d9958e54 Add persistent Redis data store and copy over Druid config to production 2022-10-04 20:26:58 +01:00
Mark Veidemanis 464c831686 Add Apache Superset and fix Druid resource usage 2022-10-04 20:17:04 +01:00