Commit Graph

Select branches

Hide Pull Requests

master

#1

prod

Mono Color

• 5ea4e5f460
  
  Bump versions in pre-commit config master Mark Veidemanis 2023-02-09 07:20:13 +0000
• 210237b50a
  
  Update pre-commit versions Mark Veidemanis 2023-02-09 07:20:13 +0000
• 87b81ac236
  
  Retry Redis ingest if it failed Mark Veidemanis 2023-01-13 07:20:27 +0000
• 02071758b5
  
  Send messages to Neptune Redis via PubSub Mark Veidemanis 2023-01-12 07:20:43 +0000
• 0ab67becff
  
  Give option for only crawling some boards Mark Veidemanis 2022-12-22 07:20:26 +0000
• ebaf8c765d
  
  Allow disabling modules in environment variables Mark Veidemanis 2022-12-22 07:20:26 +0000
• ce2d7684bc
  
  Run ingest task first Mark Veidemanis 2022-12-22 10:11:48 +0000
• 508b00e471
  
  Pre-create meta index Mark Veidemanis 2022-11-23 19:02:31 +0000
• 9d1e4b44e8
  
  Add pathogen network Mark Veidemanis 2022-11-23 18:23:20 +0000
• 371bce1094
  
  Remove print statements Mark Veidemanis 2022-11-22 21:43:56 +0000
• be0cf231b4
  
  Fix mapping and make Threshold talk to SSDB Mark Veidemanis 2022-11-22 21:42:35 +0000
• 1993c8f1d2
  
  Use Portainer Git directory for Redis config Mark Veidemanis 2022-11-22 21:19:13 +0000
• 9d35930b3b
  
  Re-add Portainer Git dir Mark Veidemanis 2022-11-22 21:15:19 +0000
• 34346006ab
  
  Remove leftover Docker files in legacy Mark Veidemanis 2022-11-22 21:11:46 +0000
• 42a3f5da03
  
  Remove tarred Docker definition Mark Veidemanis 2022-11-22 07:20:52 +0000
• 42657aeee0
  
  Lower Python version due to gensim incompatibility Mark Veidemanis 2022-11-22 21:07:34 +0000
• 1c34aa4a01
  
  Clean up legacy and debugging code Mark Veidemanis 2022-11-22 07:20:27 +0000
• 6f3db61532
  
  Add debugging statements for Portainer Mark Veidemanis 2022-11-22 20:37:58 +0000
• 3c18858c48
  
  Use relative path for code Mark Veidemanis 2022-11-22 20:35:13 +0000
• 78c6ef96d2
  
  Use relative path for build directory Mark Veidemanis 2022-11-22 20:30:35 +0000
• d2a174c1c4
  
  Remove Portainer Git volume Mark Veidemanis 2022-11-22 20:28:44 +0000
• c53438d07b
  
  Remove port variable Mark Veidemanis 2022-11-22 20:17:51 +0000
• 93353f34e7
  
  Update env example file Mark Veidemanis 2022-11-22 20:17:40 +0000
• 6b1604b724
  
  Remove old compose file Mark Veidemanis 2022-11-22 20:17:28 +0000
• 49f46c33ba
  
  Fully implement Elasticsearch indexing Mark Veidemanis 2022-11-22 20:15:02 +0000
• 052631c71f
  
  Remove infrastructure Docker definition Mark Veidemanis 2022-11-22 18:41:29 +0000
• 7edc231ea9
  
  Remove Manticore and Superset stuff Mark Veidemanis 2022-11-22 18:37:49 +0000
• 44d6d90325
  
  Update Druid spec Mark Veidemanis 2022-11-21 07:20:13 +0000
• 1c2ff41b56
  
  Add ripsecrets to pre-commit hook Mark Veidemanis 2022-11-03 07:20:30 +0000
• 51a9b2af79
  
  Improve memory usage and fix 4chan crawler Mark Veidemanis 2022-10-21 07:20:30 +0100
• 2d7b6268dd
  
  Don't shadow previous iterator variable Mark Veidemanis 2022-10-21 07:20:30 +0100
• e5b5268f5c
  
  Add example Druid spec Mark Veidemanis 2022-10-21 07:20:30 +0100
• dc1ed1fe10
  
  Print the length of the flattened list in debug message Mark Veidemanis 2022-10-21 07:20:30 +0100
• eaf9a3c937
  
  Remove unused ssdb_data volume Mark Veidemanis 2022-10-21 07:20:30 +0100
• 054a7a3ccf
  
  Don't mount the template directory Mark Veidemanis 2022-10-21 07:20:30 +0100
• f774f4c2d2
  
  Add some environment variables to control debug output Mark Veidemanis 2022-10-21 07:20:30 +0100
• e32b330ef4
  
  Switch to SSDB for message queueing Mark Veidemanis 2022-10-21 07:20:30 +0100
• 8c596ec516
  
  Update gitignore Mark Veidemanis 2022-10-21 07:20:30 +0100
• ab5e85c5c6 Begin switching away from Redis Mark Veidemanis 2022-10-21 11:14:51 +0100
• 7482064aee Clean up docker environment Mark Veidemanis 2022-10-19 16:45:18 +0100
• dccbc6b158 Remove dependencies on infra stuff Mark Veidemanis 2022-10-11 11:16:24 +0100
• 8cc1a48a25 Separate out infra in production Mark Veidemanis 2022-10-11 11:04:03 +0100
• 83e8fb0e38 Remove event log file Mark Veidemanis 2022-10-05 12:52:30 +0100
• 64cf7d0d4a Set Superset directory relative to Portainer Git root Mark Veidemanis 2022-10-04 21:43:16 +0100
• ae12e37e9b Set Superset path properly Mark Veidemanis 2022-10-04 21:41:22 +0100
• 5bb9bd3998 Use local storage in production Mark Veidemanis 2022-10-04 21:33:08 +0100
• d96dc573c5 Update production compose Mark Veidemanis 2022-10-04 21:32:14 +0100
• aea1c7faf6 Use one image for all the Druid services Mark Veidemanis 2022-10-04 21:30:17 +0100
• 2d6b3bb090 Set Superset volume relative to docker folder Mark Veidemanis 2022-10-04 20:54:38 +0100
• 808ed18b74
  
  Switch quickstart setting to nano prod Mark Veidemanis 2022-10-04 20:37:02 +0100
• 83ffd6517c Switch quickstart setting to nano Mark Veidemanis 2022-10-04 20:37:02 +0100
• 34e589aa9c
  
  Set Superset env file relative to docker directory Mark Veidemanis 2022-10-04 20:30:14 +0100
• 8465e8fb77 Set Superset env file relative to docker directory Mark Veidemanis 2022-10-04 20:30:14 +0100
• cc6340acab
  
  Add persistent Redis data store and copy over Druid config to production Mark Veidemanis 2022-10-04 20:26:58 +0100
• d7d9958e54 Add persistent Redis data store and copy over Druid config to production Mark Veidemanis 2022-10-04 20:26:58 +0100
• 7b73229d5a
  
  Add Apache Superset and fix Druid resource usage Mark Veidemanis 2022-10-04 20:17:04 +0100
• 464c831686 Add Apache Superset and fix Druid resource usage Mark Veidemanis 2022-10-04 20:17:04 +0100
• 35ba2cc947
  
  Add postgres config to Metabase Mark Veidemanis 2022-10-02 14:29:40 +0100
• 5ad6cd0354 Add postgres config to Metabase Mark Veidemanis 2022-10-02 14:29:40 +0100
• 817bfd8835
  
  Time stuff and switch to gensim for tokenisation Mark Veidemanis 2022-10-01 14:46:45 +0100
• 06e80a9759 Time stuff and switch to gensim for tokenisation Mark Veidemanis 2022-10-01 14:46:45 +0100
• 40cf0c6430
  
  Remove commented debug code Mark Veidemanis 2022-09-30 07:22:22 +0100
• 5c91f1af87 Remove commented debug code Mark Veidemanis 2022-09-30 07:22:22 +0100
• 63081f68b7
  
  Use only one Redis key for the queue to make chunk size more precise for thread allocation Mark Veidemanis 2022-09-30 07:22:22 +0100
• 5992498493
  
  Remove ujson Mark Veidemanis 2022-09-30 15:30:34 +0100
• 328db4a6da
  
  Reformat Mark Veidemanis 2022-09-30 15:23:00 +0100
• 02ff44a6f5 Use only one Redis key for the queue to make chunk size more precise for thread allocation Mark Veidemanis 2022-09-30 07:22:22 +0100
• a5d29606e9 Remove ujson Mark Veidemanis 2022-09-30 15:30:34 +0100
• 6b549dee6a Reformat Mark Veidemanis 2022-09-30 15:23:00 +0100
• c5c834da82
  
  Add config file to Turnilo Mark Veidemanis 2022-09-27 08:30:28 +0100
• 2dd2360b4f Add config file to Turnilo Mark Veidemanis 2022-09-27 08:30:28 +0100
• a8dbabd85e
  
  Implement uvloop Mark Veidemanis 2022-09-23 07:20:30 +0100
• 56b5c85fac
  
  Print Ingest settings on start Mark Veidemanis 2022-09-23 08:32:29 +0100
• a2f88e29e6 Implement uvloop Mark Veidemanis 2022-09-23 07:20:30 +0100
• f0df3e80fd Print Ingest settings on start Mark Veidemanis 2022-09-23 08:32:29 +0100
• fc7450c33a
  
  Make debug output cleaner Mark Veidemanis 2022-09-22 17:39:29 +0100
• 09fc63d0ad Make debug output cleaner Mark Veidemanis 2022-09-22 17:39:29 +0100
• 0e9a016e2a
  
  Fix indexer options Mark Veidemanis 2022-09-22 17:39:18 +0100
• e9ae499ce8 Fix indexer options Mark Veidemanis 2022-09-22 17:39:18 +0100
• 763501d1ee
  
  Fix Java variable in indexer parameters Mark Veidemanis 2022-09-22 08:41:59 +0100
• b6f8dabccd Fix Java variable in indexer parameters Mark Veidemanis 2022-09-22 08:41:59 +0100
• 40a215e6ec
  
  Decrease memory requirements further and switch Kafka image Mark Veidemanis 2022-09-21 21:11:13 +0100
• 395dfb1e7b Decrease memory requirements further and switch Kafka image Mark Veidemanis 2022-09-21 21:11:13 +0100
• 7abf9a00cb
  
  Set Kafka max heap size Mark Veidemanis 2022-09-21 20:26:05 +0100
• ee79762c73 Set Kafka max heap size Mark Veidemanis 2022-09-21 20:26:05 +0100
• bd3f1ecd53
  
  Set max memory for Metabase Mark Veidemanis 2022-09-21 14:39:11 +0100
• e58b9960b2 Set max memory for Metabase Mark Veidemanis 2022-09-21 14:39:11 +0100
• 64ebcedd76
  
  Remove debugging code and fix regex substitution Mark Veidemanis 2022-09-21 12:48:54 +0100
• 4a60dec964 Remove debugging code and fix regex substitution Mark Veidemanis 2022-09-21 12:48:54 +0100
• 3d293daad3
  
  Change dev container names Mark Veidemanis 2022-09-21 12:09:18 +0100
• 9ee55a720b Change dev container names Mark Veidemanis 2022-09-21 12:09:18 +0100
• 00890860c0
  
  Change prod container names Mark Veidemanis 2022-09-21 12:08:29 +0100
• 799286ca76 Change prod container names Mark Veidemanis 2022-09-21 12:08:29 +0100
• b0efaeef90
  
  Remove prod compose comment Mark Veidemanis 2022-09-21 12:04:54 +0100
• 0e62a5b4b8 Remove prod compose comment Mark Veidemanis 2022-09-21 12:04:54 +0100
• d6d19625f3
  
  Remove commented code for debugging Mark Veidemanis 2022-09-21 10:02:05 +0100
• 5ebae02bf2 Remove commented code for debugging Mark Veidemanis 2022-09-21 10:02:05 +0100
• cf4aa45663
  
  Normalise fields in processing and remove invalid characters Mark Veidemanis 2022-09-21 10:01:12 +0100
• ced3a251b2 Normalise fields in processing and remove invalid characters Mark Veidemanis 2022-09-21 10:01:12 +0100
• 48e4c07959
  
  Make production volumes point to external storage Mark Veidemanis 2022-09-21 10:00:48 +0100