12 Commits

Author	SHA1	Message	Date
Mark Veidemanis	89328a827a	Raise open files limit for Redis	2022-09-07 07:20:30 +01:00
Mark Veidemanis	cdd12cd082	Implement threshold writing to Redis and manticore ingesting from Redis	2022-09-07 07:20:30 +01:00
Mark Veidemanis	2aedcf77a0	Add aioredis	2022-09-08 09:44:27 +01:00
Mark Veidemanis	a6b5348224	Config relative to Git dir	2022-09-05 07:20:30 +01:00
Mark Veidemanis	d0fe2baafe	Store persistent database elsewhere	2022-09-05 07:20:30 +01:00
Mark Veidemanis	e092327932	Improve DB performance with caching	2022-09-05 07:20:30 +01:00
Mark Veidemanis	ecb8079b5b	Change Python to 3.10	2022-09-05 07:20:30 +01:00
Mark Veidemanis	6811ce4af5	Update production env file path	2022-09-05 07:20:30 +01:00
Mark Veidemanis	318a8ddbd5	Split thread list into chunks to save memory	2022-09-05 07:20:30 +01:00
Mark Veidemanis	db46fea550	Run processing in thread	2022-09-04 21:29:00 +01:00
Mark Veidemanis	663a26778d	Begin implementing aiohttp	2022-09-04 13:47:32 +01:00
Mark Veidemanis	36de004ee5	Implement running Discord and 4chan gathering simultaneously	2022-09-02 22:30:45 +01:00