8 Commits

Author	SHA1	Message	Date
Mark Veidemanis	9c9d49dcd2	Reformat and set the net and channel for 4chan	2022-09-05 07:20:30 +01:00
Mark Veidemanis	dcd648e1d2	Make crawler more efficient and implement configurable parameters	2022-09-05 07:20:30 +01:00
Mark Veidemanis	318a8ddbd5	Split thread list into chunks to save memory	2022-09-05 07:20:30 +01:00
Mark Veidemanis	20e22ae7ca	Reformat code	2022-09-04 21:40:04 +01:00
Mark Veidemanis	db46fea550	Run processing in thread	2022-09-04 21:29:00 +01:00
Mark Veidemanis	22cef33342	Implement aiohttp	2022-09-04 19:44:25 +01:00
Mark Veidemanis	663a26778d	Begin implementing aiohttp	2022-09-04 13:47:32 +01:00
Mark Veidemanis	36de004ee5	Implement running Discord and 4chan gathering simultaneously	2022-09-02 22:30:45 +01:00