Implement indexing into Apache Druid #1

Closed
m wants to merge 263 commits from druid into master
Owner

Implement integration with Apache Druid.
Added Metabase.
Added Turnilo.
Buffered messages from Discord and 4chan into a Redis buffer.
Removed threads in 4chan handler.

Moved 4chan processing after the Redis ingestion process.
Parralelised processing to use maximum number of cores on the system.
Implemented live sentiment annotation.
Implemented language detection.
Implemented noun, adjective, verb and adverb extraction to replace tokens.

Implement integration with Apache Druid. Added Metabase. Added Turnilo. Buffered messages from Discord and 4chan into a Redis buffer. Removed threads in 4chan handler. Moved 4chan processing after the Redis ingestion process. Parralelised processing to use maximum number of cores on the system. Implemented live sentiment annotation. Implemented language detection. Implemented noun, adjective, verb and adverb extraction to replace tokens.
m added 5 commits 2022-09-16 16:43:29 +00:00
m requested review from Owners 2022-09-16 16:43:46 +00:00
Author
Owner

Merged

Merged
m closed this pull request 2022-09-16 16:45:40 +00:00
m deleted branch druid 2022-11-03 17:16:33 +00:00

Pull request closed

Sign in to join this conversation.
No reviewers
Pathogen/Owners
No Label
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Pathogen/monolith#1
No description provided.