Implement indexing into Apache Druid #1

Closed
m wants to merge 263 commits from druid into master
m commented 2 years ago
Owner

Implement integration with Apache Druid.
Added Metabase.
Added Turnilo.
Buffered messages from Discord and 4chan into a Redis buffer.
Removed threads in 4chan handler.

Moved 4chan processing after the Redis ingestion process.
Parralelised processing to use maximum number of cores on the system.
Implemented live sentiment annotation.
Implemented language detection.
Implemented noun, adjective, verb and adverb extraction to replace tokens.

Implement integration with Apache Druid. Added Metabase. Added Turnilo. Buffered messages from Discord and 4chan into a Redis buffer. Removed threads in 4chan handler. Moved 4chan processing after the Redis ingestion process. Parralelised processing to use maximum number of cores on the system. Implemented live sentiment annotation. Implemented language detection. Implemented noun, adjective, verb and adverb extraction to replace tokens.
m added 5 commits 2 years ago
m requested review from Owners 2 years ago
m commented 2 years ago
Poster
Owner

Merged

Merged
m closed this pull request 2 years ago
m deleted branch druid 2 years ago

Reviewers

Pathogen/Owners was requested for review 2 years ago
This pull request cannot be reopened because the branch was deleted.
Sign in to join this conversation.
No reviewers
Pathogen/Owners
No Label
No Milestone
No project
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: Pathogen/monolith#1
Loading…
There is no content yet.