Skip to content

Input buffer for prompter plugin node#136

Open
b3by wants to merge 1 commit intomeetecho:mainfrom
b3by:feat/ollama_buffered_sync
Open

Input buffer for prompter plugin node#136
b3by wants to merge 1 commit intomeetecho:mainfrom
b3by:feat/ollama_buffered_sync

Conversation

@b3by
Copy link
Collaborator

@b3by b3by commented Mar 11, 2026

Description

This PR adds the implementation of next_batch for the prompter_ollama node, allowing it to buffer a configurable number of messages before invoking the update.

PR type

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update
  • Code refactoring
  • Performance improvement
  • Test update
  • Build/CI configuration change
  • Other (please describe):

Key modifications and changes

The prompter_ollama node now accepts a new argument, called every. This represents the number of messages that are buffered and then batched before sending them to the node update. The update will take all the received messages and concatenate the prompts.

Affected components

prompter_ollama plugin node.

@b3by b3by requested a review from GaijinKa March 11, 2026 13:22
@b3by b3by added type:enhancement New feature or request priority:medium labels Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant