NXLog Agent batch processing

NXLog Agent implements an internal batch processing mechanism to process and move events along the defined routes efficiently. Batch settings can be specified globally or at the module level using the BatchSize and BatchFlushInterval directives. The module-level settings override the global settings.

Events are organized in batches by the input modules. Input modules accumulate events until they reach the batch size or flush interval. Once reaching either of these limits, the module writes the batch of events to a queue for processing by the following module(s) in the route. Output modules read the batched events from their log queues, process them, and write them to the output buffer in the same order they read them.

gv batch processing
Figure 1. NXLog Agent batch processing