Struct MemoryOptimizedBatchProcessor

pub struct MemoryOptimizedBatchProcessor {
    memory_manager: Arc<GlobalMemoryManager>,
    batch_size: usize,
    memory_threshold: usize,
}

内存优化的批处理器

Fields

memory_manager: Arc<GlobalMemoryManager>

batch_size: usize

memory_threshold: usize

Implementations

impl MemoryOptimizedBatchProcessor

pub fn new( memory_manager: Arc<GlobalMemoryManager>, batch_size: usize, memory_threshold: usize, ) -> Self

创建新的批处理器

pub fn process_texts<'a>( &self, texts: &'a [String], ) -> Vec<MemoryOptimizedTextItem<'a>>

处理文本批次，自动管理内存

fn estimate_memory_usage(&self, items: &[MemoryOptimizedTextItem<'_>]) -> usize

估算当前内存使用