
We're excited to introduce a new component type: Iterators. Iterators are designed to process each data element individually within an array or list. This functionality is crucial for efficiently handling data in batches within your pipeline.
Iterator ( [ ๐ฝ , ๐ฎ , ๐ ] , cook) => [ ๐ฟ , ๐ฅฉ , ๐ ]
Imagine you're summarizing a webpage with extensive content. With an iterator, you can process the substantial content of a webpage, breaking it down into manageable chunks segmented by tokens. This enables you to efficiently generate concise summaries for each section of the page.
๐ Try out the pipeline Website Summarizer with Iterator.