We're excited to introduce a new component type: Iterators. Iterators are designed to process each data element individually within an array or list. This functionality is crucial for efficiently handling data in batches within your pipeline.

Iterator ( [ 🌽 , 🐮 , 🐓 ] , cook) =>  [ 🍿 , 🥩 , 🍗 ]

Imagine you're summarizing a webpage with extensive content. With an iterator, you can process the substantial content of a webpage, breaking it down into manageable chunks segmented by tokens. This enables you to efficiently generate concise summaries for each section of the page.

Instill AI changelog

Introducing Iterators for Batch Processing in Your Pipeline