Instill AI changelog

New and Improved Smart Hint

changelog cover

We've improved the Smart Hint feature to offer contextual advice and suggestions throughout your pipeline.

Here's how it functions:

  • Firstly, Smart Hint informs users about the type of content an input field can accept, indicated through placeholder text, making it clear whether references are allowed.

  • Upon interacting with the input field, Smart Hint reveals the specific type of data it supports, such as String, Number, Object, etc.

  • Moreover, when a user enters ${ into an input field, Smart Hint intelligently filters and presents only the relevant hints that are compatible with the field.

This structured guidance method simplifies the process of building your pipeline, enhancing productivity and ease of use.

jq JSON Processor Integration

Take control of your JSON data with seamless jq filter integration within the JSON Operator. Apply custom jq filters directly to your data streams, enabling advanced manipulation and extraction with precision.

To get started, head to the JSON Operator and select TASK_JQ.

Video Input Support

Unlock limitless possibilities with the addition of video input support. Seamlessly ingest and process video content within your workflows, enabling dynamic data analysis, transformation, and the use of models that support video content.


  • Improved performance and stability ensure a seamless user experience.

  • Enhanced user interface with refined visual cues and streamlined navigation for increased productivity

Thank you for your Contributions 🙌

We highly value your feedback, so feel free to initiate a conversation on GitHub Discussions or join us in the #general channel on Discord.

Huge thanks to rsmelo92 for their contribution!

Instill Python SDK: Pipeline Creation made Easier

changelog cover

We are thrilled to announce a significant upgrade to our Python SDK, aimed at streamlining and enhancing the pipeline creation and resource configuration process for connectors and operators.

One of the key challenges users faced in previous versions was the difficulty in understanding the required configurations for connectors and operators. With the implementation of JSON schema validation, type hints, and helper classes that define all the necessary fields, users no longer need to refer to extensive documentation to configure resources. This ensures a more straightforward and error-free setup.

This update marks a significant step forward in improving user experience and reducing friction in the configuration process. We believe that these enhancements will empower users to make end-to-end use of the Python SDK; resource configuration, pipeline creation, debugging/editing/updating, and deployment from within their tech stack.

You can find a complete pipeline setup example with Python SDK on our GitHub repo.

Your feedback is crucial to us, so please don't hesitate to share your thoughts and experiences with the improved configuration workflow. We're committed to continually enhancing our platform to meet your needs and provide you with the best possible user experience.

To set up and get started with the SDKs, head over to their respective GitHub Repos:

New Pipeline Component Reference Schema: ${}

changelog cover

We're excited to introduce an enhanced Component Reference Schema that will make pipeline building even more straightforward. With this update, referencing a component field is as simple as using ${}. When establishing connections between components, there's no need to distinguish between {} or {{}} anymore. Just type ${ in any form field within a component, and our Smart Hint feature will promptly suggest available connections.

Rest assured, you won't need to manually update your existing pipelines due to this change from our previous reference schemas {} and {{}}. We've seamlessly migrated all pipelines to this new format.

Explore Our OpenAPI Documentation

We have just launched our OpenAPI Documentation, which contains all the essential information required for smooth integration with our APIs. Please visit our OpenAPI Documentation to access comprehensive details. You can even insert your Instill Cloud API token in the Authorization Header to experiment with the APIs on our platform.


User-friendly Error Messages

We understand the importance of clear communication, especially when errors occur. That's why we've revamped our error messages to be more user-friendly and informative. You'll now see which component in the pipeline the error is related to, allowing you to quickly identify and address issues, and speeding up the debugging process.

Instill Cloud Console URL Migration

We have successfully migrated the Instill Cloud console URL from to Please make sure to update your bookmarks accordingly.

Thank you for your Contributions 🙌

We highly value your feedback, so feel free to initiate a conversation on GitHub Discussions or join us in the #general channel on Discord.

Huge thanks to @chenhunghan and @HariBhandari07 for their contributions!

Introducing Zephyr-7b, Stable Diffusion XL, ControlNet Canny on Instill Model 🔮

changelog cover

Open-source models empower you and your businesses to leverage them within your own infrastructure, granting you complete control over your data and ensuring the privacy of sensitive information within your network. This approach mitigates the risk of data breaches and unauthorized access, affording you the flexibility of not being bound to a single hosting vendor.

With Instill Model, you gain access to a wide range of cutting-edge open-source models. Now, you can seamlessly use Zephyr-7b, Stable Diffusion XL, and ControlNet Canny in an integrated environment for FREE.

Zephyr-7b is a fine-tuned version of Mistral-7b created by Hugging Face. It is trained on public datasets but also optimized with knowledge distillation techniques. It's lightweight and fast, although 'intent alignment' may suffer. Read more about it and distillation techniques here.

Stable Diffusion XL empowers you to craft detailed images with concise prompts and even generate text within those images!

ControlNet Canny allows you to control the outputs of Stable Diffusion models and hence manipulate images in innovative ways.

We are committed to expanding our offering of open-source models, so stay tuned for more!

Instill VDP, now on Beta! 🦾

changelog cover

In this Beta release, we are delighted to announce that the Instill VDP API has now achieved a state of stability and reliability. This marks a pivotal moment for Instill VDP, and we are committed to ensuring the continued robustness of our API.

We recognize the importance of a seamless transition for our users and pledge to avoid any disruptive or breaking changes. This commitment means that you can confidently build upon the current version of the Instill VDP API, knowing that your existing integrations and workflows will remain intact.

This achievement represents a major milestone in our journey to provide the best experience for our users. We understand the critical role that stability and consistency play in your development efforts, and we are excited to take this step forward together with you.

As we move forward, we will keep striving to enhance the features of Instill VDP, listening to your feedback, and working closely with our community to deliver even more value and innovation. Thank you for being part of this exciting journey with us.

Support JSON input

Our Start operator now supports JSON inputs. Leveraging JSON as an input format enables the handling of semi-structured data, providing a well-organized representation of information. This is especially valuable when working with a REST API connector as a payload or when utilizing the Pinecone connector to insert records that include metadata in the form of key-value pairs.

Use Redis as a chat history store

We've introduced a Redis connector to facilitate chat history functionality. Redis, a widely used in-memory data store, enables the efficient implementation of a chat history system. Messages from a given chat session, identified by a unique Session ID, can be stored consistently, complete with their associated roles like "system," "user," and "assistant." Moreover, you have the flexibility to configure the retrieval of the latest K messages and integrate them seamlessly with a Large Language Model (LLM), such as OpenAI's GPT models, allowing you to develop a chatbot with full control over your data.

Improve RAG capabilities

We now support metadata in the Pinecone connector to enhance the efficiency and precision of your vector searches. With the ability to associate metadata key-value pairs with your vectors, you can now access not only the most similar records after your data has been indexed but also retrieve the associated metadata. Additionally, you can define filter expressions during queries, enabling you to refine your vector searches based on metadata. This functionality proves invaluable when dealing with extensive datasets where precision and efficiency in retrieval are paramount.

Unlock Instill VDP's full potential with Instill Hub!

Welcome to Instill Hub, your go-to platform for all things Instill VDP! Here, you have the opportunity to explore and use pipelines that have been contributed by fellow members. These pipelines are designed to provide you with the most up-to-date and efficient AI capabilities. You can seamlessly trigger these pipelines for your projects, or if you're feeling creative, you can even clone them and customize them to suit your unique needs.

But that's not all – we strongly encourage you to share your pipelines with the Instill Hub community. By doing so, you'll be contributing to the growth and success of our platform, helping others in the community benefit from your expertise.

So, whether you're eager to explore, eager to contribute, or simply excited to learn from others, Instill Hub is here to foster a supportive and collaborative community around Instill VDP. Join Instill Cloud today and let's work together to make AI innovation accessible to everyone!