List and add files to OpenAI vector store

This example pipeline demonstrates how to list files from OpenAI and add those files to the OpenAI vector store.


OpenAI List Files & OpenAI Add Vector Store File Snaps Example Pipeline

Download this pipeline.
  1. Configure the OpenAI List Files Snap to retrieve a list of all the files associated with your OpenAI account based on the file purpose assistants.

    On validation, the Snap displays the retrieved files list along with their details.

    OpenAI List Files Snap Configuration OpenAI List Files Snap Output

    OpenAI List Files Snap Configuration
    OpenAI List Files Snap Output
  2. Configure the OpenAI Add Vector Store File Snap with $id in File ID field to add all the files from the retrieved list provided by the upstream Snap to the specified vector store vs_zZUjhOmXoHt0NDKrUu0YA3WI: Test docs. You can also configure the chunking strategy to optimize how the file is divided into segments for efficient indexing.
    On validation, the Snap displays the details of all the files added to the vector store, converting it into a collection of vectors.
    Tip: To add specific files we recommend you to use this Snap individually.
    OpenAI Add Vector Store File Snap Configuration OpenAI Add Vector Store File Snap Output

    OpenAI Add Vector Store File Snap Configuration
    OpenAI Add Vector Store File Snap Output
    Note: After adding the vector store file, you can use GenAI App Builder for various machine learning tasks, such as searching for similar vectors, retrieving relevant information, or integrating it into applications that leverage vector embeddings.
To successfully reuse pipelines:
  1. Download and import the pipeline into SnapLogic Platform.
  2. Configure Snap accounts, as applicable.
  3. Provide pipeline parameters, as applicable.