Interface StreamingModel

All Superinterfaces:

Model

All Known Implementing Classes:

OpenAIModel

public interface StreamingModel
extends Model

This interface is used for when a backend supports streaming responses, otherwise use Model

Method Summary

Modifier and Type	Method	Description
CompletableFuture<Message>	qurryModel(ChatObject obj, List<Tool> tools, Consumer<org.json.JSONObject> chunkConsumer)
CompletableFuture<Message>	singleFire(Message msg, Consumer<org.json.JSONObject> chunkConsumer)
CompletableFuture<Message>	singleFire(Message msg, List<Tool> tools, Consumer<org.json.JSONObject> chunkConsumer)

Methods inherited from interface Model

getToolSerializer, qurryModel, singleFire, singleFire

Method Details

qurryModel

CompletableFuture<Message> qurryModel(ChatObject obj,
 List<Tool> tools,
 Consumer<org.json.JSONObject> chunkConsumer)

singleFire

CompletableFuture<Message> singleFire(Message msg,
 Consumer<org.json.JSONObject> chunkConsumer)

singleFire

CompletableFuture<Message> singleFire(Message msg,
 List<Tool> tools,
 Consumer<org.json.JSONObject> chunkConsumer)