Skip to content

Removing streaming related scaffolding for now since it doesn't do anything #166

@felixarntz

Description

@felixarntz

We don't support streaming yet. So as long as that's the case, there's no point of having interface methods that always throw an exception.

This also means we can later think about a cleaner interface structure once we actually implement streaming. For example, it might be a better solution to have a standalone interface for a model that can stream text - not every provider necessarily supports both regular text generation and text streaming.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions