I tried to test today the Cerebras model with some streaming:
MVP
using PromptingTools: CerebrasOpenAISchema, aigenerate
aigenerate(CerebrasOpenAISchema(), "Tell me a joke."; model="gpt-oss-120b") # works
using StreamCallbacks
cb = StreamCallback()
aigenerate(CerebrasOpenAISchema(), "Tell me a joke."; model="gpt-oss-120b", streamcallback=cb) # gets stuck
What could we do with this? for me the second one gets stuck.
I tried to test today the Cerebras model with some streaming:
MVP
What could we do with this? for me the second one gets stuck.