Generative AI for .NET – Part 5 Streaming

When we explored Chat Completions in Part 3 we used the asynchronous API to call our model, but it’s still somewhat a blocking call in that we wait for the model to generate a response before sending to the client. This is how we would traditiona…


This content originally appeared on Posts on LINQ to Fail and was authored by Posts on LINQ to Fail

When we explored Chat Completions in Part 3 we used the asynchronous API to call our model, but it’s still somewhat a blocking call in that we wait for the model to generate a response before sending to the client. This is how we would traditionally get data back to a client from a data source, since the data source we’re requesting from, like a database, will have all the data we need, it just has to “find it”.


This content originally appeared on Posts on LINQ to Fail and was authored by Posts on LINQ to Fail


Print Share Comment Cite Upload Translate Updates
APA

Posts on LINQ to Fail | Sciencx (2023-10-29T23:34:22+00:00) Generative AI for .NET – Part 5 Streaming. Retrieved from https://www.scien.cx/2023/10/29/generative-ai-for-net-part-5-streaming/

MLA
" » Generative AI for .NET – Part 5 Streaming." Posts on LINQ to Fail | Sciencx - Sunday October 29, 2023, https://www.scien.cx/2023/10/29/generative-ai-for-net-part-5-streaming/
HARVARD
Posts on LINQ to Fail | Sciencx Sunday October 29, 2023 » Generative AI for .NET – Part 5 Streaming., viewed ,<https://www.scien.cx/2023/10/29/generative-ai-for-net-part-5-streaming/>
VANCOUVER
Posts on LINQ to Fail | Sciencx - » Generative AI for .NET – Part 5 Streaming. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2023/10/29/generative-ai-for-net-part-5-streaming/
CHICAGO
" » Generative AI for .NET – Part 5 Streaming." Posts on LINQ to Fail | Sciencx - Accessed . https://www.scien.cx/2023/10/29/generative-ai-for-net-part-5-streaming/
IEEE
" » Generative AI for .NET – Part 5 Streaming." Posts on LINQ to Fail | Sciencx [Online]. Available: https://www.scien.cx/2023/10/29/generative-ai-for-net-part-5-streaming/. [Accessed: ]
rf:citation
» Generative AI for .NET – Part 5 Streaming | Posts on LINQ to Fail | Sciencx | https://www.scien.cx/2023/10/29/generative-ai-for-net-part-5-streaming/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.