# Stream responses are 5s slow to get the first token

**URL:** <https://community.perplexity.ai/t/stream-responses-are-5s-slow-to-get-the-first-token/53>\
**Category:** Bug Reports\
**Created:** [May 15, 2025, 12:10am UTC](https://community.perplexity.ai/t/stream-responses-are-5s-slow-to-get-the-first-token/53 "2025-05-15T00:10:55Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![vikvang](https://avatars.discourse-cdn.com/v4/letter/v/67e7ee/32.png) [@vikvang](https://community.perplexity.ai/u/vikvang)\
**Post date:** [May 15, 2025, 12:10am UTC](https://community.perplexity.ai/t/stream-responses-are-5s-slow-to-get-the-first-token/53/1 "2025-05-15T00:10:55Z")

</div>

Hello, for my usecase I need very low latencies with llama-3.1-sonar-huge-128k-online but currently the model is very slow to respond in streaming requests. The 70b would already be enough with speedness but is it not comparable to the state of the art models like gpt4o

---

<div class="post-metadata">

**Author:** ![vikvang](https://avatars.discourse-cdn.com/v4/letter/v/67e7ee/32.png) [@vikvang](https://community.perplexity.ai/u/vikvang)\
**Post date:** [May 15, 2025, 12:10am UTC](https://community.perplexity.ai/t/stream-responses-are-5s-slow-to-get-the-first-token/53/2 "2025-05-15T00:10:58Z")

</div>

Hey, we know that sonar-huge is rather slow. I do recommend using sonar-large instead especially if latency is a priority for you; hopefully answer quality does not substantially degrade.  
You can expect sonar-huge to remain around the current speed for the foreseeable future.
