Mismatch search accuracy between App chat and API chat

:bug: Describe the Bug

The App chat interface is able to find the correct link but the Chat Completions and Search APIs are not able to.

:white_check_mark: Expected Behavior

We’re testing using the following prompt for both App chat and Chat Completions:

Find the recipe page for The Best Corn Casserole by Food Network. Return just one link if the page is found. If the page is not found, respond in 2 words or less.

And it should return the following link: https://www.foodnetwork.com/recipes/food-network-kitchen/corn-casserole-4587845

:cross_mark: Actual Behavior

App chat is able to return the correct link. But Chat Completions is not able to return it or even include it in the search_results field in the response. We have enable_search_classifier set to true, tried web_search_options.search_context_size set to high, and even set the search_domain_filter to foodnetwork.com but still to no avail. We also tried using all models available.

We also tried using Search API but it also couldn’t return the correct link.

:counterclockwise_arrows_button: Steps to Reproduce

  1. Call the API with the following request:
    1. {
        "model": "sonar",
        "temperature": 1,
        "messages": [
          {
            "role": "system",
            "content": "Be precise and concise."
          },
          {
            "role": "user",
            "content": "Find the recipe page for The Best Corn Casserole by Food Network. Return just one link if the page is found. If the page is not found, respond in 2 words or less."
          }
        ],
        "enable_search_classifier": "true",
        "web_search_options": {
          "search_context_size": "high"
        }
      }
      
  2. Observe the unexpected behavior.

:pushpin: API Request & Response (if applicable)

Request:

{
  "model": "sonar",
  "temperature": 1,
  "messages": [
    {
      "role": "system",
      "content": "Be precise and concise."
    },
    {
      "role": "user",
      "content": "Find the recipe page for The Best Corn Casserole by Food Network. Return just one link if the page is found. If the page is not found, respond in 2 words or less."
    }
  ],
  "enable_search_classifier": "true",
  "web_search_options": {
    "search_context_size": "high"
  }
}

Response:

{
    "id": "1abd95db-d239-453d-bcf6-35f50925401c",
    "model": "sonar",
    "created": 1762223915,
    "usage": {
        "prompt_tokens": 45,
        "completion_tokens": 2,
        "total_tokens": 47,
        "search_context_size": "high",
        "cost": {
            "input_tokens_cost": 0.0,
            "output_tokens_cost": 0.0,
            "request_cost": 0.012,
            "total_cost": 0.012
        }
    },
    "citations": [
        "https://www.youtube.com/watch?v=CTZh7hPrNvM",
        "https://www.youtube.com/watch?v=b7LRMmwFAD0",
        "https://www.cookingbites.com/threads/corn-casserole.5242/"
    ],
    "search_results": [
        {
            "title": "How to Make Ree's Creamy Corn Casserole | The Pioneer Woman",
            "url": "https://www.youtube.com/watch?v=CTZh7hPrNvM",
            "date": "2017-11-03",
            "last_updated": "2025-08-22",
            "snippet": "Quarantine Cooking - Corn Casserole. Paula Deen · 768K views ; Ree Drummond's TOP 5 Casserole Recipe Videos | The Pioneer Woman | Food Network.",
            "source": "web"
        },
        {
            "title": "Kardea Brown's Creamed Corn Casserole ​| Delicious Miss Brown",
            "url": "https://www.youtube.com/watch?v=b7LRMmwFAD0",
            "date": "2022-07-23",
            "last_updated": "2025-10-05",
            "snippet": "... recipes, brilliant kitchen hacks and content from your favorite Food Network shows. ▷ FOOD NETWORK KITCHEN APP: http://foodtv.com/FNKApp ...",
            "source": "web"
        },
        {
            "title": "Corn Casserole - Recipe - CookingBites Cooking Forum",
            "url": "https://www.cookingbites.com/threads/corn-casserole.5242/",
            "date": "2015-07-11",
            "last_updated": "2025-10-24",
            "snippet": "I used Paula Deen's Corn Casserole recipe as the basis for a casserole last night. I used a can of creamed corn, and then, instead of a can or kernel corn, I ...",
            "source": "web"
        }
    ],
    "object": "chat.completion",
    "choices": [
        {
            "index": 0,
            "finish_reason": "stop",
            "message": {
                "role": "assistant",
                "content": "Not found"
            },
            "delta": {
                "role": "assistant",
                "content": ""
            }
        }
    ]
}

:globe_showing_europe_africa: Environment

  • API Version: Latest
  • Operating System: MacOS

:paperclip: Logs or Screenshots (if applicable)

Expected result from App chat: