Search_domain_filter unable to crawl sap.com or help.sap.com

:bug: Describe the Bug

The search_domain_filter in Perplexity API can’t crawl content from sap.com or help.sap.com. Nothing is shown under search_results even with a simple query “What is SAP?”

:white_check_mark: Expected Behavior

Perplexity should search sap. com, help.sap. com and their subdomains and should return the result.

:cross_mark: Actual Behavior

API is not able to retrieve from sap. com, help.sap. com and their subdomains. Getting blank search_results and citations.

:counterclockwise_arrows_button: Steps to Reproduce

  1. Use /chat/completions
  2. Try Simple system prompt like “You are a helpful assistant that search help.sap. com and subdomains on user question and return response”
  3. Use search_domain_filter - add sap. com and help.sap. com
  4. search with sap related questions.

:pushpin: API Request & Response (if applicable)

:globe_showing_europe_africa: Environment

  • API Version: [e.g., sonar-3.1] Sonar
  • SDK (if applicable): [e.g., Python SDK v0.5]
  • Operating System: [e.g., MacOS, Linux, Windows] Windows

:paperclip: Logs or Screenshots (if applicable)

‘id’: ‘08ff98b9-ed8b-43b8-9a3a-08215b1d53d8’, ‘model’: ‘sonar’, ‘created’: 1754470634, ‘usage’: {‘prompt_tokens’: 21, ‘completion_tokens’: 189, ‘total_tokens’: 210, ‘search_context_size’: ‘medium’, ‘cost’: {‘input_tokens_cost’: 2.1e-05, ‘output_tokens_cost’: 0.000189, ‘request_cost’: 0.005, ‘total_cost’: 0.00521}}, ‘citations’: [], ‘search_results’: [], ‘object’: ‘chat.completion’, ‘choices’: [{‘index’: 0, ‘finish_reason’: ‘stop’, ‘message’: {‘role’: ‘assistant’, ‘content’: ‘SAP B1, or SAP Business One, is an integrated enterprise resource planning (ERP) software solution designed specifically for small and medium-sized enterprises (SMEs). It helps businesses manage critical functions such as finance, sales, customer relationship management (CRM), inventory, purchasing, and operations within a single system.\n\nKey features of SAP Business One include:\n\n- **Financial Management:** Streamlines accounting, banking, and financial operations.\n- **Sales and Customer Management:** Manages sales processes, customer interactions, and service.\n- **Inventory and Production Management:** Helps track inventory levels, manage procurement, and oversee production processes.\n- **Reporting and Analytics:** Provides real-time analytics and customizable reports for informed decision-making.\n- **Integration:** Can integrate with other SAP solutions and third-party applications to extend functionality.\n\nSAP B1 is widely used by growing businesses for its ability to unify various business processes, improve efficiency, and provide greater visibility into operations.’}, ‘delta’: {‘role’: ‘assistant’, ‘content’: ‘’}}]}

:memo: Additional Context

Add any other context about the problem here.

2 Likes

Same issue I have raised here. Waiting from 4th August.

See also API Returning empty search_results object - #7 by jamesliounis

Thanks for bringing this up! This issue has been reported with multiple sites as of lately. This is because our Crawler is currently blocked by Cloudfront on an increasing number of sites. Our teams are actively working on mitigating this issue.

You can learn more about the Cloudflare situation here: https://x.com/perplexity_ai/status/1952531537385456019

1 Like