Skip to main content
Solved

How can i crawl your sitemap URL?

  • 7 June 2024
  • 2 replies
  • 6682 views

Hey Team,

We have been trying to crawl the contents from Lucid sitemap URL - and Lucid server is giving us 403 all the time.

Below is the error logs. we are getting for all of requests
"Crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving, root cause: Exception: crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving"

 

What is the way to solve this? any userAgent we need to list for our crawler.
I need help on it!

 

I reached out your Support team and they are not ready to help at all!!!

Comments

Badge +1

This is your sitemap URL - https://help.lucid.co/hc/sitemap.xml

Userlevel 4
Badge +7

Thank you for contributing to the Lucid for Developers Community and for submitting your Support ticket that has been addressed by my colleagues. Lucid’s public APIs offer a wide range of capabilities - though this isn’t something we support. 

Reply