Skip to main content
Answer

How can i crawl your sitemap URL?

  • June 7, 2024
  • 2 replies
  • 6714 views

steve s
Forum|alt.badge.img+1

Hey Team,

We have been trying to crawl the contents from Lucid sitemap URL - and Lucid server is giving us 403 all the time.

Below is the error logs. we are getting for all of requests
"Crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving, root cause: Exception: crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving"

 

What is the way to solve this? any userAgent we need to list for our crawler.
I need help on it!

 

I reached out your Support team and they are not ready to help at all!!!

Best answer by Richard Udell

Thank you for contributing to the Lucid for Developers Community and for submitting your Support ticket that has been addressed by my colleagues. Lucid’s public APIs offer a wide range of capabilities - though this isn’t something we support. 

Comments

steve s
Forum|alt.badge.img+1
  • Author
  • June 7, 2024

This is your sitemap URL - https://help.lucid.co/hc/sitemap.xml


Richard Udell
Forum|alt.badge.img+8
  • Lucid support team
  • Answer
  • June 8, 2024

Thank you for contributing to the Lucid for Developers Community and for submitting your Support ticket that has been addressed by my colleagues. Lucid’s public APIs offer a wide range of capabilities - though this isn’t something we support.