Skip to main content
steve s
Jun 7, 2024 12:53 PM UTC
Solved

How can i crawl your sitemap URL?

Hey Team,

We have been trying to crawl the contents from Lucid sitemap URL - and Lucid server is giving us 403 all the time.

Below is the error logs. we are getting for all of requests
"Crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving, root cause: Exception: crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving"

 

What is the way to solve this? any userAgent we need to list for our crawler.
I need help on it!

 

I reached out your Support team and they are not ready to help at all!!!

Richard Udell
Lucid support team
Jun 8, 2024 2:36 AM UTC

Thank you for contributing to the Lucid for Developers Community and for submitting your Support ticket that has been addressed by my colleagues. Lucid’s public APIs offer a wide range of capabilities - though this isn’t something we support. 

Comments

steve s
steve sAuthor
Jun 7, 2024 12:54 PM UTC

This is your sitemap URL - https://help.lucid.co/hc/sitemap.xml

Translate
Richard Udell
Lucid support team
Jun 8, 2024 2:36 AM UTC

Thank you for contributing to the Lucid for Developers Community and for submitting your Support ticket that has been addressed by my colleagues. Lucid’s public APIs offer a wide range of capabilities - though this isn’t something we support. 

Translate