Solved

How can i crawl your sitemap URL?


Badge +1

Hey Team,

We have been trying to crawl the contents from Lucid sitemap URL - and Lucid server is giving us 403 all the time.

Below is the error logs. we are getting for all of requests
"Crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving, root cause: Exception: crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving"

 

What is the way to solve this? any userAgent we need to list for our crawler.
I need help on it!

 

I reached out your Support team and they are not ready to help at all!!!

icon

Best answer by Richard U 8 June 2024, 04:36

View original

Comments

Badge +1

This is your sitemap URL - https://help.lucid.co/hc/sitemap.xml

Userlevel 3
Badge +7

Thank you for contributing to the Lucid for Developers Community and for submitting your Support ticket that has been addressed by my colleagues. Lucid’s public APIs offer a wide range of capabilities - though this isn’t something we support. 

Reply