Hey Team,
We have been trying to crawl the contents from Lucid sitemap URL - and Lucid server is giving us 403 all the time.
Below is the error logs. we are getting for all of requests
"Crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving, root cause: Exception: crawl failed with status 403 for url https://help.lucid.co/hc/en-us/articles/360049865511-Troubleshooting-Saving"
What is the way to solve this? any userAgent we need to list for our crawler.
I need help on it!
I reached out your Support team and they are not ready to help at all!!!