AI Prompt Flow: Failed to get response from custom endpoint
Hey there, gone through the “How to” documentation for configuring AI Prompt Flow in Lucid Charts 5 times now. No matter what I configure when Executing a prompt, I only get “Failed to get response from custom endpoint”
Any insight or ideas of where this could be going wrong? Example Photo of config/Prompt below.
“AI Prompt Flow” integration on Lucid’s side is both “Connected for my Account” and “Connected for me”
Tried many model types (4 and 3.5 alike, found under the provided compatibility list for “chat completions”)
Generated and test multiple API keys, confirmed they were “used/called on” on Open AI’s side
Open AI is a paid subscription with access to model 4
Logged in via “incognito” window in chrome
What am I getting wrong here? Do I need to be logged into OpenAI at the same time? Do I need to approve the API connection somewhere? Any an all help would be greatly appreciated, thank you.
Page 1 / 1
Hi @Kohl, thanks for your post. Our AI Prompt Flow integration will return this error message if the API key or endpoint URL are invalid. I suggest double-checking these two values:
API Key: try generating a new API key for your AI Prompt Flow configuration.
Endpoint URL: The AI Prompt Flow currently works with any model that supports chat_completion APIs from OpenAI or Azure. The endpoint URL in our documentation will work: https://api.openai.com/v1/chat/completions. Your screenshot truncates your endpoint URL, though I suspect that you may be using avalid chat_completions endpoint.
Please let me know if you're still having issues after trying these steps and we can take a closer look.
Yup I’ve triple checked those value as they were my suspects as well.
As for the API Keys, I have generated several (generating them here: https://platform.openai.com/api-keys ) testing them one at a time. On the same page, after pressing the “execute” button in Lucidcharts, I have verified that the API key will update as “used” in the “last used” column, showing some level of “connection/correctness”
Hi @Kohl. I’m sorry you are continuing to have trouble with the AI Prompt Flow tool. Have you purchased API usage credits from OpenAI? Each time Lucid calls on OpenAI through the API, it uses a certain amount of credits per letter/word. You can purchase them through the Biling tab of your OpenAI account.
If that isn’t the issue, let me know, and I’ll be happy to continue troubleshooting with you.
Ah so I think this has sent me down the correct path, thank you Morgan. We are fairly new at working with OpenAI, and it took some digging to find the following:
We will look deeper into the mess that is OpenAI billing, it seems the use of the API is separate billing all together. Who knew! Thank you again for the all the help, I’m pretty confident this is our problem.
Hi @Kohl - glad to hear it! Please let me know if you encounter any additional issues!
Reply
Create an account in the community
A Lucid account is required to interact with the community. You will be redirected to the Lucid app to create an account.
