Limited Input/Output length seriously reduces Poe's usefulness compared to ChatGPT about server-bot-quick-start

[anmolsingh95]

Hi Behnam. Just wanted to acknowledge that I saw your message and share that I filed an internal ticket to investigate this. In the meanwhile, will it be possible for you to provide a snippet of text that allows us to reproduce this? Thanks!

[anmolsingh95]

Hi @ibehnam. Unfortunately, it will take longer for us to make the higher context models available. In the meanwhile, is it possible for you to try out GPT-32K to see if that works? https://poe.com/GPT-4-32k

[ibehnam]

Hi Behnam. Just wanted to acknowledge that I saw your message and share that I filed an internal ticket to investigate this. In the meanwhile, will it be possible for you to provide a snippet of text that allows us to reproduce this? Thanks!

Sure! Here's one example: https://poe.com/s/s8bzSuskErMYCeufvkOB

In comparison, ChatGPT handles the exact same prompt with no problem:
https://chat.openai.com/share/31312be8-38d8-4f82-b890-6dec81359136

[ibehnam]

Hi @ibehnam. Unfortunately, it will take longer for us to make the higher context models available. In the meanwhile, is it possible for you to try out GPT-32K to see if that works? poe.com/GPT-4-32k

Thanks for offering this, but unfortunately the limit is not just about context window, it's about the length of text that the user is allowed to write in their messages (example above).

When Poe silently switched from gpt-4 to gpt-4-turbo on its official GPT-4 bot, I was a bit disappointed because gpt-4-turbo is a downgrade in terms of reasoning skills and quality of messages. But since it has a much longer context window (128k!), I decided to use it for my academic bot. I don't even know why Poe still serves the GPT-4-32k bot. It was always limited for me (50 messages) and although it's got higher quality compared to gpt-4 and gpt-4-turbo, limited allowed number of messages for this bot makes it unusable in practice. Not to mention that all these Poe bots (based on gpt-4, gpt-4-turbo, and gpt-4-32k) suffer from the limited input and output length, and it messes with their function calling too.

[anmolsingh95]

Hi @ibehnam. I raised this internally but seems like it will take a bigger change to allow messages longer than the model's total context window and will likely not get addressed in a timeframe in which it will be helpful to you. Apologies for the inconvenience this caused on your end.

[ibehnam]

@anmolsingh95 Thanks for the update. Just to be clear, I wasn't asking for context window longer than the model's total context window. As I said, currently Poe doesn't allow us to send inputs that are longer than a specific length n, even if n < model_contex_window. GPT-4-turbo's context window is 128K, that is almost 300 pages. But we can't send more than a couple pages content in the messages (either through the API or on the website).

I was hoping that this would get resolved but I understand that Poe may want to save API costs by limiting input/output lengths.