gentopia-ai / gentpool Goto Github PK

View Code? Open in Web Editor NEW

27.0 27.0 7.0 12.25 MB

Gentopia Agent Zoo and Agent Benchmark

License: MIT License

Python 57.21% Jupyter Notebook 39.90% Shell 2.89%

gentpool's People

Contributors

Stargazers

Forkers

mkram yakami129 shism2 azure-arc-0 evelynmitchell sorokinvld neolaf23

gentpool's Issues

GentPool benchmark evaluation error

When I run python evaluate.py <agnet_name>, I get this error:
ImportError: cannot import name 'ZenoParameters' from 'zeno'

When I run python evaluate.py <agent_name> --mode sequential, I get this error:
NotImplementedError: Consistency eval is not supported yet.

Please fix the issue

Saying "hello" to cloned elon leads to KeyError: 'None'

Environment:
Apple M1 Max
13.5 (22G74)

Steps to reproduce:

Follow the GentPool readme to install GentPool:

conda create --name gentenv python=3.10
conda activate gentenv
pip install gentopia
git clone [email protected]:Gentopia-AI/GentPool.git
cd GentPool
touch .env
echo "OPENAI_API_KEY=<my_openai_api_key>" >> .env

Then clone and assemble elon as per the README (omitting --print_agent due to #17):

./clone_agent elon foo
python assemble.py foo

Write "hello" and press enter

Expected results:
No exception thrown. Maybe the agent realizes that there is no ask and resolves to responding in a polite and friendly manner, but no exception should be thrown that prevents the agent from doing so.

Actual results:
Exception thrown:

$ python assemble.py foo
╭───────────────────────────────────────────────────── Gentopia ──────────────────────────────────────────────────────╮
│ Welcome to Gentopia!                                                                                                │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
User: hello
foo:
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ foo ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ The user has greeted me. I should respond in a polite and friendly manner.                                          ┃
┃                                                                                                                     ┃
┃ Action: None                                                                                                        ┃
┃                                                                                                                     ┃
┃ Action Input: None                                                                                                  ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
Traceback (most recent call last):
  File "/Users/motin/Dev/Projects/generative-reality/reproduce-issue/GentPool/assemble.py", line 41, in <module>
    main()
  File "/Users/motin/Dev/Projects/generative-reality/reproduce-issue/GentPool/assemble.py", line 37, in main
    chat(agent, verbose=print_agent)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/__init__.py", line 26,
in chat
    response = agent.stream(text, output=output)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/agent/react/agent.py",
line 224, in stream
    result = self._format_function_map()[action](tool_input)
KeyError: 'None'
⠸ Calling function: None ...

Using --print_agent leads to RecursionError: maximum recursion depth exceeded while calling a Python object

Environment:
Apple M1 Max
13.5 (22G74)

Steps to reproduce:

Follow the GentPool readme to install GentPool:

conda create --name gentenv python=3.10
conda activate gentenv
pip install gentopia
git clone [email protected]:Gentopia-AI/GentPool.git
cd GentPool
touch .env
echo "OPENAI_API_KEY=<my_openai_api_key>" >> .env

Then clone and assemble elon as per the README:

./clone_agent elon foo
python assemble.py foo --print_agent

Expected results:
No exception thrown.

Actual results:
Exception thrown:

$ python assemble.py foo --print_agent
╭───────────────────────────────────────────────────── Gentopia ──────────────────────────────────────────────────────╮
│ Welcome to Gentopia!                                                                                                │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
Traceback (most recent call last):
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1673, in print
    renderables = self._collect_renderables(
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1543, in _collect_renderables
    elif isinstance(renderable, ConsoleRenderable):
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/typing.py", line 1503, in __instancecheck__
    issubclass(instance.__class__, cls)):
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/abc.py", line 123, in __subclasscheck__
    return _abc_subclasscheck(cls, subclass)
RecursionError: maximum recursion depth exceeded in comparison

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/motin/Dev/Projects/generative-reality/reproduce-issue/GentPool/assemble.py", line 41, in <module>
    main()
  File "/Users/motin/Dev/Projects/generative-reality/reproduce-issue/GentPool/assemble.py", line 37, in main
    chat(agent, verbose=print_agent)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/__init__.py", line 12, in chat
    output.panel_print(str(agent), title="[red]Agent")
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/agent/base_agent.py", line 77, in __str__
    rprint(self, file=result)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/__init__.py", line 74, in print
    return write_console.print(*objects, sep=sep, end=end)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1673, in print
    renderables = self._collect_renderables(
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1550, in _collect_renderables
    append_text(_highlighter(str(renderable)))
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/agent/base_agent.py", line 77, in __str__
    rprint(self, file=result)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/__init__.py", line 74, in print
    return write_console.print(*objects, sep=sep, end=end)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1673, in print
    renderables = self._collect_renderables(
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1550, in _collect_renderables
    append_text(_highlighter(str(renderable)))
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/agent/base_agent.py", line 77, in __str__
    rprint(self, file=result)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/__init__.py", line 74, in print
    return write_console.print(*objects, sep=sep, end=end)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1673, in print
    renderables = self._collect_renderables(
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1550, in _collect_renderables
    append_text(_highlighter(str(renderable)))
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/agent/base_agent.py", line 77, in __str__
    rprint(self, file=result)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/__init__.py", line 74, in print
    return write_console.print(*objects, sep=sep, end=end)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1673, in print
    renderables = self._collect_renderables(
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1550, in _collect_renderables
    append_text(_highlighter(str(renderable)))
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/agent/base_agent.py", line 
........ <--- lots of repetitions removed for brevity
77, in __str__
    rprint(self, file=result)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/__init__.py", line 74, in print
    return write_console.print(*objects, sep=sep, end=end)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1673, in print
    renderables = self._collect_renderables(
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1550, in _collect_renderables
    append_text(_highlighter(str(renderable)))
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/gentopia/agent/base_agent.py", line 77, in __str__
    rprint(self, file=result)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/__init__.py", line 74, in print
    return write_console.print(*objects, sep=sep, end=end)
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 1672, in print
    with self:
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 864, in __exit__
    self._exit_buffer()
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 822, in _exit_buffer
    self._check_buffer()
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 2057, in _check_buffer
    text = self._render_buffer(self._buffer[:])
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 2073, in _render_buffer
    not_terminal = not self.is_terminal
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/site-packages/rich/console.py", line 952, in is_terminal
    force_color = self._environ.get("FORCE_COLOR")
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/_collections_abc.py", line 824, in get
    return self[key]
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/os.py", line 677, in __getitem__
    value = self._data[self.encodekey(key)]
  File "/opt/homebrew/Caskroom/miniforge/base/envs/gentenv/lib/python3.10/os.py", line 756, in encode
    if not isinstance(value, str):
RecursionError: maximum recursion depth exceeded while calling a Python object

Note that the same command without --print_agent does not throw an exception.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.