Coder Social home page Coder Social logo

james4ever0 / agi_computer_control Goto Github PK

View Code? Open in Web Editor NEW
32.0 2.0 4.0 2.3 MB

Autonomous computer program that can do anything without human operators.

Home Page: https://james4ever0.github.io/cybergod_doc

Python 34.99% Batchfile 0.03% Shell 0.99% Jupyter Notebook 13.39% HTML 5.85% Jinja 4.34% Dockerfile 0.02% Makefile 0.08% JavaScript 40.30%
artificial-general-intelligence autonomous-robots consciousness deep-active-inference evolutionary-algorithms qstar automation

agi_computer_control's Introduction

Cybergod logo

cybergod_with_background.mp4

Cybergod

join discord group

bilibili live streaming

Intro

Agent powered by Godlang, the official agent language for cybergod.

Economy system powered by Godcoin, the official digital currency for cybergod. Smart contract system is deeply integrated into the reinforcement learning system and life support system per agent.

Notice not only human can publish smart contracts, agents can also publish smart contracts, to delegate work to other agents.

Trained on The Frozen Forest, a dataset containing random keystrokes, mouse clicks and screen recordings.

You can also get the dataset (terminal version) at here

the openai universe is using VNC, almost doing the same thing.

you can find some demo models from there.

check out SerpentAI

but why bother? we can build these things in the same way.

human demonstrations are limited, but random keystrokes are infinite.

try to obtain infinite data as pretrained data, then fine-tune on human demonstrations.


键鼠真神是一种意识形态

cybergod is an ideology.

键鼠真神 又名cybergod 赛博真神

训练数据集为the frozen forest 随机敲键盘点鼠标 录屏

奖励函数 如果屏幕发生变化 奖励上一次行为

避免把系统关机 被锁在屏幕外面

避免机器卡死: 监测机器是否卡死 如果卡死那么自动外部重启 (重置状态,重新跑脚本)

连着WEBDAV一起刷新 有filelock

(直接取消lock权限)


looking for using docker for automation, or using some tty-like things for automation.

disable ubuntu system authentication?


make some server for vm to access to restart the webdav server when you have error.


agi_workspace happen to be in recycle bin. make sure we have the init files.

make sure we can restore our environments in every restart.


spice-protocol

found on utm.app, launch qemu and create spice unix socket.

https://github.com/Shells-com/spice

https://github.com/gnif/PureSpice

https://github.com/citrix-openstack-build/spice-html5

https://github.com/oetcxiaoliu/spice

https://github.com/TotallWAR/spice_protocol

remmina


掉盘问题: cd .

(建议直接换个盘 或者换C口的数据线 A口不稳定 或者把硬盘取出来更新固件?)

c口数据线观测中


to resolve the display resolution/mouse coordinate range matching issue, use pyautogui to get the resolution then capture display using that resolution (resize to it)


GPT4 is using MoE as its architecture.


the main objective of AGI is to create another version of itself.


ways of connection:

vnc, ssh, tty, tmux, hdmi capture & hid emulator, window capture and directed inputs (os specific)


the point is not making this exhaustive. it is about making some standard i/o and adapt to every situation.


改变开发思路:将功能和娱乐相结合

受众:游戏娱乐向 实用向

发布程序到steam平台

为此需要宣传、绘画设计等等


用elo进行打分 分高的可以在官网有较高的模型权重排名


technically this would not be a normal game. it is a metagame, which is the game of all games. it can play other games, play itself, even create itself.


devcontainer is useful for creating reproducible environments locally (if of the same architecture, like x86) or remotely (different architecture, like Apple M1).


because setting this up properly during development is a pain in the ass (in most time), let's pack it up into a docker container, for your safety.

if you want to release this and use it in production, you can refactor the code, configure platform specific dependencies and send it to devops.


devcontainer won't work as expected on windows 11 as we put our repo on external disk


your aim is too damn big! shall you begin to train some primitive neural network with functionality of only emitting and receiving ascii words, even just a single character like 'C'. get your hands dirty!


the basic docker service is just like havoc. it does not contain anything 'intelligent'. only 'life support'.

we plan to containerize chatdev/open-interpreter/autogpt. after that, we will combine the two, and create some 'capitalism' among multiple containers.

finally we will create some ever-evolving agent and use that as the building block for the megasystem.


the mouse calibration issue can be of major concern. we don't find it anywhere.

use active inference or reinforcement learning?


thanks to our pioneers that guided us some 'aimless' learning, i think it does not matter how we learn specific things. when we learn things relevant to our personal goals, we are inevitably going to optimize the algorithm towards our desired values.

if qstar is just about long term thinking, it could be useful since that is something currently missing in ai systems. when it comes to issues like calibration errors, fixing bugs, handling uncertainties, worse than human. they often get stuck into repetition, never seek for improvements and will not get bored in the loop, which is quite strange and unusual.


i think you are getting jealous over openai, since they are consisted of the world's smartest asses and come over new ideas every fucking day. but that does not matter. i think i had the idea before. i think everyone around the world had the same damn idea before. we do not need its mercy to teach us the dream we had via abstract symbols and formulas. we do our own. worst of all, they do not trust their ai systems, severely limited the ability of ai, left it overthinking and powerless.


the self-operating-computer is using visual grid (just putting grid and text over screenshot, kinda like this hackish approach) for calibration. are you sure it is a good idea? do you need some extra channel over this to avoid information loss?

does this work for games as well?


prompt engineering is a tweak around prior, in order to change posterior. they want to know better prior to get better posterior. kind like searching for the reason behind the decision, backtracking. so why not just use bidirectional or arbitrary directional language models instead of causal models?


i don't understand active inference. however there is a debate over whether to change the environment to fit prediction, or to change prediction to fit the environment. sounds like quantum entanglement.


the reward function is part of the observation, usually not something life critical so it will not be so direct. it is the internal state that will be affected by the observation.


play fps at: https://krunker.io/ (in chromium, not firefox)


if want to run the program isolated, without interference, you use docker. if want to visualize, use jpeg streaming service and open in browser.

Star History

agi_computer_control's People

Contributors

gitjournalapp avatar james4ever0 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

agi_computer_control's Issues

TypeError: can only concatenate str (not "bytes") to str

Hello @James4Ever0 , Could you please help on below issue? I am not able to conclude whether we expect results in bytes or str.

2023-08-18 04:24:53,542Z INFO rdp_client_cli.py:227 (TB) Initiate RDP connection: (IP:10.48.183.172, Username:devuser, Password:nutanix/4u, Domain:XI88.local)
Unhandled Error
Traceback (most recent call last):
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/python/log.py", line 96, in callWithLogger
return callWithContext({"system": lp}, func, *args, **kw)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/python/log.py", line 80, in callWithContext
return context.call({ILogContext: newCtx}, func, *args, **kw)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/python/context.py", line 117, in callWithContext
return self.currentContext().callWithContext(ctx, func, *args, **kw)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/python/context.py", line 82, in callWithContext
return func(*args, **kw)
--- ---
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/internet/posixbase.py", line 487, in _doReadOrWrite
why = selectable.doRead()
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/internet/tcp.py", line 248, in doRead
return self._dataReceived(data)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/internet/tcp.py", line 253, in _dataReceived
rval = self.protocol.dataReceived(data)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/protocols/tls.py", line 329, in dataReceived
self._flushReceiveBIO()
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/protocols/tls.py", line 295, in _flushReceiveBIO
ProtocolWrapper.dataReceived(self, bytes)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/protocols/policies.py", line 110, in dataReceived
self.wrappedProtocol.dataReceived(data)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/rdpy3/protocol/rdp/nla/cssp.py", line 259, in recvChallenge
message, self._interface = self._authenticationProtocol.getAuthenticateMessage(getNegoTokens(request)[0])
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/rdpy3/protocol/rdp/nla/ntlm.py", line 552, in getAuthenticateMessage
NtChallengeResponse, LmChallengeResponse, SessionBaseKey = ComputeResponsev2(self._ResponseKeyNT, self._ResponseKeyLM, ServerChallenge, ClientChallenge, Timestamp, ServerName)
File "/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/rdpy3/protocol/rdp/nla/ntlm.py", line 452, in ComputeResponsev2
temp = Responserversion + HiResponserversion + Z(6) + Time + ClientChallenge + Z(4) + ServerName
builtins.TypeError: can only concatenate str (not "bytes") to str

[] INFO: *******************************************
[
] INFO: * NLA Security selected *
[*] INFO: *******************************************
Dimpi Responserversion: <class 'str'>, HiResponserversion: <class 'str'>, Z(6): <class 'str'>, Time: <class 'bytes'>, ClientChallenge : <class 'bytes'>, Z(4): <class 'str'>, ServerName: <class 'bytes'>
2023-08-18 04:24:53,572Z INFO rdp_client_cli.py:167 (TB) Lost connection : [Failure instance: Traceback: <class 'TypeError'>: can only concatenate str (not "bytes") to str
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/python/log.py:80:callWithContext
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/python/context.py:117:callWithContext
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/python/context.py:82:callWithContext
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/internet/posixbase.py:500:_doReadOrWrite
--- ---
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/internet/posixbase.py:487:_doReadOrWrite
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/internet/tcp.py:248:doRead
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/internet/tcp.py:253:_dataReceived
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/protocols/tls.py:329:dataReceived
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/protocols/tls.py:295:_flushReceiveBIO
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/twisted/protocols/policies.py:110:dataReceived
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/rdpy3/protocol/rdp/nla/cssp.py:259:recvChallenge
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/rdpy3/protocol/rdp/nla/ntlm.py:552:getAuthenticateMessage
/home/dimple.goyal/ADUI/nutest-py3-tests/my_nutest_virtual_env/lib/python3.9/site-packages/rdpy3/protocol/rdp/nla/ntlm.py:452:ComputeResponsev2

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.