fukuball / fuku-ml Goto Github PK

http://www.cnblogs.com/xbf9xbf/p/4716834.html

https://github.com/kevin-keraudren/randomforest-python

https://github.com/chandarb/Python-Regression-Tree-Forest/blob/master/random_forest.py

2/N(XTXw - XTy)

http://www.cnblogs.com/xbf9xbf/p/4737525.html

https://github.com/haiqiong/machine-learning/blob/master/supervised/adaboost.py

http://blog.csdn.net/maoersong/article/details/24776905

http://hhtucode.blogspot.tw/2013/04/ml-adaboost-part-2.html

https://github.com/mazefeng/ml

http://www.cnblogs.com/xbf9xbf/p/4694364.html

https://github.com/neale/softmax

https://github.com/mazefeng/ml/blob/master/softmax.py

https://penolove.gitbooks.io/deep-learning-tutourial/content/Supervise%20learning/softmax%20regression.html

Collecting FukuML
Downloading FukuML-0.4.1-py2.py3-none-any.whl (1.4MB)
100% |████████████████████████████████| 1.4MB 490kB/s
Collecting cvxopt==1.1.8 (from FukuML)
Downloading cvxopt-1.1.8.tar.gz (5.3MB)
100% |████████████████████████████████| 5.3MB 167kB/s
Collecting scikit-learn==0.17.1 (from FukuML)
Downloading scikit_learn-0.17.1-cp27-cp27mu-manylinux1_x86_64.whl (17.6MB)
100% |████████████████████████████████| 17.6MB 69kB/s
Collecting scipy==0.17.0 (from FukuML)
Downloading scipy-0.17.0-cp27-cp27mu-manylinux1_x86_64.whl (39.5MB)
100% |████████████████████████████████| 39.5MB 36kB/s
Collecting numpy==1.10.4 (from FukuML)
Downloading numpy-1.10.4-cp27-cp27mu-manylinux1_x86_64.whl (15.0MB)
100% |████████████████████████████████| 15.0MB 79kB/s
Requirement already satisfied: pep8==1.7.0 in /mnt/disk1/anaconda2/lib/python2.7/site-packages (from FukuML)
Building wheels for collected packages: cvxopt
Running setup.py bdist_wheel for cvxopt ... error
Complete output from command /mnt/disk1/anaconda2/bin/python -u -c "import setuptools, tokenize;file='/tmp/pip-build-Yide8J/cvxopt/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, file, 'exec'))" bdist_wheel -d /tmp/tmpr_lP_apip-wheel- --python-tag cp27:
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/cvxopt
copying src/python/coneprog.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/modeling.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/printing.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/cvxprog.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/info.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/init.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/msk.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/solvers.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/misc.py -> build/lib.linux-x86_64-2.7/cvxopt
running build_ext
building 'base' extension
creating build/temp.linux-x86_64-2.7
creating build/temp.linux-x86_64-2.7/src
creating build/temp.linux-x86_64-2.7/src/C
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/mnt/disk1/anaconda2/include/python2.7 -c src/C/base.c -o build/temp.linux-x86_64-2.7/src/C/base.o
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/mnt/disk1/anaconda2/include/python2.7 -c src/C/dense.c -o build/temp.linux-x86_64-2.7/src/C/dense.o
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/mnt/disk1/anaconda2/include/python2.7 -c src/C/sparse.c -o build/temp.linux-x86_64-2.7/src/C/sparse.o
src/C/sparse.c: In function ‘sparse_concat’:
src/C/sparse.c:368:30: warning: variable ‘blk_ncols’ set but not used [-Wunused-but-set-variable]
int_t blk_nrows = 0, blk_ncols = 0;
^
gcc -pthread -shared -L/mnt/disk1/anaconda2/lib -Wl,-rpath=/mnt/disk1/anaconda2/lib,--no-as-needed build/temp.linux-x86_64-2.7/src/C/base.o build/temp.linux-x86_64-2.7/src/C/dense.o build/temp.linux-x86_64-2.7/src/C/sparse.o -L/usr/lib -L/mnt/disk1/anaconda2/lib -lm -llapack -lblas -lpython2.7 -o build/lib.linux-x86_64-2.7/cvxopt/base.so
/usr/bin/ld: 找不到 -llapack
collect2: error: ld returned 1 exit status
error: command 'gcc' failed with exit status 1

Failed building wheel for cvxopt
Running setup.py clean for cvxopt
Failed to build cvxopt
Installing collected packages: cvxopt, scikit-learn, scipy, numpy, FukuML
Running setup.py install for cvxopt ... error
Complete output from command /mnt/disk1/anaconda2/bin/python -u -c "import setuptools, tokenize;file='/tmp/pip-build-Yide8J/cvxopt/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, file, 'exec'))" install --record /tmp/pip-vV2hrJ-record/install-record.txt --single-version-externally-managed --compile:
running install
running build
running build_py
creating build
creating build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/cvxopt
copying src/python/coneprog.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/modeling.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/printing.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/cvxprog.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/info.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/init.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/msk.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/solvers.py -> build/lib.linux-x86_64-2.7/cvxopt
copying src/python/misc.py -> build/lib.linux-x86_64-2.7/cvxopt
running build_ext
building 'base' extension
creating build/temp.linux-x86_64-2.7
creating build/temp.linux-x86_64-2.7/src
creating build/temp.linux-x86_64-2.7/src/C
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/mnt/disk1/anaconda2/include/python2.7 -c src/C/base.c -o build/temp.linux-x86_64-2.7/src/C/base.o
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/mnt/disk1/anaconda2/include/python2.7 -c src/C/dense.c -o build/temp.linux-x86_64-2.7/src/C/dense.o
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/mnt/disk1/anaconda2/include/python2.7 -c src/C/sparse.c -o build/temp.linux-x86_64-2.7/src/C/sparse.o
src/C/sparse.c: In function ‘sparse_concat’:
src/C/sparse.c:368:30: warning: variable ‘blk_ncols’ set but not used [-Wunused-but-set-variable]
int_t blk_nrows = 0, blk_ncols = 0;
^
gcc -pthread -shared -L/mnt/disk1/anaconda2/lib -Wl,-rpath=/mnt/disk1/anaconda2/lib,--no-as-needed build/temp.linux-x86_64-2.7/src/C/base.o build/temp.linux-x86_64-2.7/src/C/dense.o build/temp.linux-x86_64-2.7/src/C/sparse.o -L/usr/lib -L/mnt/disk1/anaconda2/lib -lm -llapack -lblas -lpython2.7 -o build/lib.linux-x86_64-2.7/cvxopt/base.so
/usr/bin/ld: 找不到 -llapack
collect2: error: ld returned 1 exit status
error: command 'gcc' failed with exit status 1

----------------------------------------

Command "/mnt/disk1/anaconda2/bin/python -u -c "import setuptools, tokenize;file='/tmp/pip-build-Yide8J/cvxopt/setup.py';f=getattr(tokenize, 'open', open)(file);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, file, 'exec'))" install --record /tmp/pip-vV2hrJ-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-build-Yide8J/cvxopt/

Lasso Regression 實作（L1），要找一下資料

http://cvxopt.org/userguide/coneprog.html#cvxopt.solvers.qp

https://gist.github.com/fukuball/de704b2c169aba61cc7d

寫一些 ipython note book tutorial～

https://github.com/misaka-10032/ML/blob/master/hw3/handin/code/svr.py

http://cvxopt.org/examples/tutorial/qp.html

http://cvxopt.org/userguide/coneprog.html

x_normed = x / x.max(axis=0)

https://github.com/michaeldorner/DecisionTrees/tree/master/03_Python%20Code

https://github.com/gumption/Python_for_Data_Science/blob/master/4_Python_Simple_Decision_Tree.ipynb

http://www.cnblogs.com/xbf9xbf/p/4716834.html

https://www.youtube.com/watch?v=g-PvXUjD6qg&list=PLlJy-eBtNFt6EuMxFYRiNRS07MCWN5UIA&index=1

https://www.youtube.com/playlist?list=PLDVUyNKQkt3ro0GUDynHp5ekOAoUZrCsl

https://www.youtube.com/view_play_list?p=A89DCFA6ADACE599

https://github.com/Nyker510/gradient-boosted-decision-tree/blob/master/gbdtree/gbdtree.py

https://github.com/rajivsam/DecisionTrees/blob/master/DT.py

PLA, Pocket, Logistic Regression 的 init_W 可先用 linear regression 算出 w0

http://blog.smellthedata.com/2009/06/python-logistic-regression-with-l2.html

http://aimotion.blogspot.tw/2011/11/machine-learning-with-python-logistic.html

2(y - wx)x

我在網上找的資料說，如果數據線性可分，那麼PLA一定會停止，最大步數為 對於R我們可以從數據集中得到，但是對於gamma，我們無法求得，所以我們只知道存在最大步數，但具體是多少無從得知。

看你的code(PLA.py)，似乎是能確定一個上界，可以請問下相關的理論證明麼

if (self.tune_times > (2 * self.data_num)):
      print("Dataset not linear separable.")
      break