Coder Social home page Coder Social logo

Comments (6)

CastellanZhang avatar CastellanZhang commented on June 30, 2024

看了一下这个数据,比较特殊,类别105,特征维度5w多,而样本数只有几千,平均到每个类别只有几十个样本。而我的算法采用的是FTRL优化,前提假定样本数相对类别和特征维度是足够多的。
所以对这个数据需要多轮迭代,我算法本身是支持的。或者等价地,直接把训练样本复制多份再训练。同时还要调参,参数很重要。我简单实验了一下,把-w_alpha改成100:
16轮迭代,或者直接把数据复制16倍,测试集acc能到90%以上
32轮,测试集acc能到92%以上
如果轮次更多,或者好好调调参数,应该还能更高。

from alphafm_softmax.

hxs91 avatar hxs91 commented on June 30, 2024

噢噢,了解了谢谢~~

from alphafm_softmax.

laoma023012 avatar laoma023012 commented on June 30, 2024

如何设置迭代次数

from alphafm_softmax.

CastellanZhang avatar CastellanZhang commented on June 30, 2024

见-im参数说明

from alphafm_softmax.

supersush avatar supersush commented on June 30, 2024

您好,最近在学习FTRL算法,FTL的**是每次找到让之前所有损失函数之和最小的参数。我理解这也是为什么它可以做online learning。
既然它每次训练都使损失函数最小,为什么复制样本会得出更优的模型呢?我理解只要训练样本集一次就应该得出在该样本集下的最优模型。
谢谢!

from alphafm_softmax.

CastellanZhang avatar CastellanZhang commented on June 30, 2024

@supersush ,仔细看一下FTRL迭代公式,最小化的不是之前所有损失函数之和,而是之前所有损失函数的“一阶近似”之和以及附加强凸函数与正则项

from alphafm_softmax.

Related Issues (4)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.