Comments (1)
icoxfog417
commented on June 26, 2024
英語単体でも OK 、多言語データは機械翻訳でもいいからあるとブーストが効くことを示唆している。基本的に物量がモノを言うので、量が減ってしまうとその分性能は下がる感じ。提案された BloomZ は重みが 175B だが性能は GPT-J 6B と同程度なので機械翻訳でOKかは怪しい(limitations にも記載あり)
from arxivtimes.
Related Issues (20)
- Parameter Prediction for Unseen Deep Architectures
- Fast Model Editing at Scale
- Can Automated Feedback Improve Teachers’ Uptake of Student Ideas? Evidence From a Randomized Controlled Trial In a Large-Scale Online Course
- Approximate Data Deletion from Machine Learning Models HOT 1
- Training Larger Networks for Deep Reinforcement Learning
- Masked Autoencoders Are Scalable Vision Learners
- TIDE: A General Toolbox for Identifying Object Detection Errors
- PolyViT: Co-training Vision Transformers on Images, Videos and Audio
- Improving language models by retrieving from trillions of tokens HOT 1
- Do Transformer Modifications Transfer Across Implementations and Applications? HOT 1
- Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning
- Text-to-Table: A New Way of Information Extraction
- A Survey on Machine Learning Techniques for Source Code Analysis
- Human Feedback is not Gold Standard
- Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models
- Contrastive Error Attribution for Finetuned Language Models
- Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection
- Cold-Start Data Selection for Few-shot Language Model Fine-tuning: A Prompt-Based Uncertainty Propagation Approach HOT 1
- Fine-tuning Happens in Tiny Subspaces: Exploring Intrinsic Task-specific Subspaces of Pre-trained Language Models
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from arxivtimes.