ryota-murakami / biq-data-backend Goto Github PK
View Code? Open in Web Editor NEWtwitterのトレンドワードを集計するシステムです。
twitterのトレンドワードを集計するシステムです。
デプロイフローも含めた最終的なインフラ構成は後に詰める
このページのコードをコピペして動かしてみたんだけどアラビア文字コンソール出力に出てしまう。http://www.intellilink.co.jp/article/column/bigdata-kk01.html
これを直したい。
topList.foreach{case (count, tag) => println(s"$tag ($count tweets)")}
A. ちゃんとUTF-8になっている。もちろんソースファイルもUTF-8。
ryota.murakami@murakami ~/r/twitterpulse> activator console
[info] Loading project definition from /Users/ryota.murakami/repository/twitterpulse/project
[info] Updating {file:/Users/ryota.murakami/repository/twitterpulse/project/}twitterpulse-build...
[info] Resolving org.fusesource.jansi#jansi;1.4 ...
[info] Done updating.
[info] Set current project to otkm (in build file:/Users/ryota.murakami/repository/twitterpulse/)
[info] Updating {file:/Users/ryota.murakami/repository/twitterpulse/}twitterpulse...
[info] Resolving jline#jline;2.12 ...
[info] Done updating.
[info] Compiling 1 Scala source to /Users/ryota.murakami/repository/twitterpulse/target/scala-2.11/classes...
[info] Starting scala interpreter...
[info]
import main._
Welcome to Scala version 2.11.2 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_92).
Type in expressions to have them evaluated.
Type :help for more information.
scala> scala.io.Codec.default.charSet
res0: java.nio.charset.Charset = UTF-8
scala>
A. アラビア文字っぽいのは出なくなった。kuromojiが原因の可能性が高い。
//topList.foreach{case (count, tag) => println(s"$tag ($count tweets)")}
topList.foreach{case (count, tag) => println("tag (count tweets)")}
16/12/13 19:58:53 INFO TwitterStreamImpl: Establishing connection.
16/12/13 19:58:53 INFO TwitterStreamImpl: Establishing connection.
¥n Popular topics in last 60*60 seconds (2091 words):
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
tag (count tweets)
unicorde番号調べてたらやっぱりアラビア語っぽい。
以下ページの06番台の文字がリストに格納されている。
https://ja.wikipedia.org/wiki/Unicode%E4%B8%80%E8%A6%A7_0000-0FFF
1分間の中で20個
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.