Coder Social home page Coder Social logo

bigdatalab5's Introduction

现在的问题:

由于我没认真看ppt,用GraphFileGen实现了任务123的功能,需要把它拆成3部分。

任务5还没写。我看了任务5的论文,算法是:

  1. 将每个人物打上一个独有的标签

  2. 对于每轮迭代,统计A的所有邻居的标签,选择权重最大的一个作为A的新标签。

    • 例如,若A的邻居为 B 0.1|C 0.2|D 0.7,其中B和C的标签为1,D的标签为2,则标签1的权重和为0.3,标签2的权重和为0.7,A的新标签为2
  3. 进行若干轮迭代

感觉任务5可以参考任务4的框架。

你们两个一个写任务5,一个拆任务123以及写报告?

运行方式

任务1

在hdfs下跑:

yarn jar xxx.jar org.GetNames.GetNames PATH/PERSON_LIST_TXT YOUR_INPUT_FOLDER_PATH YOUR_OUTPUT_PATH

在本机跑:

java org.GetNames.GetNames PATH/PERSON_LIST_TXT YOUR_INPUT_FOLDER_PATH YOUR_OUTPUT_PATH

任务3:

在hdfs下跑:

yarn jar xxx.jar org.GraphFileGen.GraphFileGen YOUR_INPUT_FOLDER_PATH YOUR_OUTPUT_PATH

在本机跑:

java org.GraphFileGen.GraphFileGen YOUR_INPUT_FOLDER_PATH YOUR_OUTPUT_PATH

任务4

在hdfs下跑:

yarn jar xxx.jar org.PageRank.PageRankMain YOUR_INPUT_FOLDER_PATH YOUR_OUTPUT_PATH 迭代轮数

在本机跑:

java org.PageRank.PageRankMain YOUR_INPUT_FOLDER_PATH YOUR_OUTPUT_PATH 迭代轮数

bigdatalab5's People

Contributors

triccsr avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.