Coder Social home page Coder Social logo

cyvaction / jarvis2 Goto Github PK

View Code? Open in Web Editor NEW

This project forked from pologood/jarvis2

0.0 1.0 0.0 18.19 MB

工作流调度系统

Home Page: http://blog.csdn.net/colorant/article/details/76034188#t29

Shell 0.19% Java 58.24% Protocol Buffer 0.76% CSS 7.81% JavaScript 33.00%

jarvis2's Introduction

调度系统重构项目.

总体介绍

业务场景

数据平台核心作业调度管理系统

核心需求

  • 支持多种不同类型的作业调度任务, 当前主要目标:

    • 高优先 : Hive / MR / Java / Shell
    • 低优先 : SSH / Python (可以考虑用通用方式处理?)
  • 自动化动态部署作业运行环境

    • 通过参数配置,后台管理等形式, 使用户能动态的集中管理和部署作业运行所需环境, 无需在集群上提前静态部署相关环境.
  • 用户权限管理

    • 对用户权限能方便的进行管理, 包括用户对作业相关的操作权限, 对资源的使用权限等
  • 灵活的外部接入方式

    • 需要提供统一的业务接入模式和编程接口
  • 监控

    • 需要提供作业运行状态和集群本身的监控

jarvis2's People

Contributors

colorant avatar zhaolmtravelsky avatar zllc avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.