lubozhan Goto Github PK

abris

Avro SerDe for Apache Spark structured APIs.

akka-quartz-scheduler

Quartz Extension and utilities for cron-style scheduling in Akka

athenax

SQL-based streaming analytics platform at scale

canal

阿里巴巴mysql数据库binlog的增量订阅&消费组件 。阿里云DRDS( https://www.aliyun.com/product/drds )、阿里巴巴TDDL 二级索引、小表复制powerd by canal.

coolplayspark

酷玩 Spark: Spark 源代码解析、Spark 类库等

decision

Powered by Spark Streaming & Siddhi

easyml

Easy Machine Learning is a general-purpose dataflow-based system for easing the process of applying machine learning algorithms to real world tasks.

edk2

EDK II

effectivescala

Twitter's Effective Scala Guide

example-spark-kafka

Apache Spark and Apache Kafka integration example

flink

Apache Flink

hibench

HiBench is a big data benchmark suite.

hudi

Spark Library for Hadoop Upserts And Incrementals

interview_internal_reference

2019年最新总结，阿里，腾讯，百度，美团，头条等技术面试题目，以及答案，专家出题人分析汇总。

iql

An ad hoc query service based on the spark sql engine.(基于spark sql引擎的即席查询服务)

kafka-connect-hdfs

Kafka Connect HDFS connector

kafka-exactly-once

kafka-spark-consumer

High Performance Kafka Consumer for Spark Streaming. Compatible with every Spark and Kafka versions including latest Spark 2.2.0 and Kafka 0.11.0. Now supports Kafka Security. Offset management in Zookeeper. Reliable No-Dataloss gurantee. No dependency on HDFS or Checkpointing and WAL. In-built PID rate controller. Support Message Interceptor . Offset Lag checker.

kafka_spark_hbase_demo

kafka spark hbase 日志统计

ksql

KSQL - the Streaming SQL Engine for Apache Kafka

liudao

“六道”实时业务风控系统

mlflow

Open source platform for the complete machine learning lifecycle

movie-recommender-demo

This project walks through how you can create recommendations using Apache Spark machine learning. There are a number of jupyter notebooks that you can run on IBM Data Science Experience, and there a live demo of a movie recommendation web application you can interact with. The demo also uses IBM Message Hub (kafka) to push application events to topic where they are consumed by a spark streaming job running on IBM BigInsights (hadoop).

oap

Optimized Analytics Package for Spark Platform

opentsdb-client

A Java library that implements the synchronized http api for putting metrics and querying data from the OpenTSDB server.

pat

Performance Analysis Tool

quicksql

Simpler, Safer, Faster Unified SQL Analytics Engine for Multi-Datasources

rong360

用户贷款风险预测

scala-archetype-sparkinaction

A simple maven archetype for generating a new Spark 1.6.1 project with Scala 2.10.4

scala_tutorial

Scala Tutorial