Coder Social home page Coder Social logo

dzharii / awesome-elasticsearch Goto Github PK

View Code? Open in Web Editor NEW
4.8K 228.0 558.0 223 KB

A curated list of the most important and useful resources about elasticsearch: articles, videos, blogs, tips and tricks, use cases. All about Elasticsearch!

License: The Unlicense

elasticsearch query-elasticsearch elasticsearch-cluster elasticsearch-configuration logstash elastalert awesome lucene kibana database

awesome-elasticsearch's Introduction

Awesome Elasticsearch

← Awesome TypeScript -= Awesome Elasticsearch =-

General

Elastic Stack

  • Elasticsearch official website
  • Logstash is a data pipeline that helps you process logs and other event data from a variety of systems
  • Kibana is a data analysis tool that helps to visualize your data; Kibana Manual docs
  • beats is the platform for building lightweight, open source data shippers for many types of data you want to enrich with Logstash, search and analyze in Elasticsearch, and visualize in Kibana.

Books

Certifications

Elastic Certified Engineer

Related (awesome) lists

Open-source and free products, based on Elasticsearch

  • Fess is an open source full featured Enterprise Search, with a web-crawler
  • Yelp/elastalert is a modular flexible rules based alerting system written in Python
  • etsy/411 - an Alert Management Web Application https://demo.fouroneone.io (credentials: user/user)
  • appbaseio/mirage is a πŸ”Ž GUI for composing Elasticsearch queries
  • exceptionless/Exceptionless is an error (exceptions) collecting and reporting server with client bindings for a various programming languages
  • searchkit/searchkit is a UI framework based on React to build awesome search experiences with Elasticsearch
  • appbaseio/reactivemaps is a React based UI components library for building Airbnb / Foursquare like Maps
  • appbaseio/reactivesearch is a library of beautiful React UI components for Elasticsearch
  • appbaseio/dejavu The missing UI for Elasticsearch; landing page
  • Simple File Server is an Openstack Swift compatible distributed object store that can serve and securely store billions of large and small files using minimal resources.
  • logagent a log shipper to parse and ship logs to Elasticsearch including bulk indexing, disk buffers and log format detection.
  • ItemsAPI simplified search API for web and mobile (based on Elasticsearch and Express.js)
  • Kuzzle - An open-source backend with advanced real-time features for Web, Mobile and IoT that uses ElasticSearch as a database. (Website)
  • SIAC - SIAC is an enterprise SIEM built on the ELK stack and other open-source components.
  • Sentinl - Sentinl is a Kibana alerting and reporting app.
  • Praeco - Elasticsearch alerting made simple
  • DataStation - Easily query, script, and visualize data from every database, file, and API.

Elasticsearch developer tools and utilities

Clients

Development and debugging

  • Sense (from Elastic) A JSON aware developer console to Elasticsearch; official and very powerful
  • ES-mode An Emacs major mode for interacting with Elasticsearch (similar to Sense)
  • Elasticsearch Cheatsheet Examples for the most used queries, API and settings for all major version of Elasticsearch
  • Elasticstat CLI tool displaying monitoring informations like htop
  • Elastic for Visual Studio Code An extension for developing Elasticsearch queries like Kibana and Sense extention in Visual Studio Code
  • Elastic Builder A Node.js implementation of the Elasticsearch DSL
  • Bodybuilder A Node.js elasticsearch query body builder
  • enju A Node.js elasticsearch ORM
  • Peek An interactive CLI in Python that works like Kibana Console with additional features
  • Logstash pipeline parser Python Parsing expression grammar (PEG) and Abstract syntax tree (AST) for Logstash pipeline syntax.

Import and Export

  • Knapsack plugin is an "swiss knife" export/import plugin for Elasticsearch
  • Elasticsearch-Exporter is a command line script to import/export data from Elasticsearch to various other storage systems
  • esbulk Parallel elasticsearch bulk indexing utility for the command line.
  • elasticdump - tools for moving and saving indices
  • elasticsearch-loader - Tool for loading common file types to elasticsearch including csv, json, and parquet

Management

  • Esctl - High-level command line interface to manage Elasticsearch clusters.
  • Vulcanizer - Github's open sourced cluster management library based on Elasticsearch's REST API. Comes with a high level CLI tool

Elasticsearch plugins

Cluster

  • sscarduzio/elasticsearch-readonlyrest-plugin Safely expose Elasticsearch REST API directly to the public
  • mobz/elasticsearch-head is a powerful and essential plugin for managing your cluster, indices and mapping
  • Bigdesk - Live charts and statistics for elasticsearch cluster
  • Elastic HQ - Elasticsearch cluster management console with live monitoring and beautiful UI
  • Cerebro is an open source(MIT License) elasticsearch web admin tool. Supports ES 5.x
  • Kopf - Another management plugin that have REST console and manual shard allocation
  • Search Guard - Elasticsearch and elastic stack security and alerting for free
  • ee-outliers - ee-outliers is a framework to detect outliers in events stored in an Elasticsearch cluster.
  • Elasticsearch Comrade - Elasticsearch admin panel built for ops and monitoring
  • elasticsearch-admin - Web administration for Elasticsearch

Other

  • SIREn Join Plugin for Elasticsearch This plugin extends Elasticsearch with new search actions and a filter query parser that enables to perform a "Filter Join" between two set of documents (in the same index or in different indexes).

Integrations and SQL support

You know, for search

Kibana plugins and applications

Kibana Visualization plugins

  • nbs-system/mapster - a visualization which allows to create live event 3d maps in Kibana
  • Kibana Tag Cloud Plugin - tag cloud visualization plugin based on d3-cloud plugin
  • LogTrail - a plugin for Kibana to view, analyze, search and tail log events from multiple hosts in realtime with devops friendly interface inspired by Papertrail
  • Analyze API - Kibana 6 application to manipulate the _analyze API graphically
  • kbn_network - This is a plugin developed for Kibana that displays a network node that link two fields that have been previously selected.

Discussions and social media

Tutorials

Articles

System configuration

Docker and Elasticsearch

Java tuning

How to start using G1

#ES_JAVA_OPTS=""
ES_JAVA_OPTS="-XX:-UseParNewGC -XX:-UseConcMarkSweepGC -XX:+UseG1GC"

Scalable Infrastructure and performance

Integrations

Logging

Alerts

Time series

Machine Learning

Use cases for Elasticsearch

Other

Videos

Overviews

Advanced

Code, configuration file samples and other gists

Who is using elasticsearch?

Yelp, IFTTT, StackExchange, Raygun, Mozilla, Spotify, CERN, NASA Zalando

I want more! (Elasticsearch related resources)

Contributing

  • Make sure you are about to post a valuable resource that belongs to this list
  • Do NOT group ++Add and --Remove changes in same PR. Make them separate pull requests
  • Use spellchecker
  • All spelling and grammar corrections are welcome (except for the rule above)
  • Fork this repo, do your edits, send the pull request
  • Feel free to create any new sections
  • Do not even try to add this repo to any awesome-awesome-* lists

← Awesome TypeScript -= Awesome Elasticsearch =-

awesome-elasticsearch's People

Contributors

0xflotus avatar anborg avatar cigolpl avatar citybasebrooks avatar damienalexandre avatar dzharii avatar eatonphil avatar hsen-dev avatar ipcenas avatar israelwebdev avatar kr5hn4 avatar marclaporte avatar megastef avatar moshe avatar onesuper avatar p4awd avatar pistocop avatar polyfractal avatar remy-rojas-acc avatar rwynn avatar ryanmaclean avatar segalziv avatar siddharthlatest avatar stephanediondev avatar stjepanjurekovic avatar sunkuet02 avatar tomaskoutek avatar tomsquest avatar yichingwu avatar ywangd avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

awesome-elasticsearch's Issues

URL not working

"Docker and elasticsearch blog post series by blog.codingtimes.com" doesn't exist anymore under that domain.

Sling, a new command line

Hi dzharii,

the Datasweet team (Kibana Datasweet Formula) has realeased a first version of Sling, a collection of elasticsearch command line tools, with query based filtering capabilities.

Among the featured capabilities, Sling allows its users to ingest big datasets from files (currently supporting CSV) with a pretty straightforward method.

Dumping, deleting can be performed using a filtering query.

https://github.com/datasweet/sling-binaries

Would you be kind enough to test it, and maybe add it to your list of useful stuff around Elastisearch?

Best regard,

Lionel

Add section of tools for realtime indexing

such as:

special mention for Lucene NRT

Realtime indexing allow for search results to be in sync with the current state of the database, which is a majorly useful feature.
If I understand correctly, most people use periodic (non-realtime) full patch with tools such as logstash to reindex ELK. I wonder what the industry actually use for this need since the river drivers are unmaintained and hibernate search and zombodb are not well known.

List of managed providers

Hi, I'm missing a list of managed providers like cloud.elastic.io, AWS Elasticsearch, etc. I'm interested in managed solution that supports plugins.

Validate Links

Hello, I wrote a tool that can validate README links (valid URLs, not duplicate). It can be run when someone submits a pull request or a commit is pushed to awesome-elasticsearch.

It is currently being used by many projects including

Examples

If you are interested, connect this repo to https://travis-ci.org/ and add a .travis.yml file to the project.

See https://github.com/dkhamsing/awesome_bot for options, more information
Feel free to leave a comment πŸ˜„

Elasticsearch

Hello,
I need to extract my data logs to visualization on kibana\elasticsearch. I can see my data logs from the log section of kibana, but I don't know how to extract specific data from it.

Any help would be great.

Thank you.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.