yass's People
yass's Issues
Add direct use of other casegrab flags
Expose -n and -f for casegrab and others that may be useful
Add garbagecat parallelism option
Garbagecat can be the most expensive tool run here. With a directory containing many gc logs, this could result in many JVMs swamping the system so it'd be helpful to implement a configurable limit to the number of garbagecats forked in parallel and default it to a sane amount.
Clickable file links
It could be handy to have clickable file links of files summarized by yass
Improve server log error summary
Listing the specific known error occurrences would be more helpful.
Organize files to output directories
It could be helpful to organize found and analyzed files to report directories. All server logs and yala reports to a yass server log directory. All thread dumps and yatda reports to a yass thread dump directory. All gc logs and garbagecat reports to a gc directory. All access logs and summaries to an access log directory. And possibly all heap dumps to a heap dump directory and any hs_err_pids to a crash directory.
Adjustable JAVA_HOME
add an adjustable JAVA_HOME to customize JDK used for garbagecat
Clickable link of exploded files
It could help if the listed exploded files are clickable. 03686735
Request URI long response summary
It'd help to summarize request URIs that are primary contributors to long response times
Kill forked child processes if terminated
Need to trap a signal and kill any lingering child processes like long garbagecats if terminated early.
Improve access log sanity check speed
This could be simplified and run faster based on a first (earliest) and last (latest) log line comparison.
Fast exit after download if no new files downloaded
Clickable link upon completion
It'd help to have directory links for reference once yass is entirely done.
Add case downloading
It would be helpful to leverage casegrab to download case files.
Daily update checks
It'd be helpful to add a once-a-day update mode that updates yass and checks any other things to update once (yala, yass)
Add krashpad
It could help to automatically run krashpad on any hs_err_pid files contained in the directory and sum these up.
Summarize stuck thread messages
It'd help to provide a summary of stuck thread occurrences from server log messages. (counts and stack occurrences)
Don't delete archive after failed decompression
Compressed file will be deleted even if it did not decompress successfully
Configurable krashpad container command
It'd be helpful to allow this to be configurable between docker or podman
Add overall peak response time
Add tracking of overall individual peak response time for each access log file and peak across all access log files
Heap dump summary
At least provide a quick reference of all heap dump files found in the directory.
Ignoreable Casegrab error prevents further processing
May need to ignore casegrab errors as some are not important (like no casegrab.log found if running several casegrabs concurrently).
Minimize output of summaries for 0 files
This could be less chatty.
Report final summary of server logs with known errors
In case of many server logs, it'd help to have a final summary indicating which logs specifically have critical known errors.
Fix incorrect heap dump file extensions
If a heap dump has an incorrect extension (not .hprof), MAT won't open it. So a simple check to correct and fix a file extension automatically would help.
Clear token suggestion
If the oidc token is bad and causing download failures, it'd help to echo out the likely command to remove it and correct that.
Fix file links of thread dump summaries in case of multiple files with peaks
Clickable links are broken for multiple files with the same peak
adjustable garbage cat options
Add a field to adjust garbagecat options
Cap access log parsing
If an access log is quite large and spanning many days, it'll be excessive to process it and summaries will be less helpful anyway. A cap to total timestamp amounts will be helpful.
Sanity check on access log format
It's wasteful processing trying to handle an access log with an unrecognized format currently. Need to more quickly skip these.
improve access log time and add progress indicator
access log summaries can take some time currently so need to improve its efficiency and consider a progress indicator
Implement access log summary
Add more fine grained timestamp directory
Downloading to a more specific time stamp directory could help when pulling data multiple times in a day for a single case
Cache and archive already summarized files
Avoid repeat summaries and processing of unchanged files already handled
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.