Comments (12)
Matt:
Thanks for the report. Looks like I forgot to put the parser_dir attribute in the /opt/scot/etc/alert.cfg.pl sample file. Try inserting the following line at line 2.
parser_dir => '/opt/scot/lib/Scot/Parser',
I'll be adding it to the sample soon, but you don't have to wait on that to try it out. Save the config file with the new line and at the next run of /opt/scot/bin/alert.pl you will hopefully get past that error.
from scot.
from scot.
I added that line and am getting this error now:
Can't located object method "mq" via package "Scot::Env" at /opt/scot/lib/Scot/Collection/Alertgroup.pm line 37.
Then it looked like it hung up and dumped some issues related to IMAPClient.pm line 122. Looks like it just lost connection to the server.
Matt
from scot.
Apologies, the config system was the last thing we updated and our sample configs appear to be somewhat incomplete. Quick fix is to go into /opt/scot/etc/scot.cfg.pl and in the "modules" array, copy the "mq" section to /opt/scot/etc/alert.cfg.pl. modules array.
In other words, put:
{
attr => 'mq',
class => 'Scot::Util::Messageq',
config => {
destination => "scot",
stomp_host => "localhost",
stomp_port => 61613,
},
},
in alerts.cfg.pl right after the line
modules => [
Thanks for the update, I'll be fixing the configs soon.
from scot.
Hi Todd,
There were a few more config hurdles which I resolved. It actually processed 4 alerts then died again with an error: Can't call method "from_addresses" on an undefined value at /opt/scot/lib/Scot/Util/Imap.pm
What can I do to get it past this? Thanks.
from scot.
Matt:
Please include the line numbers if possible, that will help with debugging. (Also sanitized sections of the logs in /var/log/scot will help)
In this case though, the error is indicating that the imap server was not able to get the "envelope" of the email message. If you look through /var/log/scot/scot.mail.log you might see a line containing: "Error from IMAP: " I'd be interested in see what that says. Also you might change "log_level" in etc/alert.cfg.pl to "TRACE" to get a few more details in the log.
I'd also be interested if you mark message 4 as read, will alert.pl continue processing message 5 etc. That would let us know if there is something funky with that message.
from scot.
Hi Todd,
Sorry that line was 497 in the Imap.pm. So the full error was:
Can't call method "from_addresses" on an undefined value at /opt/scot/lib/Scot/Util/Imap.pm line 497.
I turned on TRACE in the alert config to see if I can get more details. Looking at the scot.mail.log file; It looked like it was dying on a large HTML formatted Email coming from Splunk. I have a FAILED to process error which came from Mail.pm and it stuck the whole Email into a $VAR1. These Emails are still getting processed in the older version of SCOT.
Matt
from scot.
Todd,
I cleared out all the Emails for the day where it was dying and it seems to have resolved that. I am on to the next issue which is the ElasticSearch cluster. While it looks to be running I am seeing "500" errors with Firebug when trying to do a search.
"NetworkError: 500 Internal Server Error - https://xxxxxx.xxx.xxx/scot/api/v2/search?qstring=xx 500 Internal Server Error.
I restarted the Elasticsearch service and that didn't resolve it. I will continue to hunt this one down.
Thanks,
Matt
from scot.
Todd,
Concerning the elasticsearch issue if I copy out that URL and run it I see the mojolicious stack trace which is pointing to another issue with the "Scot::Env" Here is the error:
Can't locate object method "es" via package "Scot::Env" at /opt/scot/script/.../lib/Scot/Controller/Search.pm line 83.
Line 83 is: my $esua = $env->es;
Thanks,
Matt
from scot.
Hi Todd,
I figured I needed to add a module for the Elasticsearch in the scot.cfg.pl. I pulled that from the stretch.cfg.pl and added it to scot.cfg.pl.
So I added this to the modules section (scot.cfg.pl.):
**{
attr => 'es',
class => 'Scot::Util::ElasticSearch',
config => {
nodes => [ qw(localhost:9200) ],
},
},**
The environment error went away but it came back with a new error:
Can't locate object method "do_request_new" via package "Scot::Util::ElasticSearch" at /opt/scot/script/../lib/Scot/Controller/Search.pm line 94.
Please let me know if I was on the right track with what I did and if there is something I can do to fix this new error.
Thanks,
Matt
from scot.
OK, first let me apologize profusely. All these problems stem from poorly tested sample configs. I appreciate your patience and perseverance. Replace the "es" section you copied with the following:
{
attr => 'es',
class => 'Scot::Util::ESProxy',
config => {
nodes => [ qw(localhost:9200) ],
max_workers => 1,
proto => 'http',
servername => 'localhost',
serverport => 9200,
username => ' ',
password => ' ',
},
},
We have some bureaucratic hurdles here in releasing frequent updates to github. I'm working on resolving, but until then. anyone reading this string will have to make these updates by hand. I hope to be able to release updates next week.
from scot.
Matt,
Feel free to reopen if this is still unresolved.
from scot.
Related Issues (20)
- install.sh fails to get elasticsearch gpg key HOT 3
- Install script ends abruptly HOT 2
- github linked demo times out HOT 1
- Demo site down ? HOT 5
- Multiple questions HOT 3
- RPM spec HOT 8
- Authentication failure after installation HOT 1
- Docker-Perl does not install HOT 3
- /var/log/mongo directory missing HOT 6
- game exited with code 255 HOT 1
- User Defined Forms Not Persisting Input Data
- Online demo not working HOT 2
- mongodb errors on first-time login HOT 5
- Failed to log in due to bad CSRF token. Please reload the page and then log in. Error: Failed CSRF check HOT 1
- build failed on AArch64, Fedora 33 HOT 6
- Issues with docker-compose.yml HOT 5
- Unable to log in to SCOT - bad CSRF token HOT 1
- How to set Email Injest Parser module for Arcsight HOT 1
- Is there any Docker image of SCOT for development purposes? HOT 1
- Integrate MISP Platform HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from scot.