Rearview::MonitorService crashing on startup about rearview

[danmayer]

Hmmm interesting. I feel like I recently saw one of those in our system as well. I will see if I can get someone from the rearview team to take a look. Thanks for reporting and good to hear from you @tarcieri ;)

[talbright]

Hey there @tarcieri! I didn't see this before, I guess my notification settings are wrong. Are you still having this problem?

[tarcieri]

I am indeed! Still trying to figure it out too o_O

I'll be taking another look at it today and can get you more info then. I was hoping there would be some other associated exception, but I'm not seeing it in the logs.

[talbright]

Ok. Double check your config/initializers/rearview.rb as well, I think I saw something like this a long time ago and it ended up being configuration related.

[tarcieri]

It quite likely is, I'm just not sure what exactly is misconfigured

[talbright]

This might catch the problem:

$ rake RAILS_ENV=production rearview:config:verify

[tarcieri]

Will give that a try, thanks!

[tarcieri]

Well, that found a few things wrong, but now I get:

validating...PASSED

And it's still crashing with the same error.

[talbright]

Is your jdk and jruby version on the build matrix:

https://travis-ci.org/livingsocial/rearview-engine

[tarcieri]

We're using this:

jruby 1.7.3 (1.9.3p385) 2013-02-21 dac429b on Java HotSpot(TM) 64-Bit Server VM 1.7.0_17-b02 [linux-amd64]

I can try upgrading JRuby. In the meantime I can provide another pointer... things seem to be going amiss here:

https://github.com/livingsocial/rearview-engine/blob/master/lib/rearview/monitor_service.rb#L25

Here, @jobs.values is []

It seems that even trying to reference (i.e. print out or call) @supervisor crashes the program. If I comment out L25 and try to start the supervisor from the console:

irb(main):001:0> Rearview::MonitorSupervisor.run!
=> #<Celluloid::ActorProxy(Rearview::MonitorSupervisor:0x2cc0) @registry=#<Celluloid::Registry:0x7d26297b @registry_lock=#<Mutex:0x546d8a6d>, @registry={}> @members=[]>

Very strange...

[talbright]

Very strange! I seem to be guarding against nil and an empty [] correctly in the MonitorSupervisor. Which JDK (oracle, openjdk,etc)?

[talbright]

@tarcieri it does look like the build fails with jruby-1.7.2 (with openjdk{6,7}). It could be coincidence -- I'll have to dig more into it later

https://travis-ci.org/livingsocial/rearview-engine/builds/27228811

[tarcieri]

I seem to recall numerous bugs in earlier versions of JRuby and Celluloid ;). I'll try updating JRuby.

[talbright]

Cool...let me know how it goes. If its still busted I'll keep working with you on it until we figure it out.

[tarcieri]

Quick update: looks like upgrading JRuby fixed the problem.

We're still having some issues but they're unrelated to this.

[talbright]

👍

I'm working on a vagrant setup, which will make it at least easier for people to test drive rearview.