Memory leak problem about ex_rated

[grempe]

I'll mark this as help wanted as I don't currently have the time to investigate. I suspect there is an edge case at play here though as this lib has been used by others in production for a couple of years now with no similar reports.

@dsnipe Can you provide more information as to how you determined that it was this lib that was seemingly at fault for your server memory issue?

There is an automatic pruning process for old ETS records which should limit the growth of the ETS tables with old buckets.

[grempe]

Interesting. No I don't have any idea why, and I have not been actively using or maintaining this lib to be honest so if you do find a reason a pull request would be greatly appreciated!

[sergiotapia]

@dsnipe This uses ETS for saving bucket information - could it be you're never purging stale bucket data?

[ryanwinchester]

@dsnipe did you ever solve this? I wanted to use this in a production application as well, but now I'm scared to.

[sergiotapia]

@grempe There's also the issue where adding ex_rated to a Phoenix project essentially turns the application single-threaded since every request goes through the exrated genserver. It becomes a bottleneck.

[jaimeiniesta]

@sergiotapia can you please elaborate further in a separate issue? If if makes every request pass through the exrated bottleneck, then that's serious.

[ryanwinchester]

https://dockyard.com/blog/2017/05/19/optimizing-elixir-and-phoenix-with-ets

[sergiotapia]

@jaimeiniesta It makes every single request go through the single genserver process. It is really bad. I didn't notice this issue but Chris McCord mentioned it to me and said it was a major problem; turning Phoenix apps into a single-threaded app.

He then pointed me to this article: https://dockyard.com/blog/2017/05/19/optimizing-elixir-and-phoenix-with-ets

[jaimeiniesta]

But, you mean every single request that uses ExRated, right? Or every single request? It's bad in both cases, but not as bad in the first case.

[dsnipe]

It turned out that ex_rated wasn't a problem. I can close the issue.

[dsnipe]

Thank you everyone and sorry for a false alarm.

[sergiotapia]

@jaimeiniesta Yes, every single request that uses exrated.