Add task scheduling system to metagov-core about gateway

[gigxz]

One possibility is to use a celery schedule in Metagov Core, and allow Metagov Plugins to register task functions. Then the Plugin author doesn't have to worry about how the polling works.

  @Registry.plugin
  class MyPlugin(Plugin):

    @Registry.periodic_task
    def poll_events(self):
        """
        Function that gets called every minute/hour/day (however schedule is configured).
        Useful when you can't use a webhook.
        """
        events = requests.get(...) # fetch events from platform API 

        self.handle_event(event) # process event and send to driver

We need to be able to dynamically add and and remove scheduled tasks without restarting Django or Celery, as well as maybe dynamically changing the schedules (hourly/daily/etc) based on the plugin config.

[shaunagm]

I think it would be fantastic for metagov to implement polling - it would make things much easier for plugin authors. I don't really know enough about this topic to make any recommendations, though.

[thelastjosh]

Just to clarify, this meaning of "poll" is "to check", not "to conduct a survey or questionnaire", right?

…

On Fri, Apr 9, 2021 at 9:35 AM Shauna ***@***.***> wrote: I think it would be fantastic for metagov to implement polling - it would make things much easier for plugin authors. I don't really know enough about this topic to make any recommendations, though. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#19 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACHA5PFQKANKU7FO5WOAGQLTH37DDANCNFSM42TMT3LA> .

-- http://www.joshuatan.com/research/

[shaunagm]

Yes, checking, not surveying.

[gigxz]

The instructions to Drivers for how to perform async governance processes was made simpler from this change: https://docs.metagov.org/en/latest/driver_tutorial.html#performing-governance-processes

The instructions for Metagov installation was made more complicated, because of the need to set up Celery: https://docs.metagov.org/en/latest/installation.html