tgbugs / hyputils

python utilities for hypothes.is

hyputils

python utilities for working with the hypothes.is api and websocket interface

Config files

zendeskinfo.yaml should contain

zdesk_url: https://yoururl.zendesk.com
zdesk_email: [email protected]
zdesk_password: your_token_or_password
zdesk_token: True

Usage

hyputils checks the following enviornment variables

1. HYP_API_TOKEN is your api token.
2. HYP_USERNAME is your username (not strictly required).
3. HYP_GROUP is the 8 char group identifier.

Fun!

If you never modify your annotations, but instead only add new replies to modify them you can view a snapshot of the state of your annotation work and understanding at time T by simply excluding all anotations with updated > T!

hyputils's Issues

existence of memoization files is non-obvious

per group memoization

There are many nasty issues that come from having annotations from more than one group in the same file. Either figure out how to support multiple groups in the same pickle, or have per group memfiles.

depopulate tags issues

annos updated, memoizing new version with, 4111 members
[2019-02-13 13:39:13,007] - DEBUG - hyputils.hypothesis - Removing Hybrid.byId('-ktWpC71EemG-WPumDX8GQ') from 2 tag sets
Exception in thread Thread-1:
Traceback (most recent call last):
  File "/usr/lib64/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib64/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "/home/tom/git/hyputils/hyputils/subscribe.py", line 220, in loop_target
    loop.run_until_complete(ws_loop(loop))
  File "/usr/lib64/python3.6/asyncio/base_events.py", line 468, in run_until_complete
    return future.result()
  File "/home/tom/git/hyputils/hyputils/subscribe.py", line 195, in ws_loop
    await process_or_exit(ws, handler, exit_reader)
  File "/home/tom/git/hyputils/hyputils/subscribe.py", line 140, in process_or_exit
    raise future.exception()
  File "/home/tom/git/hyputils/hyputils/subscribe.py", line 117, in process_messages
    handler.process(msg)
  File "/home/tom/git/hyputils/hyputils/subscribe.py", line 24, in process
    fh(message)
  File "/home/tom/git/hyputils/hyputils/handlers.py", line 22, in __call__
    self.handler(message)
  File "/home/tom/git/hyputils/hyputils/handlers.py", line 84, in handler
    out.append(helper(anno, self.annos))
  File "/home/tom/git/protc/protcur/protcur/analysis.py", line 347, in __new__
    return HypothesisHelper.__new__(cls, anno, annos)
  File "/home/tom/git/hyputils/hyputils/hypothesis.py", line 723, in __new__
    obj.depopulateTags()
  File "/home/tom/git/hyputils/hyputils/hypothesis.py", line 692, in depopulateTags
    tset.remove(self)  # this should never error if everything is working correctly
KeyError: <unprintable KeyError object>

consider sqlite or similar for Memoizer

Groups that make frequent updates via the websocket have all sorts of synchronization and performance updates.