fugary / calibre-web-douban-api Goto Github PK

calibre pc版的插件已更新豆瓣封面问题了。请问，docker版本的calibre-web DouBan.py 会更新吗？

但是界面并没有显示，显示加载失败，想请教一下是什么原因，谢谢

我的操作步骤如下：

1. SSH登录群晖执行sudo -i，输入密码进入root权限。
2. 删除johngong-calibre-web:/usr/local/calibre-web/app/cps/metadata_provider下的douban.py。
3. 下载NewDouban.py v1.1.1到home目录。
4. 执行docker cp NewDouban.py johngong-calibre-web:/usr/local/calibre-web/app/cps/metadata_provider，在群晖docker里能看到NewDouban.py已经成功复制进去。
5. 重启johngong-calibre-web。
6. 搜索元数据，只能显示“搜索错误！!”是为什么？
   

1、作者的链接变由/author变为了/serach

def author_filter(self, a_element):
    a_href = a_element.attrib['href']
    return '/search' in a_href

2、简介内容上层div标签不完整导致包含简介之外的其他内容。剪去</div>之后的内容

book['description'] = ''
if len(summary_element):
     summary = etree.tostring(summary_element[-1], encoding="utf8").decode("utf8").strip()
     book['description'] = summary[0:(summary.index("</div>") + 6)]

怎么启动

描述如题，用的镜像是linuxserver的，挂载.py文件到 /app/calibre-web/cps/metadata_provider/NewDouban.py。容器连不上。。不知是挂载目录有误，还是我忘了做哪一步。。

05:55:03 Traceback(most recent call last):
05:55:03 File"/app/calibre-web/cps.py",line 40,in
05:55:03 from cps.search_metadata import meta
05:55:03 File"/app/calibre-web/cps/search_metadata.py",line 48,in
05:55:03 importlib.import_module("cps.metadata_provider."+ a)
05:55:03 File"/usr/lib/python3.8/importlib/init.py",line 127,in import_module
05:55:03 return _bootstrap._gcd_import(name[level:],package,level)
05:55:03 File"/app/calibre-web/cps/metadata_provider/NewDouban.py",line 7
05:55:03
05:55:03 A
05:55:03 SyntaxError:invalid syntax

获取元数据后，不能正常保存。会提示“标识符不区分大小写，覆盖旧标识符删除图书”，也会出现只能删除数据库记录的情况。似乎是获取的数据格式不兼容。
calibre-web 0.6.21

搜书的元数据的时候，搜索页无结果。第一行显示 搜索错误，第二显示 加载中...再后面都是空白。
单选google刮削结果能出来
单选douban不行
双选google和豆瓣也不行。

下面是日志：
[2022-02-24 20:00:54,033] ERROR {cps:1457} Exception on /metadata/search [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 2073, in wsgi_app
response = self.full_dispatch_request()
File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1518, in full_dispatch_request
rv = self.handle_user_exception(e)
File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1516, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1502, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
File "/usr/local/lib/python3.8/dist-packages/flask_login/utils.py", line 272, in decorated_view
return func(*args, **kwargs)
File "/app/calibre-web/cps/search_metadata.py", line 133, in metadata_search
data.extend([asdict(x) for x in future.result()])
File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
return self.__get_result()
File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
result = self.fn(*self.args, **self.kwargs)
TypeError: search() takes from 2 to 3 positional arguments but 4 were given

大佬您好！我使用群晖johngong的docker版本，calibre_web版本是0.6.18，将metadata_provider文件夹中别的文件全部删除，只留了NewDouban.py一个文件，搜索时结果是空白，请问有可能是哪里出了问题？

在豆瓣刮削太多次会出现错误(大概50本左右吧)，第二天就好了，不管是calibre-web本身的豆瓣还是这个插件好像都有这问题，作者有遇到吗

成功添加了NewDouban 的源，并且可以更新除封面外的所有元数据。
calibre-web 报错：下载封面时出错

手动尝试把豆瓣网页上，书籍封面的链接填写在元数据表格中，有的可以成功获取封面，有的不能，报同样的错：下载封面时出错。

我使用豆瓣获取图书信息后，在封面那一览会自动填入封面网址信息，但是每次都会出现错误提示：

“You are not allowed to access localhost or the local network for cover uploads”

但同时也提示：已成功更新元数据

如果把封面那一栏留空，就不会出现这个。
请问这是什么问题？是我哪里没有设置好吗？

补充一下，上传电脑中的图片就没有这样的问题。

23年12月
系统：威联通 NAS
安装模式：johngong的calibre-web docker。配置正常，可正常运行。
docker内的环境：
calibre版本 0.6.21 python版本3.11.6 flask版本2.3.3 requests版本2.31.0

安装脚本后，进入获取元数据页面，可以看到new douban books这个tab。
能正常显示douban的书籍信息、包括封面、isbn、简介。
点击某个封面能正常获取除了封面之外的其他数据。
就是无法获得封面图。

与issue #5 的问题相同。

主要是因为上游[4f3c39]中对cps/search_metadata.py和cps/services/Metadata.py的更改。

Metadata的search方法增加了locale参数，并修改返回类型为List[MetaRecord]。

也就是说版本0.6.17对metadata_provider产生了breaking change，无法与前面的版本兼容了。

以下为日志：

[2022-03-11 05:07:57,224] ERROR {cps:1457} Exception on /metadata/search [POST]
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 2073, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1518, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1516, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1502, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
  File "/usr/local/lib/python3.8/dist-packages/flask_login/utils.py", line 272, in decorated_view
    return func(*args, **kwargs)
  File "/app/calibre-web/cps/search_metadata.py", line 133, in metadata_search
    data.extend([asdict(x) for x in future.result()])
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
    return self.__get_result()
  File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/usr/lib/python3.8/concurrent/futures/thread.py", line 57, in run
    result = self.fn(*self.args, **self.kwargs)
TypeError: search() takes from 2 to 3 positional arguments but 4 were given

添加传入参数后：

[2022-03-11 05:28:23,011] ERROR {cps:1457} Exception on /metadata/search [POST]
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 2073, in wsgi_app
    response = self.full_dispatch_request()
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1518, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1516, in full_dispatch_request
    rv = self.dispatch_request()
  File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1502, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
  File "/usr/local/lib/python3.8/dist-packages/flask_login/utils.py", line 272, in decorated_view
    return func(*args, **kwargs)
  File "/app/calibre-web/cps/search_metadata.py", line 133, in metadata_search
    data.extend([asdict(x) for x in future.result()])
  File "/app/calibre-web/cps/search_metadata.py", line 133, in <listcomp>
    data.extend([asdict(x) for x in future.result()])
  File "/usr/lib/python3.8/dataclasses.py", line 1072, in asdict
    raise TypeError("asdict() should be called on dataclass instances")
TypeError: asdict() should be called on dataclass instances

对DoubanBookHtmlParser进行修改后可以正常使用：

    def parse_book(self, url, book_content):
        book = MetaRecord(
            id = "",
            title = "",
            authors = "",
            url = "",
            source=MetaSourceInfo(
                id=PROVIDER_ID,
                description=PROVIDER_NAME,
                link="https://book.douban.com/"
            )
        )
        html = etree.HTML(book_content)
        title_element = html.xpath("//span[@property='v:itemreviewed']")
        book.title = self.get_text(title_element)
        share_element = html.xpath("//a[@data-url]")
        if len(share_element):
            url = share_element[0].attrib['data-url']
        book.url = url
        id_match = self.id_pattern.match(url)
        if id_match:
            book.id = id_match.group(1)
        img_element = html.xpath("//a[@class='nbg']")
        if len(img_element):
            cover = img_element[0].attrib['href']
            if not cover or cover.endswith('update_image'):
                book.cover = ''
            else:
                book.cover = cover
        rating_element = html.xpath("//strong[@property='v:average']")
        book.rating = self.get_rating(rating_element)
        elements = html.xpath("//span[@class='pl']")
        book.authors = []
        book.publisher = ''
        for element in elements:
            text = self.get_text(element)
            if text.startswith("作者"):
                book.authors.extend([self.get_text(author_element) for author_element in filter(self.author_filter, element.findall("..//a"))])
            elif text.startswith("译者"):
                book.authors.extend([self.get_text(author_element) for author_element in filter(self.author_filter, element.findall("..//a"))])
            elif text.startswith("出版社"):
                book.publisher = self.get_tail(element)
            elif text.startswith("副标题"):
                book.title = f"{book.title}:{self.get_tail(element)}"
            elif text.startswith("出版年"):
                book.publishedDate = self.get_tail(element)
            elif text.startswith("丛书"):
                book.series = self.get_text(element.getnext())
        summary_element = html.xpath("//div[@id='link-report']//div[@class='intro']")
        book.description = ''
        if len(summary_element):
            book.description = etree.tostring(summary_element[-1], encoding="utf8").decode("utf8").strip()
        tag_elements = html.xpath("//a[contains(@class, 'tag')]")
        if len(tag_elements):
            book.tags = [self.get_text(tag_element) for tag_element in tag_elements]
        return book