Coder Social home page Coder Social logo

silentbuteo2 / webgrabplus-siteinipack Goto Github PK

View Code? Open in Web Editor NEW
160.0 41.0 157.0 222.09 MB

Official user supported WebGrab+Plus Siteini.pack repo

JavaScript 21.67% Mathematica 24.86% Python 53.47%
epg grabber iptv mediacenter pvr kodi mythtv nextpvr argus merge

webgrabplus-siteinipack's People

Contributors

akkradet avatar blackbear199 avatar blantas avatar blueddo avatar chris230291 avatar christoph21x avatar doglover3920 avatar drspockenterprise avatar erkexzcx avatar fazzani avatar forenta avatar francisuk1989 avatar jeanniquini avatar jijo1 avatar kampfader avatar laibalion avatar lam4hound avatar michaelarnauts avatar mr-groch avatar netuddki avatar orhan avatar owenmurr avatar pancronos avatar r00ty-tc avatar silentbuteo2 avatar tdabasinskas avatar trujulu avatar wgmaker avatar znuff avatar zofiel avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

webgrabplus-siteinipack's Issues

Horizon.tv xmltv_ns support?

Is there support for xmltv_ns when using the horizon.tv provider?
If not can this be implemented. I'm using Plex and this requires xmltv_ns as the episode system.

tv.mail.ru.ini: broken channel list generation

Channel list is broken:

<channel update="i" site="tv.mail.ru" site_id="775&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/d/a1/bb0d4cf9eac6dae683eaf60b00bfb.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/5/f2/bf339eabe73c2de2f47d1cec953b6.png&quot;,&quot;url&quot;:&quot;/moskva/channel/1219/&quot;,&quot;name&quot;:&quot;Ностальгия&quot;,&quot;id&quot;:&quot;1219&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/b/c9/b034cf7965db7ef970d9c45b922fc.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/b/78/3a5353c4d5fd1e990a8b47998d20d.png&quot;,&quot;url&quot;:&quot;/moskva/channel/1894/&quot;,&quot;name&quot;:&quot;Food Network&quot;,&quot;id&quot;:&quot;1894&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/3/94/bcde3b2f7c695639d27859d389a68.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/4/75/96c2236f9e08143c01de63afea291.png&quot;,&quot;url&quot;:&quot;/moskva/channel/2274/&quot;,&quot;name&quot;:&quot;Диалоги о рыбалке&quot;,&quot;id&quot;:&quot;2274&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/3/09/335e5f865346efd0ff03aa70b5f8e.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/0/ac/a1e4e29bb2703b0fcfadf2e7f18a5.png&quot;,&quot;url&quot;:&quot;/moskva/channel/1243/&quot;,&quot;name&quot;:&quot;TV5MONDE&quot;,&quot;id&quot;:&quot;1243&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/b/f2/523e625d491d1602d46c51fcbeda4.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/d/97/442ea2f512796048ddb89c1868170.png&quot;,&quot;url&quot;:&quot;/moskva/channel/889/&quot;,&quot;name&quot;:&quot;Ретро&quot;,&quot;id&quot;:&quot;889&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/9/35/b018a91c35e244c51fdf8d987a04b.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/8/13/4bfc97f45449d260df57734aaed5a.png&quot;,&quot;url&quot;:&quot;/moskva/channel/1944/&quot;,&quot;name&quot;:&quot;Техно 24&quot;,&quot;id&quot;:&quot;1944&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/1/1b/e7ee1fbd597576b9665030461b396.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/3/a6/bf2f44b083e186c2000206d099453.png&quot;,&quot;url&quot;:&quot;/moskva/channel/919/&quot;,&quot;name&quot;:&quot;ЕДА&quot;,&quot;id&quot;:&quot;919&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/5/0d/2b1d6e0e40d33522e6a037ff3a7c8.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/d/73/e787c76fc16a8d2613993948baea2.png&quot;,&quot;url&quot;:&quot;/moskva/channel/924/&quot;,&quot;name&quot;:&quot;Усадьба&quot;,&quot;id&quot;:&quot;924&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/0/6f/f2fad760df84d27a410f73bc7c9b0.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/8/42/f949465fb3490c192d5dc012c667f.png&quot;,&quot;url&quot;:&quot;/moskva/channel/1195/&quot;,&quot;name&quot;:&quot;Загородная жизнь&quot;,&quot;id&quot;:&quot;1195&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/a/42/b46dd102eb0670185fd00b481d1d6.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/b/58/5bcdf7688106dc20cdc078412282a.png&quot;,&quot;url&quot;:&quot;/moskva/channel/1244/&quot;,&quot;name&quot;:&quot;Здоровое ТВ&quot;,&quot;id&quot;:&quot;1244&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/b/26/897021c2b3b760464c5ef06c36ed7.png&quot;,&quot;is_promo&quot;:0},{&quot;pic_url&quot;:&quot;/pic/channel_logo/32x32/7/a3/e1bf468d0762c288d3c5cb2b79531.png&quot;,&quot;url&quot;:&quot;/moskva/channel/1282/&quot;,&quot;name&quot;:&quot;Fashion TV&quot;,&quot;id&quot;:&quot;1282&quot;,&quot;pic_url_64&quot;:&quot;/pic/channel_logo/64x64/5/11/b33080c21731ec2f44a019fecb725.png&quot;,&quot;is_promo&quot;:0}]&quot;id&quot;:&quot;" xmltv_id="МАТЧ! Планета">МАТЧ! Планета</channel>

*index_site_id.scrub {multi|"channel":[|"id":"|"}|]}

teleman.pl

   epg correction :
 CHANGED show corrected,
      show with ---- start = 26/06/2017 11:55:00 stop = 26/06/2017 12:40:00 title = Plotkara
      Replaces ----- start = 26/06/2017 11:55:00 stop = 26/06/2017 12:40:00 title = Plotkara

or

(  62/172 ) TELEMAN.PL -- chan. (xmltv_id=Fokus TV PL) -- mode Incremental
iiiii.....................................c
No episode-num matching
episode-num unchanged: odc. 9/13</h2>




    <script>
(function(d, s, id) {
 var js, fjs = d.getElementsByTagName(s)[0];
 if (d.getElementById(id)) return;
 js = d.createElement(s); js.id = id;
 js.src = "http
   epg correction :
 CHANGED show corrected,
      show with ---- start = 26/06/2017 07:05:00 stop = 26/06/2017 08:00:00 title = Determinator
      Replaces ----- start = 26/06/2017 07:05:00 stop = 26/06/2017 08:00:00 title = Determinator

Still making corrections as above

transvision.co.id

It's no longer working, been looking around the website but they don't get answer of what happend and how to fix/workaround it...
But i have been researching and it looks like they added CSRF Token to the input to prevent this program to grab epg from the web... I would love to know if it's possible to call the value of csrf or any possible workaround.

Indonesian epg

Please update or fix the indonesian EPG. Hope you guys have time to check and fix them or update them. Thank U so Much. Please see attached indonesia zip file.
indonesial.zip

zita.be (Belgium)

Site.ini pack goes in error:
[Critical] SiteIni syntax exception:
[Critical] file: siteini.pack/Belgium/zita.be.ini
[Critical] line: 8
[Critical] message:
[Critical] Multiple identical @Revisionision 2 defined

in site ini:

  • @revision 2 - [09/09/2016] Blackbear199
  • Site changes
  • @revision 2 - [11/12/2012] Willy de Wilde
  • Site changes

TV.NU is not working

It seems that tv.nu is not working since Jan 15. I believe they have changed the site ...

This is what the log show:

Unable to update channel Kunskapskanalen
Generic syntax exception:
   message: 
no index page data received from Kunskapskanalen
unable to update channel, try again later
Existing guide data restored!

tvtv.de not working anymore

as the title already says, the siteini for tvtv.de (germany) is not working anymore. Could someone have a look on it?

Switzerland horizon.tv.ch not working anymore

Has anybody an idea ?

Here is the log :

[  Info  ] (   9/53  ) HORIZON.TV.CH -- chan. (xmltv_id=ITV HD) -- mode Incremental
[Warning ] error downloading page: Error: SendFailure (Error writing headers)
[Warning ] pausing 1 of 4 times for 30 seconds before re-try.
[Warning ] error downloading page: Error: SendFailure (Error writing headers)
[Warning ] pausing 2 of 4 times for 60 seconds before re-try.
[Warning ] error downloading page: The request timed out (90sec)
[Warning ] Retry 3 of 4 times
[Warning ] error downloading page: The request timed out (120sec)
[Warning ] Retry 4 of 4 times
[        ] Job finished at 19/01/2017 03:05:43 done in 5m 8s
[Critical] Unhandled Exception
[Critical] 
Index was outside the bounds of the array.
[Critical] 
  at WGconsole.Program.ConsoleApplication (System.String[] args) <0x416bb000 + 0x06c4f> in <filename unknown>:0 
  at WGconsole.Program.Main (System.String[] args) <0x416b2e20 + 0x000a7> in <filename unknown>:0 
[Critical] For detailed info, see log file WebGrab++.log.txt
[Critical] Execution stopped

Thanks

Sky.de stopped working

Unfortunately the Sky plugin stopped working.
I guess it is becaus of the skygo shutdown and staging of skyticket.

Is anyone there who could fix this?
This is the only way to get sky epg.

Thanks!

No images

Using tvvlaanderen and canaldigitaal
Getting the EPG works ok, but can 't get images to show up in Tvheadend

Links are in guide.xml

<title lang="nl">Commuter, The</title>
Amerikaans-Frans misdaaddrama Een zakenman raakt tijdens zijn dagelijkse treinreis betrokken bij een crimineel complot.(n)

Add channel icon

index_urlchannellogo.modify {set|http://icon.telerama.fr/tele/imedia/images_chaines_tra/Transparent/80x80/'config_site_id'.png}

Remove telvis.fi

Telvis.fi website was redesigned in the beginning of July. The site now has program info for one day only so it is basically useless as a data source. That's why I think telvis.fi.ini should be removed from the Finnish ini file section.

skynetdth.com

.ini needs updating..

No longer grabbing data or creating channel list.

Thanks.

Directv ini is causing Webgrab to close and download no other EPG Data

Just noticed that for the last 3 days I've not been getting any updated EPG and after checking the log its the Directv ini thats causing this issue.

Group (0) :
update requested for - 238 - out of - 238 - channels for 7 day(s)
( 1/238 ) DIRECTV.COM -- chan. (xmltv_id=BBC America HD (BBCAHD)) -- mode Force
i
error downloading page: The request timed out (20sec)
Retry 1 of 4 times
error downloading page: The request timed out (40sec)
Retry 2 of 4 times
error downloading page: The request timed out (60sec)
Retry 3 of 4 times
error downloading page: The request timed out (80sec)
Retry 4 of 4 times
Job finished at 23/12/2019 13:27:48 done in 3m 23s

Index was outside the bounds of the array.

at (wrapper stelemref) System.Object.virt_stelemref_sealed_class(intptr,object)
at WGconsole.Q.UrlBuilder (System.String 0, WGconsole.W 1, System.Int32 2, System.Int32 3, System.Boolean 4, WGconsole.K 5) [0x00733] in <82fae152af5c4c379c1328bc94ed3f01>:0
at WGconsole.G.1 (System.String[] 0) [0x00a1e] in <82fae152af5c4c379c1328bc94ed3f01>:0
Unhandled Exception
For detailed info, see log file /root/.wg++/./WebGrab++.log.txt
Execution stopped

cinemagia.ro.ini encrypted

Hello,

Would it be possible to check cinemagia.ro.ini from the Romanian provider folder. Seems to be encrypted.

Thank you,
Dorin

tv.yandex.ru.ini, wrong timezone

site {url=tv.yandex.ru|timezone=UTC|maxdays=6|cultureinfo=ru-RU|charset=UTF-8|titlematchfactor=90}

The Siteini seems uses incorrect timezone=UTC option, whereas input dates in source HTML are in local Moscow time.
The timezone info is just dropped when scraping:

[ Debug ] Debugging information SiteIni
[ Debug ] Element: INDEX_START
[ Debug ] html source written to : /storage/.kodi/userdata/addon_data/service.webgrabplus/html.source.htm
[ Debug ] scrub strings:
[ Debug ] type & arguments : (debug)regex
[ Debug ] regex_expression : "start":"(\d{4}-\d{2}-\d{2}T\d{1,2}:\d{2}:\d{2})[-+]\d{2}:\d{2}"
[ Debug ] Found 1 match(es):
[ Debug ] 2019-11-30T03:40:00
[ Debug ] Element Value(s) :
[ Debug ] ----------begin--element----------
2019-11-30T03:40:00

html.source.htm:

"start":"2019-11-30T03:40:00+03:00"

In result, if we just set correct timezone option, times are crewed up in xmltv output.

pl.canalplus.com.E.ini

works one in 7 propobly 80% no shows in indexpage!

( 1/7 ) PL.CANALPLUS.COM.E -- chan. (xmltv_id=HGTV Home & Garden [23]) -- mode Incremental
iiiii
no shows in indexpage!

Bug on Meuguia.tv

Hi, MeuGuia.tv (Brazil) isn't working.

I found a simple error wich the only chang was
url_index{url|http://meuguia.tv/programacao/|channel|}
to
url_index{url|http://meuguia.tv/programacao/canal|}

Now I was able to see the pages, but can't retrieve the data.
Screenshot Error

Any help or idea ?

custom channel logo & Thumbnail

Thanks for canal plus ini
https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/siteini.pack/Poland/pl.canalplus.com.E.ini

how can I add <icon src = "

something like that

2015
category lang="pl">Serial</category
category lang="pl">Dokumentalny</category
icon src="https://ocdn.eu/program-tv/new-upload-images/images-e69225a7-3390-4b73-b560-ed40a19549c0"/

and one more question
how to change url for custom channel logo

something like that

index_urlchannellogo.modify {set(not "")|MY URL FOR LOGO'index_urlchannellogo'.png}

the .ini file is quite different from the ones I saw before and were easy to edit

Unable to update tvpassport channels.xml

A number of channels have changed names such as Space becoming CTV Sci-Fi so a new channel.xml is needed, but generating one fails.

[ Info ] ( 1/1 ) TVPASSPORT.COM -- chan. (xmltv_id=dummy) -- mode Incremental
[Error ] Unable to update channel dummy
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from dummy
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Debug ] 0 shows in 1 channels
[ Debug ] 0 updated shows
[ Debug ] 0 new shows added

Bug with 2 channel in TVHEBDO.com

There is errors each time I try to download the EPG for SE2 and SE3 channel on TVHebdo.com (Maybe SE4 too is affected but I don't use SE3).

Note that "SE" channel update fine itr's only SE2 and SE3 (and maybe SE4.

Here's the log errors:


Job started at 29/01/2018 13:42:05
[  Debug ] 
[  Debug ] Running  on: Microsoft Windows NT 6.2.9200.0
[  Debug ] Environment: 4.0.30319.42000
[  Debug ] 
[  Debug ] Loading timezone data
[  Debug ] Embedded timezones source: timezone.timezonesdata.txt
[  Debug ] Reading config file: C:\Users\Thérèse\AppData\Local\WebGrab+Plus\WebGrab++.config.xml
[  Info  ] found: C:\Users\Thérèse\AppData\Local\WebGrab+Plus\siteini.pack\Canada\tvhebdo.com.ini -- Revision 02
[  Info  ] found: C:\Users\Thérèse\AppData\Local\WebGrab+Plus\siteini.pack\France\telerama.fr.ini -- Revision 11
[  Info  ] input file C:\OutilsMichel\guide.xml not found   ... created a new one ... 


(  17/38  ) TVHEBDO.COM -- chan. (xmltv_id=SE 2) -- mode Incremental
ii
Unable to update channel SE 2
Generic syntax exception:
   message:
no index page data received from SE 2
unable to update channel, try again later
Existing guide data restored!
(  17/38  ) TVHEBDO.COM -- chan. (xmltv_id=SE 3) -- mode Incremental
ii
Unable to update channel SE 3
Generic syntax exception:
   message:
no index page data received from SE 3
unable to update channel, try again later
Existing guide data restored!

Best Regards :octocat:

teleboy.ch not working anymore

update requested for - 91 - out of - 91 - channels for 2 day(s)
( 1/91 ) TELEBOY.CH -- chan. (xmltv_id=3+) -- mode Incremental
ii
Unable to update channel 3+
Generic syntax exception:
message:
no index page data received from 3+
unable to update channel, try again later
Existing guide data restored!
( 1/91 ) TELEBOY.CH -- chan. (xmltv_id=4+) -- mode Incremental
ii
Unable to update channel 4+
Generic syntax exception:
message:
no index page data received from 4+
unable to update channel, try again later
Existing guide data restored!

I tried from an CH IP address too. Not working.
I think in teleboy api some changes

id xmltv not update using siptv

the id xmltv that are indicate in the files *.channels.xml

do not match the siptv id

off only the use of it's id allows compatibility with smart tv

thank you to correct the id of all files *.channels.xml

to match those of siptv

complete lists on

http://siptv.eu/codes

or

http://siptv.app/codes

eg

in coutry France

channel

TF1

xmltv_id="TF1.fr"

et no

xmltv_id="TF1"

please update for all country and all files *.channels.xml

regression? teleguide.info.ini gives an empty channel list

I get empty channels list with only one entry:

<?xml version="1.0" encoding="UTF-8"?>
<site generator-info-name="WebGrab+Plus/w MDB &amp; REX Postprocess -- version V2.1.11.0 -- Jan van Straaten" site="teleguide.info">
  <channels>
    <channel update="i" site="teleguide.info" site_id="" xmltv_id="">
    </channel>
  </channels>
</site>

It happens until I remove 'alloc' arguments altogether. Then it starts work OK and gives full channel list.

My program is version V2.1.11.0, Linux.

Please, help.

Problem with transvision.co.id

I don't know if this can be fixed by any chance but i'll just leave this here for you to check out,
The EPG is not lining up correctly with the live TV because of how transvision's tv guide style... If you set the date to nothing (like the wg++ did) the guide will show past guide too and that messed up the whole EPG because the program detect it current tv show...

It's the guide problem from transvision but i want to know if you can do workaround about it

Added LN24 Channel to yelotv.be.channels.xml

I've added the new channel "LN24" to yelotv.be.channels.xml

So you just have to ad this line: <channel update="i" site="yelotv.be" site_id="933" xmltv_id="LN24">VLN24</channel> to enable the grabbing of the new channel in the yelotv.be.channels.xml file.

Regards :octocat:

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.