Lot of programs have missing serie and episode

[pensionado]

Noticed that lately there are a lot of programs where series and episode is missing for example following program:

<title lang="nl">Floortje terug naar het einde van de wereld</title>
In 2014 bezocht Floortje de Engelse dierarts Joe Hollins op het prachtige en extreem geïsoleerde eiland Sint-Helena. Het eiland is inmiddels een stuk minder geïsoleerd.
Overige

had episode and series in the past and when I look at tvgids.nl, there is series and episodes to be found. This has been happening the last few weeks, but wasnt able to pinpoint it till now. Let me know if you need debug info.

[pensionado]

Sorry, the inserted xml was formatted, so here is it again hopefully not formatted:
<programme start="20200322090500 +0100" stop="20200322100000 +0100" channel="0-1"> <title lang="nl">Floortje terug naar het einde van de wereld</title> <desc lang="nl">In 2014 bezocht Floortje de Engelse dierarts Joe Hollins op het prachtige en extreem geïsoleerde eiland Sint-Helena. Het eiland is inmiddels een stuk minder geïsoleerd.</desc> <category lang="nl">Overige</category> <previously-shown/>

[mitchellklijs]

Please have a look at: #48

[hikavdh]

• The html pages from tvgids.nl are unusable as to slow.
• The json feed from tvgids.nl only very recently as had episode info added, it will take some time to seep through or run tv_grab_nl3.py --clear_source 3 to remove all data from tvgids.nl from your database.
• The rtl feed is off-line since January 28th. Unknown when back on-line

[pensionado]

After following all suggestions in #48, I still dont see episode and serie info.

[kyl416]

Can you post your tv_grab_nl3_py.set, tv_grab_nl3_py.log and tv_grab_nl3_py.conf files?

For that specific show it should have fetched the episode numbers from the tvgids.nl detail fetch and it should have gotten the episode title from Horizon or VPRO or via the detail fetch from NPO.nl or humo.

This is what my file has for that show:

  <programme  start="20200322080500 +0000" stop="20200322090000 +0000" channel="1.tvgids.nl">
    <title  lang="nl">Floortje terug naar het einde van de wereld</title>
    <sub-title  lang="nl">Sint-Helena</sub-title>
    <desc  lang="nl">(BNNVARA) In 2014 bezocht Floortje de Engelse dierarts Joe Hollins die op het prachtige en extreem geïsoleerde eiland Sint-Helena woont. Een plek die je alleen kon bereiken met een boottocht van vijf dagen. Inmiddels is er veel veranderd op het eiland en is het een stuk minder geïsoleerd doordat in 2017 een directe verbinding met de bewoonde wereld werd gerealiseerd. Wat heeft deze grote verandering voor impact op het leven daar?</desc>
    <date>2020</date>
    <category>Unknown</category>
    <keyword  lang="nl"/>
    <country>NL</country>
    <episode-num system="xmltv_ns">0 . 4/6 . </episode-num>
    <previously-shown/>
    <rating  system="kijkwijzer">
      <value>AL</value>
      <icon  src="http://tvgidsassets.nl/img/kijkwijzer/al_transp.png"/>
    </rating>
  </programme>

[pensionado]

Please find attached files from yesterdays and todays run.
tvgrab.zip

[kyl416]

You have fast enabled so you aren't grabbing any details that would include the episode numbers. In tv_grab_nl3_py.conf change the line that says "fast = True" to "fast = False"

[pensionado]

That did indeed get the details back, but then I have been running with the setting for over 2 years so something, probably in the sources, has changed which made it disappear.

[kyl416]

Humo's new API now only has the episode numbers in the detail fetches. The old API included everything in the base fetches.

[hikavdh]

More and more sources put the more detailed data on separate detail pages, where the base page only supplies title and start-time. So the --fast setting is mostly useful to get an update on start-times. I run a full fetch at night that takes some 20 min or more and then at 17:00 I run a quick --fast scan for just that day to get any last minute changes in the timings like recently with all the corona related stuff. That last one then only takes a little over 2 min.
There are also some settings to limit the detail and ttvdb fetches.

[Laibalion]

I'm also having issues with getting detail info for certain episodes where at least one of the detail sources has this info.
For example 'Blaze en de monsterwielen' doesn't get season/episode info, while when looking at humo.be/tvgids (https://www.humo.be/tv-gids/nickelodeon-spike/uitzending/aflevering/34ef56b2-b2f2-4c47-94f5-fed86fc4526e), tvgids.nl (https://www.tvgids.nl/tv/blaze-and-the-monster-machines/86461921) or tvgids.tv (https://www.tvgids.tv/tv/blaze-en-de-monsterwielen/24181184) it has this information available somewhere there.
And my config file has fast=False configured.
I've already tried to disabled a few sources, but to no avail.
tv_grab_nl3_py.conf.txt

Anyone that can help me out?

[Laibalion]

In case someone is still looking into this, For me it's mainly the Nickelodeon/Spike channel that is missing it's season/episode info. As far as I understand the source system (it's not quite trivial to wrap my head around), Humo.be is the prime source for this channel, which is also a details source, for some reason the season info is not retrieved from the details, while the description is.

[pensionado]

Still seeing missing season and episode, mainly NPOx, despite following all recommendations.

[hikavdh]

It seems some of the detail pages get some of the details added in at a later stage. I'm thinking and working on scenarios to solve this, but that will take some time.