Composition of recording filenames and Enigma2 freezes

Ampersand · 9. März 2016, 10:06

I changed option "Composition of the recording filenames" to "Short without date" and whenever jump up, down, left, right within the list of such recorded movies, after a while enigma2 freezes. No crash - just hang up. Whenever such movie is selected on the list but not started yet, debug shows this:

Spoiler anzeigen

09:55:13.833 [e2-core] unicode U+ 10 not present
09:55:13.833 [e2-core] unicode U+e276 not present
09:55:13.951 [e2-core] unicode U+ 10 not present
09:55:13.952 [e2-core] unicode U+e276 not present
09:55:14.072 [e2-core] unicode U+ 10 not present
09:55:14.073 [e2-core] unicode U+e276 not present
09:55:14.194 [e2-core] unicode U+ 10 not present
09:55:14.195 [e2-core] unicode U+e276 not present
09:55:14.313 [e2-core] unicode U+ 10 not present
09:55:14.313 [e2-core] unicode U+e276 not present
09:55:14.433 [e2-core] unicode U+ 10 not present
09:55:14.434 [e2-core] unicode U+e276 not present
09:55:14.554 [e2-core] unicode U+ 10 not present
09:55:14.554 [e2-core] unicode U+e276 not present
09:55:14.674 [e2-core] unicode U+ 10 not present
09:55:14.675 [e2-core] unicode U+e276 not present
09:55:14.795 [e2-core] unicode U+ 10 not present
09:55:14.795 [e2-core] unicode U+e276 not present
09:55:14.915 [e2-core] unicode U+ 10 not present
09:55:14.916 [e2-core] unicode U+e276 not present
09:55:15.036 [e2-core] unicode U+ 10 not present
09:55:15.036 [e2-core] unicode U+e276 not present
09:55:15.156 [e2-core] unicode U+ 10 not present
09:55:15.156 [e2-core] unicode U+e276 not present
09:55:15.276 [e2-core] unicode U+ 10 not present
09:55:15.277 [e2-core] unicode U+e276 not present
09:55:15.397 [e2-core] unicode U+ 10 not present
09:55:15.398 [e2-core] unicode U+e276 not present
09:55:15.518 [e2-core] unicode U+ 10 not present
09:55:15.518 [e2-core] unicode U+e276 not present
09:55:15.638 [e2-core] unicode U+ 10 not present
09:55:15.639 [e2-core] unicode U+e276 not present
09:55:15.759 [e2-core] unicode U+ 10 not present
09:55:15.760 [e2-core] unicode U+e276 not present
09:55:15.879 [e2-core] unicode U+ 10 not present
09:55:15.879 [e2-core] unicode U+e276 not present
09:55:16.000 [e2-core] unicode U+ 10 not present
09:55:16.000 [e2-core] unicode U+e276 not present
09:55:16.120 [e2-core] unicode U+ 10 not present
09:55:16.120 [e2-core] unicode U+e276 not present
09:55:16.240 [e2-core] unicode U+ 10 not present
09:55:16.241 [e2-core] unicode U+e276 not present
09:55:16.361 [e2-core] unicode U+ 10 not present
09:55:16.362 [e2-core] unicode U+e276 not present
09:55:16.481 [e2-core] unicode U+ 10 not present

Spoiler anzeigen

Debug does not stop producing this. It continuosly shows such info, different values depend on selected movie.

Filename without problems:

20160219 1329 - FOX HD - Z archiwum X 7_ Chimera - [serial SF] (The X-Files_ Chimera) (Ep_16) (2000) (USA) [od 12 lat].ts

and with problems:

Z archiwum X 7_ Marka X.ts

markusw · 9. März 2016, 10:11

Try to rename the eit-file of such recording .
You are using EMC or Movielist ?

Ampersand · 9. März 2016, 10:13

Why do you want me to rename eit file? I have tons of such recordings... I use Movielist, not EMC.

Ampersand · 18. März 2016, 00:38

I dig down deeper and looks like it is a bit different story. This problem is not created by Composition of the recording filenames. Whenever epgimport is in use, .eit files are not created properly that is why system freezes due to not recognized characters inside of it. The same epg description displayed on channel list is ok. The one inside .epl files is NOT - cut off, not completed with strange chars at the end. I assume that is is image problem - system are not properly passing epg description to eit file and destroing it at the same time.
More info I posted Edit hgdo: Link removed (see board rules!)

Ampersand · 18. März 2016, 14:28

Pasted from removed link:

Spoiler anzeigen

I just updated EPGImport plugin (from git) to make sure the problem I have is not caused by old one. Plugin itself works perfectly. Here some lines from the log:

[EPGImport] imported 35743 events
[EPGImport] Save last import date and count event
[EPGImport] Wait for parse autotimers 30 sec.
[EPGImport] Run start parse autotimers
[EPGImport] #### Finished ####
[EPGImport] connectionLost [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionFdescWentAway'>: Uh: Filedescriptor went away.
]
[EPGImport] WakeUpTime now set to 1458199367 (now=1458134287)

Let's come to the point...

As topic's title says epg parsed by epgimport are not properly passed to recordings .eit files. Below one example.

Description taken from xml file:

</programme>
<programme start="20160316133000 +0100" stop="20160316142500 +0100" channel="Fox.pl">
<title lang="pl">Z archiwum X 9: Pod powierzchnią</title>
<sub-title lang="pl">[serial SF] (Underneath) (Ep.9) (USA) [od 12 lat]</sub-title>
<desc lang="pl">Nowy Jork, rok 1989. John Doggett chwyta mordercę, Roberta Fassla, który zabił właśnie trzyosobową rodzinę. Trzynaście lat później Fassl wychodzi z więzienia, gdyż analiza próbek DNA wykluczyła jego udział w tej zbrodni. Jednak Agent Doggett jest pewien, że złapał właściwego człowieka i obawia się, że psychopata, będąc na wolności, wkrótce znów zaatakuje W dziewiątym sezonie serialu parę głównych bohaterów Foxa Muldera (David Duchowny) i Danę Scully (Gillian Anderson) zastępują John Doggett (Robert Patrick) i Monica Reyes (Annabeth Gish). Fabuła ostatniej serii koncentruje się na Williamie, synku Scully, i nowej organizacji, która planuje kolonizację Ziemi przez obcych. W ostatnim odcinku ósmej serii przychodzi na świat syn Scully, William. Od początku wiadomo, że chłopiec nie jest zwykłym dzieckiem. Wykazuje zdolności paranormalne. Wiele osób interesuje się jego przyszłością. Nie do końca wiadomo, czy William ma zostać przywódcą buntowników, czy może kolonizatorów kosmosu. Matka w trosce o jego bezpieczeństwo i normalne dzieciństwo oddaje synka do adopcji. Drugim motywem przewodnim jest Nowy Syndykat - organizacja, która po upadku w siódmym sezonie dawnego Syndykatu ma kontynuować plany podboju Ziemi przez obcych. Tworzą ją hybrydy - niezniszczalne istoty zwane również superżołnierzami
John Shiban
Gillian Anderson, David Duchovny, Mitch Pileggi, Robert Patrick
Filmweb: 7.8/10</desc>
</programme>

Above is properly displayed in epg selection but not completely passing it to eit file. Below description of recorded movie.

As you can see description is cut off and some strange chars are added. Not completed description is not a big problem. The main reason I decided to post info about is image freezes during scrolling through the list of such recorded movies. After a while image freezes and power cycle is the only solution to make it work again. It does not recognize strange chars:

14:45:21.677 [e2-core] unicode U+ 10 not present
14:45:21.757 [e2-core] unicode U+ 10 not present
14:45:21.758 [e2-core] unicode U+ 8e not present
14:45:21.765 [e2-core] unicode U+ 10 not present
14:45:21.765 [e2-core] unicode U+ 8e not present

Once .eit files are deleted I am able to scroll through without problems.

markusw · 18. März 2016, 14:46

There will be an update from EPGImport on wednesday - maybe this can help .
LINK

Ampersand · 22. März 2016, 15:11

I am afraid that the topic you point me at is about problem with German epg source in channel list description but I stated above that epg source in my case is correct when displayed on channel list. It is completed without any errors, strange chars etc. It gets broken only when passed to. eit file!

I am sorry that I have to write post after post but I want to make sure it will be read. Remove previous one if necessary.

I did another test. Here you find 2 examples of recorded tv movie. You can test it yourself.
After many tests I still could not find scenario where eit files gets broken so I took one single description and started to modify it. I started to add words "Test". Below you find results.

Rio, I love you.eit is OK:
----------------------------------
Characters 990
words 139
sentences 8
paragraphs 4
Whitespace 137

Spoiler anzeigen

Rio, I love you_001.eit is NOT OK:
------------------------------
Characters 995
words 140
sentences 8
paragraphs 4
Whitespace 138

Spoiler anzeigen

As you can see the length of descriptions is the limit of correct or not .eit file. I do not know what value is the limit and cause that but definitelly one of them. I could not test it with eit epg because simply such long one has not been found so test was based on description from xmltv source.

Hopefully this is enough to be able to fix such problem.

markusw · 22. März 2016, 20:54

I put your files into my movie folder but i cant reproduce your behavior .
What do i have to do for getting it ?

Ampersand · 22. März 2016, 21:21

With only one broken .eit file could be hard to do that, I did not test it with only one. I record series quite often so have lots of them. Try select the one with broken description (Rio, I love you_001), you should see the difference at the end of description

and check debug. You should have something like this:

Spoiler anzeigen

Do you see the timing? During only 2 sec enigma2 produced so much output. Try to leave it for one minute or longer and then remove the movie. With long list of broken eit files it is quit easy to do so. I can also prepare more of them if one is not enough but not today. Let me know if you willing to test wit more broken files. Will try to reproduce enigma2 freeze with one file but have to wait until my recording stops.