Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

import with lots of errors #181

Closed
cheese1 opened this issue Oct 24, 2020 · 6 comments
Closed

import with lots of errors #181

cheese1 opened this issue Oct 24, 2020 · 6 comments

Comments

@cheese1
Copy link
Contributor

cheese1 commented Oct 24, 2020

my database is mysql and i use the script to update as follows:
[plugin.video.mediathekview (master)]$ python3 mvupdate3 mysql --host 192.168.3.3 --user mediathekview --password XYZ --database mediathekview
2020-10-24 17:01:52.524565 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87, ei...' for column .._description at row 1
2020-10-24 17:01:54.103393 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87: "H...' for column .._title at row 1
2020-10-24 17:01:54.179391 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x99\xC3\xAD H...' for column .._title at row 1
2020-10-24 17:01:54.394733 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87 auf...' for column .._title at row 1
2020-10-24 17:01:54.459545 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x8Dar a...' for column .._title at row 1
2020-10-24 17:01:55.879715 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87 f\xC3\xA4...' for column .._description at row 1
2020-10-24 17:01:56.072916 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x86evap...' for column .._description at row 1
2020-10-24 17:02:01.615727 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xCC\x88r Ph...' for column .._description at row 1
2020-10-24 17:02:03.883864 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC2\x96 geh...' for column .._title at row 1
2020-10-24 17:02:04.052826 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x8Dkai ...' for column .._description at row 1
2020-10-24 17:02:06.107963 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x9Flu \xC3...' for column .._title at row 1
2020-10-24 17:02:07.064595 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xEF\xAC\x81e. ...' for column .._description at row 1
2020-10-24 17:02:07.099838 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87' for column .._title at row 1
2020-10-24 17:02:07.265197 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC2\x85.", ...' for column .._description at row 1
2020-10-24 17:02:07.285761 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87 \xC3\xBCb...' for column .._title at row 1
2020-10-24 17:02:07.451626 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x9Flu b...' for column .._description at row 1
2020-10-24 17:02:07.530342 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xE2\x80\xAF-\xE2\x80...' for column .._description at row 1
2020-10-24 17:02:07.547442 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x9Flu, ...' for column .._description at row 1
2020-10-24 17:02:07.959691 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\xB1 Erd...' for column .._title at row 1
2020-10-24 17:02:07.965798 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC7\x92gan ...' for column .._description at row 1
2020-10-24 17:02:09.155144 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC4\x87, \xC2\xAB...' for column .._description at row 1
2020-10-24 17:02:11.236855 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x99\xC3\xA1k' for column .._title at row 1
2020-10-24 17:02:24.130095 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xCC\x88lder...' for column .._description at row 1
2020-10-24 17:02:30.229158 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1366, 1366 (22007): Incorrect string value: '\xC5\x8D im ...' for column .._title at row 1
@Space2Walker
Copy link

I would say you created the schema yourself and chose the wrong char-set. you must either let mvupdate create the schema or create one with "utf8".

i know that because i made the same mistake yesterday

@cheese1
Copy link
Contributor Author

cheese1 commented Oct 24, 2020

agreed.

@Space2Walker
Copy link

@cheese1 when the problem is resolved you could close the issue. the close button is to the left of the comment button

@cheese1
Copy link
Contributor Author

cheese1 commented Oct 24, 2020

the original problem seems to be fixed. i droped the complete database and started and get a new error with corrupt dates:

2020-10-24 19:28:01.974491 INFO [mvupdate3-0.6.4]: Startup
2020-10-24 19:28:01.974584 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Database driver: External (mysql)
2020-10-24 19:28:01.974637 INFO [mvupdate3-0.6.4:StoreMySQL]: Using MySQL connector version 8.0.20
2020-10-24 19:28:01.986066 INFO [mvupdate3-0.6.4:StoreMySQL]: Connected to server 192.168.3.3 running 10.3.22-MariaDB
2020-10-24 19:28:01.986453 INFO [mvupdate3-0.6.4:StoreMySQL]: === DATABASE mediathekview DOES NOT EXIST. TRYING TO CREATE IT ===
2020-10-24 19:28:03.672523 INFO [mvupdate3-0.6.4:StoreMySQL]: Database creation successfully completed
2020-10-24 19:28:03.672649 INFO [mvupdate3-0.6.4]: Starting up...
2020-10-24 19:28:03.674870 INFO [mvupdate3-0.6.4]: Initiating full update...
2020-10-24 19:28:03.674995 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Cleaning up old downloads...
2020-10-24 19:28:03.675114 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Trying to download Filmliste-akt.xz from https://liste.mediathekview.de/Filmliste-akt.xz...
2020-10-24 19:28:27.260343 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Trying to decompress xz file...
2020-10-24 19:28:31.854611 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Return 0
2020-10-24 19:28:35.565356 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Starting import of 416241 records from ./Filmliste-akt
2020-10-24 19:28:35.565457 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Initializing update...
2020-10-24 19:28:35.641105 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: Filmliste dated 24.10.2020, 18:13
2020-10-24 19:28:35.641242 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:0, shows:0, movies:0 ...
2020-10-24 19:28:42.825144 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:17, movies:1000 ...
2020-10-24 19:28:48.705839 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:48, movies:2000 ...
2020-10-24 19:28:53.660030 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:50, movies:3000 ...
2020-10-24 19:28:58.699584 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (0%): channels:1, shows:50, movies:4000 ...
2020-10-24 19:29:04.235381 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:61, movies:5000 ...
2020-10-24 19:29:09.402064 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:62, movies:6000 ...
2020-10-24 19:29:14.957930 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:62, movies:7000 ...
2020-10-24 19:29:19.910053 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (1%): channels:1, shows:63, movies:8000 ...
2020-10-24 19:29:25.450131 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:1, shows:78, movies:9000 ...
2020-10-24 19:29:31.865751 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:1, shows:89, movies:10000 ...
2020-10-24 19:29:38.254355 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:2, shows:119, movies:11000 ...
2020-10-24 19:29:44.595425 INFO [mvupdate3-0.6.4:MediathekViewUpdater]: In progress (2%): channels:2, shows:155, movies:12000 ...
2020-10-24 19:29:44.723658 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1292, 1292 (22007): Incorrect datetime value: '1965-12-17 15:48:00' for column .._aired at row 1
2020-10-24 19:29:44.731750 ERROR [mvupdate3-0.6.4:StoreMySQL]: Database error: 1292, 1292 (22007): Incorrect datetime value: '1965-12-30 00:00:00' for column .._aired at row 1

@Space2Walker
Copy link

The problem is already known.
It is the same i have #180 and is properly related to #175
We will have do wait for a fix, but for the time your db will working except content with date 1950-1969

@cheese1
Copy link
Contributor Author

cheese1 commented Oct 24, 2020

a great. thanks for pointing me in that diretion

@cheese1 cheese1 closed this as completed Oct 24, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cheese1 @Space2Walker