[RDD] rdimport dropbox crashed

Keywan Najafi Tonekaboni lists at prometoys.net
Tue Jan 27 21:29:21 EST 2015


Hi,

I mentioned earlier on this list, that all my dropboxes stopes, but just
a few did start again. I hunt the problem, but I'm still clueless.

First I have this (all quotes from syslog):
> Jan 27 15:54:56 lisa rdcatchd: rdcatchd new connection open

I don't know, why there is a new connection or the dropboxes stopped.

Then rivendell itself tries to restart the dropboxes:
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=46 --drop-box --log-mode --add-scheduler-code="xTauschord" --normalization-level=-13 --autotrim-level=-65 "--metadata-pattern=%a - %i." --delete-source --set-user-defined=newrota --startdate-offset=0 --enddate-offset=0 MUSIK "/srv/rivendell/incoming/rotation/*" >> /srv/rivendell/log/dropbox-rotation.log 2>> /srv/rivendell/log/dropbox-rotation.log &"
> (...)
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=28 --drop-box --log-mode --normalization-level=-13 --autotrim-level=-65 --to-cart=1 "--metadata-pattern=%i." --delete-source --create-startdate-offset=0 --create-enddate-offset=21 --startdate-offset=0 --enddate-offset=0 AUTO_TT "/srv/rivendell/incoming/trailer-auto/*" >> /srv/rivendell/log/dropbox-trailer-auto.log 2>> /srv/rivendell/log/dropbox-trailer-auto.log &"

But then it fails with this error:


> Jan 27 15:55:02 lisa rdcatchd: invalid SQL or failed DB connection[Lost connection to MySQL server during query QMYSQL3: Unable to execute query]: select SCHED_CODE from DROPBOX_SCHED_CODES where DROPBOX_ID=29
> Jan 27 15:55:02 lisa rdcatchd: Database connection failed : select SCHED_CODE from DROPBOX_SCHED_CODES where DROPBOX_ID=29
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=29 --drop-box --log-mode --normalization-level=0 --autotrim-level=0 --startdate-offset=0 --enddate-offset=0  "" > /dev/null 2> /dev/null &"
> Jan 27 15:55:03 lisa rdcatchd: rdcatchd dropped connection
> Jan 27 15:55:52 lisa rdcatchd: Database connection restored.

But there shouldn't be a scheduler code for dropbox with id=29. I use
schedular code assigning only for dropboxes 46 and 33.

It should had started 19 dropboxes, but only 5 get started. I had this
problem last week with a total different drobox. I opened rdadmin and
add a random schedcode to this dropbox. Closed and opened again, removed
the schedcode and closed rdadmin. I thought, maybe there is a bug the
database and this will fix it. That helped at least for a week (before
the dropboxes crashed each few hours)

grep "launching dropbox configuration" in syslog and counting
(grep ... | cut -d: -f2-4 | sort -rn | uniq -c)
>      19 Jan 27 18:14:55 lisa rdcatchd
>       6 Jan 27 15:55:02 lisa rdcatchd
>      19 Jan 23 13:51:44 lisa rdcatchd
>      19 Jan 23 13:48:13 lisa rdcatchd
>      19 Jan 23 10:59:19 lisa rdcatchd
>       8 Jan 22 18:14:22 lisa rdcatchd
>      19 Jan 22 18:14:14 lisa rdcatchd
>      19 Jan 22 18:13:32 lisa rdcatchd
>      16 Jan 22 18:13:05 lisa rdcatchd
>      19 Jan 22 16:51:14 lisa rdcatchd
>       9 Jan 22 14:50:29 lisa rdcatchd
>      19 Jan 20 09:44:55 lisa rdcatchd
>       9 Jan 20 09:44:32 lisa rdcatchd

It should be 19 all the time.

I saw another import error:
> Jan 27 08:44:42 lisa rdimport: invalid SQL or failed DB
> connection[MySQL server has gone away QMYSQL3: Unable to execute
> query]: select FILE_DATETIME from DROPBOX_PATHS where
> (DROPBOX_ID=31)&&(FILE_PATH="/srv/rivendell/incoming/jingles/R??ckspiegel\ Jingle.mp3")

This seems to occur from time to time, but the files get imported
correctly (even though they included umlauts in the filename).

Any hints?

Maybe the MYSQL-connection is lost on that moment and rivendell can't
handle the exception here?

Best,

Keywan


P.S.: Here the "full" logs.
> 
> Jan 27 15:54:56 lisa rdcatchd: rdcatchd new connection open
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=46 --drop-box --log-mode --add-scheduler-code="xTauschord" --normalization-level=-13 --autotrim-level=-65 "--metadata-pattern=%a - %i." --delete-source --set-user-defined=newrota --startdate-offset=0 --enddate-offset=0 MUSIK "/srv/rivendell/incoming/rotation/*" >> /srv/rivendell/log/dropbox-rotation.log 2>> /srv/rivendell/log/dropbox-rotation.log &"
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=44 --drop-box --log-mode --normalization-level=-13 --autotrim-level=-65 "--metadata-pattern=%i." --delete-source --set-user-defined=newnewnew --startdate-offset=0 --enddate-offset=0 MUSIK_ALT "/srv/rivendell/incoming/musik-alt/*" >> /srv/rivendell/log/dropbox-musik-alt.log 2>> /srv/rivendell/log/dropbox-musik-alt.log &"
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=47 --drop-box --log-mode --normalization-level=-13 --autotrim-level=-65 --to-cart=7 "--metadata-pattern=%i+" --delete-source --create-startdate-offset=1 --create-enddate-offset=6 --startdate-offset=0 --enddate-offset=0 AUTO "/srv/rivendell/incoming/hoersaal/*" >> /srv/rivendell/log/dropbox-hoersaal.log 2>> /srv/rivendell/log/dropbox-hoersaal.log &"
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=27 --drop-box --log-mode --normalization-level=-13 --autotrim-level=-65 --to-cart=200 "--metadata-pattern=%i." --delete-source --startdate-offset=0 --enddate-offset=0 AUTO_TT "/srv/rivendell/incoming/teaser-auto/*" >> /srv/rivendell/log/dropbox-teaser-auto.log 2>> /srv/rivendell/log/dropbox-teaser-auto.log &"
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=28 --drop-box --log-mode --normalization-level=-13 --autotrim-level=-65 --to-cart=1 "--metadata-pattern=%i." --delete-source --create-startdate-offset=0 --create-enddate-offset=21 --startdate-offset=0 --enddate-offset=0 AUTO_TT "/srv/rivendell/incoming/trailer-auto/*" >> /srv/rivendell/log/dropbox-trailer-auto.log 2>> /srv/rivendell/log/dropbox-trailer-auto.log &"
> Jan 27 15:55:02 lisa rdcatchd: invalid SQL or failed DB connection[Lost connection to MySQL server during query QMYSQL3: Unable to execute query]: select SCHED_CODE from DROPBOX_SCHED_CODES where DROPBOX_ID=29
> Jan 27 15:55:02 lisa rdcatchd: Database connection failed : select SCHED_CODE from DROPBOX_SCHED_CODES where DROPBOX_ID=29
> Jan 27 15:55:02 lisa rdcatchd: launching dropbox configuration: "nice rdimport --persistent-dropbox-id=29 --drop-box --log-mode --normalization-level=0 --autotrim-level=0 --startdate-offset=0 --enddate-offset=0  "" > /dev/null 2> /dev/null &"
> Jan 27 15:55:03 lisa rdcatchd: rdcatchd dropped connection
> Jan 27 15:55:52 lisa rdcatchd: Database connection restored.
> 

> Jan 27 08:44:42 lisa rdimport: invalid SQL or failed DB connection[MySQL server has gone away QMYSQL3: Unable to execute query]: select FILE_DATETIME from DROPBOX_PATHS                          where (DROPBOX_ID=31)&&(FILE_PATH="/srv/rivendell/incoming/jingles/R??ckspiegel\ Jingle.mp3")
> Jan 27 08:51:05 lisa rdimport: invalid SQL or failed DB connection[MySQL server has gone away QMYSQL3: Unable to execute query]: select FILE_DATETIME from DROPBOX_PATHS                          where (DROPBOX_ID=38)&&(FILE_PATH="/srv/rivendell/incoming/wort/King\ Crismon\ -\ 21th\ Century\ Schizoid\ Man\ \(ohne\ Anmod\).mp3")
> Jan 27 11:29:11 lisa rdimport: invalid SQL or failed DB connection[MySQL server has gone away QMYSQL3: Unable to execute query]: select FILE_DATETIME from DROPBOX_PATHS                          where (DROPBOX_ID=32)&&(FILE_PATH="/srv/rivendell/incoming/mensaplan/Mensaplan\ Dienstag\ 27.01..MP3")
> Jan 27 11:42:38 lisa rdimport: invalid SQL or failed DB connection[MySQL server has gone away QMYSQL3: Unable to execute query]: select FILE_DATETIME from DROPBOX_PATHS                          where (DROPBOX_ID=30)&&(FILE_PATH="/srv/rivendell/incoming/infakt/InFakt\ Nachrichten\ am\ 27.01.a.wav")
> Jan 27 13:26:18 lisa rdimport: invalid SQL or failed DB connection[MySQL server has gone away QMYSQL3: Unable to execute query]: select FILE_DATETIME from DROPBOX_PATHS                          where (DROPBOX_ID=36)&&(FILE_PATH="/srv/rivendell/incoming/vtipps/V-Tipps\ Dienstag\ 27.01..MP3")
> Jan 27 15:14:32 lisa rdimport: invalid SQL or failed DB connection[MySQL server has gone away QMYSQL3: Unable to execute query]: select FILE_DATETIME from DROPBOX_PATHS                          where (DROPBOX_ID=37)&&(FILE_PATH="/srv/rivendell/incoming/wiederholung_vorproduziert/letat_rantanplan.MP3")
> 


-- 
Redakteur Hertz 87.9
 
Hertz 87.9 - CampusRadio für Bielefeld
www.radiohertz.de



More information about the Rivendell-dev mailing list