[RDD] rdimport constant import error SOLVED !?!?! - I am not so sure.

Robert Jeffares jeffares.robert at gmail.com
Tue Nov 16 03:11:53 EST 2010


andy

find will drill down in any directory and if it is a windows share on a 
linux box it can still find the files and then -exec rdimport the meta 
data has me puzzled
  the _ should work unless the keyboards are different on the windows 
box to the linux box.

73

Robert
Big valley Radio

Thames


  On 14/11/2010 09:17, VE4PER/Andy wrote:
> Frederick et al,
>
> I spent a weekend, a couple of weeks back ripping all of my CD's into 
> a windows machine. I had read the RD help info for
> rdimport and the understanding I had from the help text was that the 
> filename format expected by rdimport was flexible enough
> to allow me to use whatever text separator I wanted in the file name 
> to separate the artist, title,album, and genre(user defined).
>
> With this in mind, I used a ripper and was able to set up a template 
> as outlined in the last four paragraphs of the help page
> located at 
> *http://blogs.adobe.com/insidesound/2009/03/audition_3_timesaver_generatin.html 
> * that
> complied with what I originally understood, from the RD help file, was 
> needed by rdimport. I proceeded to rip
> approximately 2000 selections this way.
>
> Unfortunately, the help file didn't tell me that all files had to be 
> ripped into a single folder, so in accordance with 'Peter's Principle'
> I wrongly assumed that RD would use commercially available media 
> player default folder structure standards, and proceeded to
> rip to a folder structure as below:
>
>                                             /var/music/artist
>                                                                     
>     /album 1
>                                                                     
>                  /artist-selection1-album1-genre.wav
>                                                                     
>                  /artist-selection2-album1-genre.wav
>                                                                     
>                  /artist-selection3-album1-genre.wav
>                                                                     
>     /album 2
>                                                                     
>                  /artist-selection1-album2-genre.wav
>                                                                     
>                  /artist-selection2-album2-genre.wav
>                                                                     
>                  /artist-selection3-album2-genre.wav
>
>
>
> I soon discovered that RD had it's own standard input format, and had 
> to individually or batch copy all the
> wav files into a single folder as well, essentially temporarily  at 
> least, doubling disk space use.  To make
> matters worse, I had to do this on a windows box, as it had to run in 
> the background so that I could make use
> of the time using adobe premiere at the same time (Linux version of 
> premiere not available).
>
>
> Disk space being at a premium, I was able to mount the windows 
> partition in linux and make the single folder
> collection available to rdimport. rdimport being in /usr/bin and owned 
> and run by root, the same as all the other
> internal RD utilities/apps, I was able to log onto linux using my own 
> user id, so I could access the NTFS partition,
> and by changing the linux /var/snd properties, temporarily to make me 
> the owner with rivendell as the group, I
> was able (after finally getting a metadata pattern that would allow 
> import)rdimport all files into carts.
> On completion of the import process, I then changed the owner and 
> group of /var/snd back to chown -R rduser:rivendell .
>
> Feeling somewhat relieved, finally, I restarted the box and proceeded 
> to follow the rest of the RD Ops Guide
> procedures. Relief soon was replaced by further frustration, caused of 
> course by the delimiters used in the
> audio file names. Although the files were imported properly, and 
> useable, the information for artist, album and title
> and genre had not been recognized and parsed out properly; instead the 
> full filename was placed in each of the
> title and artist columns and nothing was inserted into the album 
> field. Additionally, additional text string, "Imported from "
> had been added to the front of the file names, making it impossible to 
> see the selection name in the rdairplay viewable
> windows. Hmmm....what to do, after all 2000 is a lot of files to go in 
> and change....I know!  use MySQL Query browser
> and update the fields properly will at least let me do this in 
> batches; after all it is only text info fields and not used as
> primary or secondary keys in the database anywhere else, according to 
> the readme and help files....
>
> Restart the box to ensure all db changes are read into the application.
>
> Eureka! it works... I am able to do an unattended test 24/7 now. I am 
> able to see the selection names. (further text refinements
> still needed, but not a hold-up any more).
>
> WOW, that was quite a learning experience... maybe I can help others 
> with existing audio libraries to avoid all this frustration?
> I know I will reply to the mail list and only have to type it once 
> into the archive so others will have the benefit of my
> experiences.
>
> Hmmm   maybe the rdimport help file online could be amended to tell 
> anyone new to the rivendell experience, to copy
> their existing music library (for import into RD) into a SINGLE folder 
> ( structured /var/music).
>
> Ensure the individual filenames are formatted such that they conform 
> to this template:  "Artist_Selection_Album_Genre.ext"; with EMPHASIS
> on using UNDERSCORE as the separators in the original filenames.
>
> This would also hold true when setting up a commercially available 
> media player/ripper program as well. Connect it to Freedb.org and set 
> the rip template up so that the filename conforms to the UNDERSCORE 
> requirements in the individual filenames and also set it to collect 
> all files into the single folder /var/music.
>
> When you put the CD in to rip, it will connect to the freedb.org site 
> and insert the data into the filenames automatically, saving the file 
> in /var/music.
>
> Now, when you run rdimport ensure that the metadata pattern option is 
> set up to use UNDERSCORE as the separators between %a %t %l and %u
> hopefully the program should take the parts of the filename and place 
> them in the appropriate columns in the mysql database. Beware, also
> that you will have the "Imported from " added to the front on the 
> field visible on the RDairplay display, which may or may not affect your
> ability to see the name in the window.
>
>
> My experience has shown that the COMMA served as a form of acceptable 
> ESC delimiter that allowed import to continue, and as others
> have indicated in this forum the SLASH character is the ESC correct 
> character to use in the metadata pattern if you are importing an existing
> library whose filenames do not use UNDERSCORE.
>
> For those who have used the program for eons, this is second nature; 
> for newbies not so much! Hopefully my experience can help others new
> to RD to avoid a lot of extra work.
>
> Please take this in the spirit it is given and not as a slam against 
> what exists.
>
> Blessings
>
> de Andy
>
>
>
>
>
>
>
>
> Frederick Henderson wrote:
>> On Sat, 13 Nov 2010 17:31:19 +0100, Marius Radiokæll Qtronix
>> <qtronix at halden.net>  wrote:
>>
>>    
>>> I know this, Fred, but that doesn't help. Doesn't seem like the parser
>>> accepted that. ;)
>>>
>>> -
>>> Marius Radiokæll Qtronix
>>>      
>> Then try quotes like so:
>>
>> "Artist - Title.ext"
>>
>> If that does not work try using a file renaming tool to replace spaces
>> with underscores.
>>
>> Frederick Henderson
>>
>>    
>>> On lør, november 13, 2010 16:17, Frederick Henderson wrote:
>>>      
>>>> On Sat, 13 Nov 2010 15:33:02 +0100, Marius Radiokæll Qtronix
>>>> <qtronix at halden.net>  wrote:
>>>>
>>>>        
>>>>> Ok, all this metadata-parsing leads me to a question:
>>>>>
>>>>> Say I have filenames formatted with spaces around the delimiter like
>>>>> Artist - Title.ext.
>>>>> What would I have to specify in the metadata-argument of rdimport?
>>>>> Can I somehow escape the spaces without the parser messing up?
>>>>>
>>>>>          
>>>> It is called escaping. The spaces in
>>>>
>>>> Artist - Title.ext   would be escaped so,
>>>>
>>>> Artist\ -\ Title.ext
>>>>
>>>> Frederick Henderson
>>>>
>>>>        
>>>>> -
>>>>> Marius Radiokæll Qtronix
>>>>>
>>>>> On lør, november 13, 2010 15:14, Frederick Henderson wrote:
>>>>>          
>>>>>> On Fri, 12 Nov 2010 16:45:42 +0100, VE4PER/Andy<ve4per at aim.com>
>>>>>> wrote:
>>>>>>
>>>>>>            
>>>>>>> The /var/snd spec was included as explained below in the using linux
>>>>>>> user
>>>>>>> area so there is no chance of the import getting messed up from
>>>>>>> importing
>>>>>>> from a windows partition.
>>>>>>>              
>>>>>> I am not sure what you are talking about when you say "using linux
>>>>>> user
>>>>>> area". Where is this? Is this on the internet? If so please give a
>>>>>> url.
>>>>>>
>>>>>>
>>>>>>            
>>>>>>> As for your comments about the data patterns, my understanding of the
>>>>>>> wording
>>>>>>> of the help file was that whatever was used as a text delimiter in
>>>>>>> the
>>>>>>> original filename
>>>>>>> had to be used the same when you set the pattern in the rdimport
>>>>>>> statement.
>>>>>>>              
>>>>>> This is absolutely correct. In my tests if it was a  dash (-) between
>>>>>> the
>>>>>> artist and title that is what I need to put in the wildcard. If
>>>>>> importing
>>>>>> a wave file and I did not want the .wav added to the last section I
>>>>>> needed
>>>>>> to put a literal period (.).
>>>>>>
>>>>>>
>>>>>>            
>>>>>>> ie if my orignial filename was "My Artist-My Song-My Album-My
>>>>>>> Genre.wav"
>>>>>>> then I should
>>>>>>> set the metadata pattern to  "%a-%t-%l-%u.wav". Because this was the
>>>>>>> way
>>>>>>> I understood/interpreted
>>>>>>> the help file, the hyphen was the delimiter I used when I initially
>>>>>>> ripped the CD library into
>>>>>>> my windows library.
>>>>>>>
>>>>>>> Instead, I discovered that the parser was misinterpreting my hyphens
>>>>>>> such that it was not considering
>>>>>>> them as proper delimiters and I ended up having to use commas to get
>>>>>>> the
>>>>>>> selections imported. I am using
>>>>>>> MYSQL query browser, as explained in the new thread email as tips for
>>>>>>> newbies, to correct the parsing
>>>>>>> without having to go back and rename a 1000's of files using the
>>>>>>> underscore in the filename and re-importing
>>>>>>> them all a second time. I suspect if I had understood the underscore
>>>>>>> delimiter, as necessary and used
>>>>>>> it in the original names, it would have parsed it correctly.
>>>>>>>
>>>>>>>
>>>>>>> So that leads me to ask which version of Rivendell are your running?
>>>>>>> Is
>>>>>>> this one of the two BETA versions?  If so then this is most likely a
>>>>>>> issue
>>>>>>> than needs take care of.
>>>>>>>              
>>>>>> Which version of Rivendell are you using?
>>>>>>
>>>>>>            
>>>>>>> Do chown so that the -R recursive owner:group of /var/music and
>>>>>>> /var/snd  are  chown -R currentloggedinLinux user:rivendell
>>>>>>> /var/music
>>>>>>> and  chown -R currentloggedinLinux user:rivendell /var/snd do the
>>>>>>> batch
>>>>>>> import
>>>>>>> as above then chown them back recursively to rduser:rivendell for
>>>>>>> both.
>>>>>>>
>>>>>>> If you want to avoid chowning, you can do an su to rduser, but then
>>>>>>> can't su back out when done.
>>>>>>>
>>>>>>>
>>>>>>> Sorry, but if you need to do all this it sounds like you are trying
>>>>>>> to
>>>>>>> import files as a different user and group that is setup in
>>>>>>> /etc/rd.conf
>>>>>>> by AudioOwner= and AudioGroup= .  If you are using a version 1.*
>>>>>>> series
>>>>>>> of
>>>>>>> Rivendell the question is why? You should be running as the user in
>>>>>>> rd.conf
>>>>>>>
>>>>>>> However, if you are using the BETA 2.* versions then you should never
>>>>>>> log
>>>>>>> in as the user and nor the group set up in /etc/rd.conf and any linux
>>>>>>> user
>>>>>>> should be able to import audio using rdimport. The user and group
>>>>>>> setup
>>>>>>> in
>>>>>>> /etc/rd.conf should be a system user that is not used by anything but
>>>>>>> Rivendell. And by the way it can not be root. I saw this in the code,
>>>>>>> smart programmer.
>>>>>>>
>>>>>>> Greetings,
>>>>>>>
>>>>>>> Frederick Henderson
>>>>>>> Rivendell has an irc channel for help, question and discussion too.
>>>>>>> #rivendell on irc.freenode.net
>>>>>>> You are correct Frederick, I am logged on using a different Linux
>>>>>>> User
>>>>>>> to complete the initial imports
>>>>>>> as my library backup is sitting on a windows NTFS partition on the
>>>>>>> same
>>>>>>> PC and I have to be logged
>>>>>>> in as the same user/pw  (Windows&  Linux) to be able to access and
>>>>>>> mount
>>>>>>> that volume to be able to
>>>>>>> import the library into the RD Linux default folders.
>>>>>>>              
>>>>>> Ok, I think you have a real mess here with trying to import as a
>>>>>> different
>>>>>> Linux User that the Rivendell one defined in /etc/rd.conf  Can you try
>>>>>> something for me? Copy some files from your ntfs partion over to where
>>>>>> the
>>>>>> rivendell linux user can get at them to import them then try using the
>>>>>> dashes(-) in the wildcard. I would be interested to know if that
>>>>>> solves
>>>>>> the problem.
>>>>>>
>>>>>> One way to do this would be to create group then add both linux users
>>>>>> (the
>>>>>> rivendell one and the one were you can access your files) to the
>>>>>> group.
>>>>>> Then create a folder and change the group to that group and make every
>>>>>> thing read/write for the group.
>>>>>>
>>>>>> As it is I do not believe you have the import parameters correct when
>>>>>> you
>>>>>> send email to the list telling how to correct the fact that everything
>>>>>> got
>>>>>> imported into Title. That just shows that that your commas are NOT
>>>>>> being
>>>>>> used as a delimiters but the first commas is telling the import to
>>>>>> wait
>>>>>> for a comma and since it never finds one it puts everything in the
>>>>>> title.
>>>>>>
>>>>>> I feel for you. The command line is a hard place. One missing space or
>>>>>> dash will mess the whole thing up.
>>>>>>
>>>>>> Greetings,
>>>>>>
>>>>>> Frederick Henderson
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Frederick Henderson
>>>>>>
>>>>>>
>>>>>> Take the pledge!
>>>>>> http://www.emailetiquettepledge.com/take-the-pledge
>>>>>>
>>>>>> This email sent from Opera's revolutionary e-mail client,
>>>>>> http://www.opera.com/mail/
>>>>>> and typed on the Dvorak keyboard.http://dvzine.org
>>>>>>
>>>>>> Want to learn a new language the way you learned your first?
>>>>>> Try LingQ for free!   ==>
>>>>>> http://www.lingq.com/?referral=frederickjh
>>>>>> _______________________________________________
>>>>>> Rivendell-dev mailing list
>>>>>> Rivendell-dev at lists.rivendellaudio.org
>>>>>> http://lists.rivendellaudio.org/mailman/listinfo/rivendell-dev
>>>>>>
>>>>>>
>>>>>>            
>>>>>
>>>>> _______________________________________________
>>>>> Rivendell-dev mailing list
>>>>> Rivendell-dev at lists.rivendellaudio.org
>>>>> http://lists.rivendellaudio.org/mailman/listinfo/rivendell-dev
>>>>>          
>>>> --
>>>> Frederick Henderson
>>>>
>>>>
>>>> Take the pledge!
>>>> http://www.emailetiquettepledge.com/take-the-pledge
>>>>
>>>> This email sent from Opera's revolutionary e-mail client,
>>>> http://www.opera.com/mail/
>>>> and typed on the Dvorak keyboard.http://dvzine.org
>>>>
>>>> Want to learn a new language the way you learned your first?
>>>> Try LingQ for free!   ==>
>>>> http://www.lingq.com/?referral=frederickjh
>>>> _______________________________________________
>>>> Rivendell-dev mailing list
>>>> Rivendell-dev at lists.rivendellaudio.org
>>>> http://lists.rivendellaudio.org/mailman/listinfo/rivendell-dev
>>>>
>>>>        
>>>
>>> _______________________________________________
>>> Rivendell-dev mailing list
>>> Rivendell-dev at lists.rivendellaudio.org
>>> http://lists.rivendellaudio.org/mailman/listinfo/rivendell-dev
>>>      
>>    
>
>
> _______________________________________________
> Rivendell-dev mailing list
> Rivendell-dev at lists.rivendellaudio.org
> http://lists.rivendellaudio.org/mailman/listinfo/rivendell-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.rivendellaudio.org/pipermail/rivendell-dev/attachments/20101116/b3a943bb/attachment-0001.htm 


More information about the Rivendell-dev mailing list