NSLU2 Install – Initial Scan=Out of Memory

[Anonymous]

Just purchased a NSLU2. Did the V2.3R63-uNSLUng-6.10-beta install. I then did the unsling.

I then followed the instructions to install the nightly build for Firefly. All goes well until I tell it to scan my library.

It stops around 3900 songs with an out of memory error.

Here is the /var/log/messages

Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Rescanning database
Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Starting playlist scan
Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Updating playlists
Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Error rescanning… bad path?

Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Scanned 0 songs (was 0) in 0
seconds
Sep 12 13:28:59 (none) cron.info cron[406]: loading crontab file /etc/crontab
Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Rescanning database
Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Starting playlist scan
Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Updating playlists
Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Error rescanning… bad path?

Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Scanned 0 songs (was 0) in 0
seconds
Sep 12 13:30:07 (none) auth.warn login[526]: invalid password for `root’ on `tty
p0′ from `192.168.1.102′
Sep 12 13:30:14 (none) auth.info login[526]: root login on `ttyp0′ from `192.16
8.1.102′
Sep 12 13:40:28 (none) daemon.alert mt-daapd[463]: Rescanning database
Sep 12 13:43:24 (none) syslog.info — MARK —
Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 463 (mt-da
apd).
Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 476 (mt-da
apd).
Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 479 (mt-da
apd).
Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 785 (mt-da
apd).
Sep 12 13:49:28 (none) daemon.alert mt-daapd[462]: Rendezvous socket closed (daa
p server crashed?) Aborting.

[Anonymous]

I found that it will crash with an out of memory error after the first or second scan. I watch memory get depleted (using “free”) during a scan…

Anybody know what the memory leak may be?

[fizze]

Congrats on unslinging your slug, and have many happy hours with it 😉

Bump up firefly’s loglevel to 9, then restart it and you will see the progress in the log.
Chances are that you have files with invalid metadata, or simply metadata firefly chokes on.
I have found that it particuliarly dislikes ogg vorbis files with multiple bitstreams, for instance.

[Anonymous]

Here’s an update:

I removed the database file and upon startup(and initial scan) it crashes every time.

Here is what the log says:

2008-09-13 15:32:27 (00000400): Executing: INSERT INTO songs VALUES (NULL,’/share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/01 All For You.mp3′,’01 All For You.mp3′,’All For You’,’Black Label Society’,’Stronger Than Death’,’Metal’,”,’mp3′,”,”,”,”,”,192,44100,239333,5912576,2000,1,0,0,0,0,0,0,0,0,2,’MPEG audio file’,1196219546,1196219546,0,1221334347,0,0,0,’mpeg’,0,0,0,0,”)
2008-09-13 15:32:27 (00000400): Rows: 1
2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/06 Counterfeit God.mp3
2008-09-13 15:32:27 (00000400): Found music file: 06 Counterfeit God.mp3
2008-09-13 15:32:27 (00000400): Codec type: mpeg
2008-09-13 15:32:27 (00000400): Title: Counterfeit God
2008-09-13 15:32:27 (00000400): Artist: Black Label Society
2008-09-13 15:32:27 (00000400): Album: Stronger Than Death
2008-09-13 15:32:27 (00000400): Genre: Metal
2008-09-13 15:32:27 (00000400): Track 6 of 0
2008-09-13 15:32:27 (00000400): Year: 2000
2008-09-13 15:32:27 (00000400): Got id3 tag successfully
2008-09-13 15:32:27 (00000400): Found ID3 header
2008-09-13 15:32:27 (00000400): Header length: 1517
2008-09-13 15:32:27 (00000400): Reading in new block at 1527
2008-09-13 15:32:27 (00000400): valid header at 0
2008-09-13 15:32:27 (00000400): MPEG Version: 1
2008-09-13 15:32:27 (00000400): Layer: 3
2008-09-13 15:32:27 (00000400): Sample Rate: 44100
2008-09-13 15:32:27 (00000400): Bit Rate: 128
2008-09-13 15:32:27 (00000400): Found Xing header
2008-09-13 15:32:27 (00000400): Xing Flags: 0F
2008-09-13 15:32:27 (00000400): Scan Type: 0, no of frames: 9896, song_length: 0, file size: 6862848
2008-09-13 15:32:27 (00000400): Song Length: 258507
2008-09-13 15:32:27 (00000400): Date Added: 1196219547
2008-09-13 15:32:27 (00000400): Codec: mpeg
2008-09-13 15:32:27 (00000400): Executing: INSERT INTO songs VALUES (NULL,’/share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/06 Counterfeit God.mp3′,’06 Counterfeit God.mp3′,’Counterfeit God’,’Black Label Society’,’Stronger Than Death’,’Metal’,”,’mp3′,”,”,”,”,”,208,44100,258507,6862848,2000,6,0,0,0,0,0,0,0,0,2,’MPEG audio file’,1196219547,1196219547,0,1221334347,0,0,0,’mpeg’,0,0,0,0,”)
2008-09-13 15:32:27 (00000400): Rows: 1
2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/09 Stonger Than Death.mp3
2008-09-13 15:32:27 (00000400): Found music file: 09 Stonger Than Death.mp3
2008-09-13 15:32:27 (00000400): Codec type: mpeg
2008-09-13 15:32:27 (00000400): Title: Stonger Than Death
2008-09-13 15:32:27 (00000400): Artist: Black Label Society
2008-09-13 15:32:27 (00000400): Album: Stronger Than Death
2008-09-13 15:32:27 (00000400): Genre: Metal
2008-09-13 15:32:27 (00000400): Track 9 of 0
2008-09-13 15:32:27 (00000400): Year: 2000
2008-09-13 15:32:27 (00000400): Got id3 tag successfully
2008-09-13 15:32:27 (00000400): Found ID3 header
2008-09-13 15:32:27 (00000400): Header length: 806
2008-09-13 15:32:27 (00000400): Reading in new block at 816
2008-09-13 15:32:27 (00000400): valid header at 0
2008-09-13 15:32:27 (00000400): MPEG Version: 1
2008-09-13 15:32:27 (00000400): Layer: 3
2008-09-13 15:32:27 (00000400): Sample Rate: 44100
2008-09-13 15:32:27 (00000400): Bit Rate: 128
2008-09-13 15:32:27 (00000400): Found Xing header
2008-09-13 15:32:27 (00000400): Xing Flags: 0F
2008-09-13 15:32:27 (00000400): Scan Type: 0, no of frames: 11197, song_length: 0, file size: 7571456
2008-09-13 15:32:27 (00000400): Song Length: 292493
2008-09-13 15:32:27 (00000400): Date Added: 1196219547
2008-09-13 15:32:27 (00000400): Codec: mpeg
2008-09-13 15:32:27 (00000400): Executing: INSERT INTO songs VALUES (NULL,’/share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/09 Stonger Than Death.mp3′,’09 Stonger Than Death.mp3′,’Stonger Than Death’,’Black Label Society’,’Stronger Than Death’,’Metal’,”,’mp3′,”,”,”,”,”,200,44100,292493,7571456,2000,9,0,0,0,0,0,0,0,0,2,’MPEG audio file’,1196219547,1196219547,0,1221334347,0,0,0,’mpeg’,0,0,0,0,”)
2008-09-13 15:32:27 (00000400): Rows: 1
2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Shot To Hell
2008-09-13 15:32:27 (00000400): Found Shot To Hell.. recursing
2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Shot To Hell/13_-_Lead_Me_To_Your_Door.mp3
2008-09-13 15:32:27 (00000400): Found music file: 13_-_Lead_Me_To_Your_Door.mp3
2008-09-13 15:32:27 (00000400): Codec type: mpeg
2008-09-13 15:32:31 (00000400): select(8, 5.000000)
2008-09-13 15:32:36 (00000400): select(8, 1.016601)
2008-09-13 15:32:37 (00000400): select(8, 0.006835)
2008-09-13 15:32:37 (00000400): select(8, 0.098632)
2008-09-13 15:32:37 (00000400): select(8, 0.097656)
2008-09-13 15:32:37 (00000400): select(8, 0.000976)
2008-09-13 15:32:37 (00000400): select(8, 5.000000)
2008-09-13 15:32:42 (00000400): select(8, 5.000000)
2008-09-13 15:32:47 (00000400): select(8, 5.000000)
2008-09-13 15:32:52 (00000400): select(8, 5.000000)
2008-09-13 15:33:01 (00000400): select(8, 5.000000)
2008-09-13 15:33:25 (00000400): select(8, 0.000976)
2008-09-13 15:33:34 (00000400): select(8, 5.000000)
2008-09-13 15:33:40 (00000400): select(8, 5.000000)
2008-09-13 15:33:46 (00000400): select(8, 5.000000)
2008-09-13 15:33:51 (00000400): select(8, 5.000000)
2008-09-13 15:33:56 (00000400): select(8, 5.000000)
2008-09-13 15:34:01 (00000400): select(8, 5.000000)
2008-09-13 15:34:07 (00000400): select(8, 5.000000)
2008-09-13 15:34:12 (00000400): select(8, 1.888671)
2008-09-13 15:34:14 (00000400): select(8, 0.006835)
2008-09-13 15:34:30 (00000400): select(8, 0.000976)
2008-09-13 15:34:48 (00000400): select(8, 5.000000)
2008-09-13 15:34:52 (00000400): Processing rendezvous message
2008-09-13 15:34:52 (00000400): Rendezvous socket closed (daap server crashed?) Aborting.
2008-09-13 15:34:52: Aborting

Here is the messages.log file:

Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Firefly Version svn-1586: Starting with debuglevel 9
Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Plugin loaded: ssc-script/svn-1586
Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Plugin loaded: daap/svn-1586
Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Plugin loaded: rsp/svn-1586
Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Starting rendezvous daemon
Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Starting signal handler
Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Initializing database
Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Full reload…
Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Starting web server from /opt/share/mt-daapd/admin-root on port 3689
Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Registering rendezvous names
Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Serving 0 songs. Startup complete in 0 seconds
Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Rescanning database
Sep 13 15:34:53 (none) user.err kernel: Out of Memory: Killed process 647 (mt-daapd).
Sep 13 15:34:53 (none) user.err kernel: Out of Memory: Killed process 648 (mt-daapd).
Sep 13 15:34:53 (none) user.err kernel: Out of Memory: Killed process 651 (mt-daapd).
Sep 13 15:34:54 (none) daemon.alert mt-daapd[646]: Rendezvous socket closed (daap server crashed?) Aborting.

Here is my mt-daapd.conf file:

[general]
#
web_root = /opt/share/mt-daapd/admin-root
#
port = 3689
#
admin_pw = trina1
#
db_type = sqlite3
db_parms = /share/flash/data/data2/music/mt-daapd
#
mp3_dir = /share/flash/data/data2/music/library
#
#servername = NSLU2 Music
#
runas = guest
#
playlist = /opt/etc/mt-daapd/mt-daapd.playlist
#
#password=mp3
#
extensions = .mp3,.m4a,.m4p,.ogg,.flac
#
ssc_codectypes = ogg,flac,alac
#
ssc_prog = /opt/sbin/mt-daapd-ssc.sh
#
# logfile (optional)
#
logfile = /var/log/mt-daapd.log
debuglevel = 9
#
#art_filename = _folderOpenImage.jpg
#
rescan_interval = 600
#
always_scan = 0
#
scan_type = 0
#
# process_m3u
#
#process_m3u = 0
#
# scan_type = 0
#
[plugins]
plugin_dir = /opt/share/mt-daapd/plugins
plugins = rsp.so,ssc-script.so

[stretch]

2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Shot To Hell/13_-_Lead_Me_To_Your_Door.mp3
2008-09-13 15:32:27 (00000400): Found music file: 13_-_Lead_Me_To_Your_Door.mp3
2008-09-13 15:32:27 (00000400): Codec type: mpeg
2008-09-13 15:32:31 (00000400): select(8, 5.000000)
2008-09-13 15:32:36 (00000400): select(8, 1.016601)
2008-09-13 15:32:37 (00000400): select(8, 0.006835)
2008-09-13 15:32:37 (00000400): select(8, 0.098632)

Looks to me like Firefly just choked on bad metadata in that track

Try running this tool over your library http://mp3val.sourceforge.net/
then delete the DB and restart Firefly

[Anonymous]

Well I removed the album from my library and deleted and re-ran the scan. I worked.

I downloaded a freeware mp3 tool from download.com and it did check the meta data and it seemed fine.

I will try adding it to the library again and see what happens.

Thanks for your help!

I guess there needs to be some additional code checking in Firefly to stop the crashing on invalid meta data?

[Author]

Posts