You are here: Home » Topic » NSLU2 Install – Initial Scan=Out of Memory

NSLU2 Install – Initial Scan=Out of Memory

This topic contains 5 replies, has 3 voices, and was last updated by  Anonymous 9 years, 2 months ago.

Viewing 6 posts - 1 through 6 (of 6 total)
  • Author
    Posts
  • #2630

    Anonymous

    Just purchased a NSLU2. Did the V2.3R63-uNSLUng-6.10-beta install. I then did the unsling.

    I then followed the instructions to install the nightly build for Firefly. All goes well until I tell it to scan my library.

    It stops around 3900 songs with an out of memory error.

    Here is the /var/log/messages

    Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Rescanning database
    Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Starting playlist scan
    Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Updating playlists
    Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Error rescanning… bad path?

    Sep 12 13:28:25 (none) daemon.alert mt-daapd[463]: Scanned 0 songs (was 0) in 0
    seconds
    Sep 12 13:28:59 (none) cron.info cron[406]: loading crontab file /etc/crontab
    Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Rescanning database
    Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Starting playlist scan
    Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Updating playlists
    Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Error rescanning… bad path?

    Sep 12 13:29:33 (none) daemon.alert mt-daapd[463]: Scanned 0 songs (was 0) in 0
    seconds
    Sep 12 13:30:07 (none) auth.warn login[526]: invalid password for `root’ on `tty
    p0′ from `192.168.1.102′
    Sep 12 13:30:14 (none) auth.info login[526]: root login on `ttyp0′ from `192.16
    8.1.102′
    Sep 12 13:40:28 (none) daemon.alert mt-daapd[463]: Rescanning database
    Sep 12 13:43:24 (none) syslog.info — MARK —
    Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 463 (mt-da
    apd).
    Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 476 (mt-da
    apd).
    Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 479 (mt-da
    apd).
    Sep 12 13:49:27 (none) user.err kernel: Out of Memory: Killed process 785 (mt-da
    apd).
    Sep 12 13:49:28 (none) daemon.alert mt-daapd[462]: Rendezvous socket closed (daa
    p server crashed?) Aborting.

    #17693

    Anonymous

    I found that it will crash with an out of memory error after the first or second scan. I watch memory get depleted (using “free”) during a scan…

    Anybody know what the memory leak may be?

    #17694

    fizze
    Participant

    Congrats on unslinging your slug, and have many happy hours with it šŸ˜‰

    Bump up firefly’s loglevel to 9, then restart it and you will see the progress in the log.
    Chances are that you have files with invalid metadata, or simply metadata firefly chokes on.
    I have found that it particuliarly dislikes ogg vorbis files with multiple bitstreams, for instance.

    #17695

    Anonymous

    Here’s an update:

    I removed the database file and upon startup(and initial scan) it crashes every time.

    Here is what the log says:

    2008-09-13 15:32:27 (00000400): Executing: INSERT INTO songs VALUES (NULL,’/share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/01 All For You.mp3′,’01 All For You.mp3′,’All For You’,’Black Label Society’,’Stronger Than Death’,’Metal’,”,’mp3′,”,”,”,”,”,192,44100,239333,5912576,2000,1,0,0,0,0,0,0,0,0,2,’MPEG audio file’,1196219546,1196219546,0,1221334347,0,0,0,’mpeg’,0,0,0,0,”)
    2008-09-13 15:32:27 (00000400): Rows: 1
    2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/06 Counterfeit God.mp3
    2008-09-13 15:32:27 (00000400): Found music file: 06 Counterfeit God.mp3
    2008-09-13 15:32:27 (00000400): Codec type: mpeg
    2008-09-13 15:32:27 (00000400): Title: Counterfeit God
    2008-09-13 15:32:27 (00000400): Artist: Black Label Society
    2008-09-13 15:32:27 (00000400): Album: Stronger Than Death
    2008-09-13 15:32:27 (00000400): Genre: Metal
    2008-09-13 15:32:27 (00000400): Track 6 of 0
    2008-09-13 15:32:27 (00000400): Year: 2000
    2008-09-13 15:32:27 (00000400): Got id3 tag successfully
    2008-09-13 15:32:27 (00000400): Found ID3 header
    2008-09-13 15:32:27 (00000400): Header length: 1517
    2008-09-13 15:32:27 (00000400): Reading in new block at 1527
    2008-09-13 15:32:27 (00000400): valid header at 0
    2008-09-13 15:32:27 (00000400): MPEG Version: 1
    2008-09-13 15:32:27 (00000400): Layer: 3
    2008-09-13 15:32:27 (00000400): Sample Rate: 44100
    2008-09-13 15:32:27 (00000400): Bit Rate: 128
    2008-09-13 15:32:27 (00000400): Found Xing header
    2008-09-13 15:32:27 (00000400): Xing Flags: 0F
    2008-09-13 15:32:27 (00000400): Scan Type: 0, no of frames: 9896, song_length: 0, file size: 6862848
    2008-09-13 15:32:27 (00000400): Song Length: 258507
    2008-09-13 15:32:27 (00000400): Date Added: 1196219547
    2008-09-13 15:32:27 (00000400): Codec: mpeg
    2008-09-13 15:32:27 (00000400): Executing: INSERT INTO songs VALUES (NULL,’/share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/06 Counterfeit God.mp3′,’06 Counterfeit God.mp3′,’Counterfeit God’,’Black Label Society’,’Stronger Than Death’,’Metal’,”,’mp3′,”,”,”,”,”,208,44100,258507,6862848,2000,6,0,0,0,0,0,0,0,0,2,’MPEG audio file’,1196219547,1196219547,0,1221334347,0,0,0,’mpeg’,0,0,0,0,”)
    2008-09-13 15:32:27 (00000400): Rows: 1
    2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/09 Stonger Than Death.mp3
    2008-09-13 15:32:27 (00000400): Found music file: 09 Stonger Than Death.mp3
    2008-09-13 15:32:27 (00000400): Codec type: mpeg
    2008-09-13 15:32:27 (00000400): Title: Stonger Than Death
    2008-09-13 15:32:27 (00000400): Artist: Black Label Society
    2008-09-13 15:32:27 (00000400): Album: Stronger Than Death
    2008-09-13 15:32:27 (00000400): Genre: Metal
    2008-09-13 15:32:27 (00000400): Track 9 of 0
    2008-09-13 15:32:27 (00000400): Year: 2000
    2008-09-13 15:32:27 (00000400): Got id3 tag successfully
    2008-09-13 15:32:27 (00000400): Found ID3 header
    2008-09-13 15:32:27 (00000400): Header length: 806
    2008-09-13 15:32:27 (00000400): Reading in new block at 816
    2008-09-13 15:32:27 (00000400): valid header at 0
    2008-09-13 15:32:27 (00000400): MPEG Version: 1
    2008-09-13 15:32:27 (00000400): Layer: 3
    2008-09-13 15:32:27 (00000400): Sample Rate: 44100
    2008-09-13 15:32:27 (00000400): Bit Rate: 128
    2008-09-13 15:32:27 (00000400): Found Xing header
    2008-09-13 15:32:27 (00000400): Xing Flags: 0F
    2008-09-13 15:32:27 (00000400): Scan Type: 0, no of frames: 11197, song_length: 0, file size: 7571456
    2008-09-13 15:32:27 (00000400): Song Length: 292493
    2008-09-13 15:32:27 (00000400): Date Added: 1196219547
    2008-09-13 15:32:27 (00000400): Codec: mpeg
    2008-09-13 15:32:27 (00000400): Executing: INSERT INTO songs VALUES (NULL,’/share/flash/data/data2/music/library/Black Label Society/Stronger Than Death/09 Stonger Than Death.mp3′,’09 Stonger Than Death.mp3′,’Stonger Than Death’,’Black Label Society’,’Stronger Than Death’,’Metal’,”,’mp3′,”,”,”,”,”,200,44100,292493,7571456,2000,9,0,0,0,0,0,0,0,0,2,’MPEG audio file’,1196219547,1196219547,0,1221334347,0,0,0,’mpeg’,0,0,0,0,”)
    2008-09-13 15:32:27 (00000400): Rows: 1
    2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Shot To Hell
    2008-09-13 15:32:27 (00000400): Found Shot To Hell.. recursing
    2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Shot To Hell/13_-_Lead_Me_To_Your_Door.mp3
    2008-09-13 15:32:27 (00000400): Found music file: 13_-_Lead_Me_To_Your_Door.mp3
    2008-09-13 15:32:27 (00000400): Codec type: mpeg
    2008-09-13 15:32:31 (00000400): select(8, 5.000000)
    2008-09-13 15:32:36 (00000400): select(8, 1.016601)
    2008-09-13 15:32:37 (00000400): select(8, 0.006835)
    2008-09-13 15:32:37 (00000400): select(8, 0.098632)
    2008-09-13 15:32:37 (00000400): select(8, 0.097656)
    2008-09-13 15:32:37 (00000400): select(8, 0.000976)
    2008-09-13 15:32:37 (00000400): select(8, 5.000000)
    2008-09-13 15:32:42 (00000400): select(8, 5.000000)
    2008-09-13 15:32:47 (00000400): select(8, 5.000000)
    2008-09-13 15:32:52 (00000400): select(8, 5.000000)
    2008-09-13 15:33:01 (00000400): select(8, 5.000000)
    2008-09-13 15:33:25 (00000400): select(8, 0.000976)
    2008-09-13 15:33:34 (00000400): select(8, 5.000000)
    2008-09-13 15:33:40 (00000400): select(8, 5.000000)
    2008-09-13 15:33:46 (00000400): select(8, 5.000000)
    2008-09-13 15:33:51 (00000400): select(8, 5.000000)
    2008-09-13 15:33:56 (00000400): select(8, 5.000000)
    2008-09-13 15:34:01 (00000400): select(8, 5.000000)
    2008-09-13 15:34:07 (00000400): select(8, 5.000000)
    2008-09-13 15:34:12 (00000400): select(8, 1.888671)
    2008-09-13 15:34:14 (00000400): select(8, 0.006835)
    2008-09-13 15:34:30 (00000400): select(8, 0.000976)
    2008-09-13 15:34:48 (00000400): select(8, 5.000000)
    2008-09-13 15:34:52 (00000400): Processing rendezvous message
    2008-09-13 15:34:52 (00000400): Rendezvous socket closed (daap server crashed?) Aborting.
    2008-09-13 15:34:52: Aborting

    Here is the messages.log file:

    Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Firefly Version svn-1586: Starting with debuglevel 9
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Plugin loaded: ssc-script/svn-1586
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Plugin loaded: daap/svn-1586
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Plugin loaded: rsp/svn-1586
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Starting rendezvous daemon
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[645]: Starting signal handler
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Initializing database
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Full reload…
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Starting web server from /opt/share/mt-daapd/admin-root on port 3689
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Registering rendezvous names
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Serving 0 songs. Startup complete in 0 seconds
    Sep 13 15:32:05 (none) daemon.alert mt-daapd[647]: Rescanning database
    Sep 13 15:34:53 (none) user.err kernel: Out of Memory: Killed process 647 (mt-daapd).
    Sep 13 15:34:53 (none) user.err kernel: Out of Memory: Killed process 648 (mt-daapd).
    Sep 13 15:34:53 (none) user.err kernel: Out of Memory: Killed process 651 (mt-daapd).
    Sep 13 15:34:54 (none) daemon.alert mt-daapd[646]: Rendezvous socket closed (daap server crashed?) Aborting.

    Here is my mt-daapd.conf file:

    [general]
    #
    web_root = /opt/share/mt-daapd/admin-root
    #
    port = 3689
    #
    admin_pw = trina1
    #
    db_type = sqlite3
    db_parms = /share/flash/data/data2/music/mt-daapd
    #
    mp3_dir = /share/flash/data/data2/music/library
    #
    #servername = NSLU2 Music
    #
    runas = guest
    #
    playlist = /opt/etc/mt-daapd/mt-daapd.playlist
    #
    #password=mp3
    #
    extensions = .mp3,.m4a,.m4p,.ogg,.flac
    #
    ssc_codectypes = ogg,flac,alac
    #
    ssc_prog = /opt/sbin/mt-daapd-ssc.sh
    #
    # logfile (optional)
    #
    logfile = /var/log/mt-daapd.log
    debuglevel = 9
    #
    #art_filename = _folderOpenImage.jpg
    #
    rescan_interval = 600
    #
    always_scan = 0
    #
    scan_type = 0
    #
    # process_m3u
    #
    #process_m3u = 0
    #
    # scan_type = 0
    #
    [plugins]
    plugin_dir = /opt/share/mt-daapd/plugins
    plugins = rsp.so,ssc-script.so

    #17696

    stretch
    Participant

    2008-09-13 15:32:27 (00000400): Found /share/flash/data/data2/music/library/Black Label Society/Shot To Hell/13_-_Lead_Me_To_Your_Door.mp3
    2008-09-13 15:32:27 (00000400): Found music file: 13_-_Lead_Me_To_Your_Door.mp3
    2008-09-13 15:32:27 (00000400): Codec type: mpeg
    2008-09-13 15:32:31 (00000400): select(8, 5.000000)
    2008-09-13 15:32:36 (00000400): select(8, 1.016601)
    2008-09-13 15:32:37 (00000400): select(8, 0.006835)
    2008-09-13 15:32:37 (00000400): select(8, 0.098632)

    Looks to me like Firefly just choked on bad metadata in that track

    Try running this tool over your library http://mp3val.sourceforge.net/
    then delete the DB and restart Firefly

    #17697

    Anonymous

    Well I removed the album from my library and deleted and re-ran the scan. I worked.

    I downloaded a freeware mp3 tool from download.com and it did check the meta data and it seemed fine.

    I will try adding it to the library again and see what happens.

    Thanks for your help!

    I guess there needs to be some additional code checking in Firefly to stop the crashing on invalid meta data?

Viewing 6 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic.