Amarok/Development/Testing

Testing Amarok

This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.

Please report failed tests to https://bugs.kde.org/enter_bug.cgi?product=amarok

Important Tests for a release

New Installation

It is very important to test a new installation: this can be done by creating a new user quite easily, as all the configurations are stored individually for each user.

• mkdir ~/.kde-test && export KDEHOME=$HOME/.kde-test && amarok --debug --nofork
• Check if https://bugs.kde.org/show_bug.cgi?id=268492 is reproducible
• Check start-up time the first and the subsequent times
• Create a collection
• Import existing collection, test if https://bugs.kde.org/show_bug.cgi?id=269241 is reproducible
• Import ratings and statistics from a previous database
• Try playing mp3 tracks without installed proprietary codecs https://bugs.kde.org/show_bug.cgi?id=301264

Upgraded Installation

• Check start-up time the first and the subsequent times
• Check existing collection
  • ratings, play counts, first & last played times, labels, lyrics
• Check existing playlists
• Check existing plugins

Main and Slim Toolbars

• Using main toolbar to...
  • change track by clicking previous/next song name
  • change track by dragging song names
  • seek music (with the FastForward - FastBackward keyboard shortcuts and by clicking on the progress slider) in different formats (mp3, flac, ogg..)
  • check artist, album and name of next/previous/current song by hovering
  • play or pause playing
  • adjust volume
  • bookmark position of song
  • like song at last.fm

• Using slim toolbar to...
  • change track by clicking previous/next -buttons
  • seek music in different formats (mp3, flac, ogg...)
  • play, pause or stop playing
  • adjust volume
  • bookmark position of song
  • like song at last.fm

Media Sources View

Local Music

Local Collection

• Browsing tracks in treeview
• Ctrl+F should focus collection search and show local collection even if previously hidden
• Searching from collection (artists, albums, year, etc.)
• Sort/nest tracks, albums and artists with different settings
• Right-click on artist to...
  • add it to the playlist.
  • replace the playlist.
  • mass-edit track details(artist name, genre)
  • organize files(different naming formats, etc.)
  • play similiar artists from Last.fm
  • bookmark it.
  • delete tracks: "Move Tracks to Trash" (remember to have backup!)
• Right-click on album to...
  • add it to the playlist.
  • replace the playlist.
  • mass-edit track details(artist name, genre, year, album name)
  • organize files(different naming formats, etc.)
  • show under various artists
  • fetch cover, set cover, display cover, unset cover(for more, check cover manager part of this list)
  • bookmark it.
  • delete tracks: "Move Tracks to Trash" (remember to have backup!)
• Right-click on track to...
  • add it to the playlist.
  • replace the playlist.
  • edit track details
  • organize file(different naming formats, etc.)
  • show under various artists
  • love it at Last.fm
  • add position marker
  • delete tracks: "Move Tracks to Trash" (remember to have backup!)
• Update collection from Tools->Update Collection

iPod Collection

Only iPods supported by libgpod are supported by Amarok. Recent models aren't usually supported until reverse-engineered, please always check that you have latest libgpod and the list of supported devices on gtkpod.org site.

• iPod collection should show up in Local Music in a few seconds after iPod is plugged in
• copy tracks to/from iPod: album cover images should be transfered in both directions, compilation status should survive copying
• drag & drop files to Amarok playlist, play them; stop playling
• test disconnect behaviour:
  • leave some iPod songs in playlist
  • disconnect iPod from within Amarok or Plasma Device Notifier
  • iPod tracks in playlist should gray-out (perhaps only when hovered by mouse)
  • right-click an iPod song → Edit Track Details. It should be visible that the track is no longer editable
• check that songs, compilations and cover images display/play correctly on iPod

Other Media Devices Collection

Same tests as for iPods, but in particular:

• Check detection of automatic mode in MTP/MSC capable players (doesn't work currently)
• Check detection and functionalites of MTP devices
• Check detection and functionalites of MSC/USB devices

Remote collections

• DAAP: to simulate a remote DAAP collection, try the following (Debian/Ubuntu):

sudo apt-get install mt-daapd
sudo vi /etc/mt-daapd.conf
# change mp3_dir under [general]
sudo /etc/init.d/mt-daapd restart

• UPnP collection
• NFS collection
• SAMBA shares

Internet

• For last.fm (needs to be enabled first in the plugins):
  • check that last.fm sees an already open KDE wallet
  • check that scrobbling happens
• From Cool Streams (script that needs to be enabled first):.
  • Add streams to playlist
  • Replace playlist with stream
  • Copy stream playlists to collection
  • Sort streams with different settings
• From Jamendo.com:
  • Update database
  • Sort/nest tracks, albums and artists with different settings
  • Copy/download albums or tracks to collection
  • Play similiar artists from Last.fm
  • Bookmark items

Playlists

• Ctrl+J should focus playlist search

Dynamic Playlists

• Test default biases
• Edit biases
• Add new biases

Saved Playlists

• Save to disk
• Save to database
• Load playlist
• Rename playlist

Automatic Playlist Generator

• Ensure saved presets have all been loaded with all their constraints
• Ensure that presets persist across sessions
• Create and delete presets
• Export and import constraints
• Add and remove constraints from a preset
• Change settings in each constraint
• Run the Generator using each of the presets, and ensure that the Generator returns reasonable results
• Cancel a running Generator job

Menu bar

Amarok-menu

• Playing media selected with dialog opened by clicking Open media-item
• Changing to previous/next track
• Start/stop/pause playing
• Stop after current track
• Quit(is it clean exit with by using it, does Amarok quit properly)

Playlist-menu

• Adding media to playlist with Add Media-item
• Adding different types of media streams(pls..) by clicking Add Stream-item
• Undo/Redo changes made in playlist
• Clearing playlist with Clear playlist-item
• Removing duplicates with Remove duplicates-item
• Using different playlist layouts including...
  • All default playlist layouts
  • Customized layouts

Tools

Bookmark Manager

• Does already added bookmarks appear
• Adding bookmark of Context View Applets
• Adding bookmark of Media Source View
• Adding bookmark of Playlist Setup
• Adding bookmark of Current Track Position
• Adding folders and sub-folders

Cover Manager

• Browsing folders by artist
• Searching covers by album name
• Searching covers by artist name
• Searching covers with keyword + albums with cover/albums without cover
• Fetching missing covers automatically
• Fetching cover for specific album...
  • from Last.fm
  • from Google
  • from Yahoo!
  • from Discogs
  • Fetching cover with custom keywords
  • Sorting covers by size
  • Clearing view
  • Selecting and changing cover
• Setting custom cover from file system(png, jpeg..)
• Displaying cover
• Unsetting cover

Script Manager

• Installing scripts
• Uninstalling scripts
• Enabling scripts
• Disabling scripts
• Installing new scripts from the Internet

Context View

• Add/remove applets
• Test applet functionalities for
  • Current Track
  • Wikipedia
  • Lyrics
  • Albums
  • Info
  • Similar Artists
  • Guitar Tags
  • Upcoming Events
  • Photos
  • Labels
  • Spectrum Analyzer

Playlist View

• Move tracks around changing place
• test different playlist sorting, including shuffle
• Set various track progressions use favors
• Save as a playlist to disk
• Save as a playlist to collection

Nice to test

General Layout

• Unlocking and locking layout
• Removing items from layout
• Adding items to layout
• Adjusting size of items in layout
• Moving items in layout

Equalizer

• Using presets
• Modifying values
• Saving a preset
• Deleting a preset
• Resetting values to default

Network Request Viewer

• Browsing network requests
• Viewing details of request