Latest revision as of 08:48, 19 December 2012

Testing Amarok

This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.

Warning: Don't report that last.fm doesn't work if you just haven't added your credentials, you need a user account and activate it in the Amarok Settings -> Configure Amarok ->Plugins section by entering your credentials! Some last.fm services (radio) are only available to paying subscribers.

Please report failed tests to https://bugs.kde.org/enter_bug.cgi?product=amarok

For users of Amarok on Windows, please see the tests in this page: Testing on Windows

Important Tests for a release

New Installation

It is very important to test a new installation: this can be done by creating a new user quite easily, as all the configurations are stored individually for each user.

mkdir ~/.kde-test && export KDEHOME=$HOME/.kde-test && amarok --debug --nofork
Check if https://bugs.kde.org/show_bug.cgi?id=268492 is reproducible
Check start-up time the first and the subsequent times
Create a collection
Import existing collection, test if https://bugs.kde.org/show_bug.cgi?id=269241 is reproducible
Import ratings and statistics from a previous database
Try playing mp3 tracks without installed proprietary codecs https://bugs.kde.org/show_bug.cgi?id=301264

Upgraded Installation

Check start-up time the first and the subsequent times
Check existing collection
- ratings, play counts, first & last played times, labels, lyrics
Check existing playlists
Check existing plugins

Main and Slim Toolbars

Using main toolbar to...
- change track by clicking previous/next song name
- seek music (with the FastForward - FastBackward keyboard shortcuts and by clicking on the progress slider) in different formats (mp3, flac, ogg..)
- check artist, album and name of next/previous/current song by hovering
- play or pause playing
- adjust volume
- bookmark position of song
- like song at last.fm

Using slim toolbar to...
- change track by clicking previous/next -buttons
- seek music in different formats (mp3, flac, ogg...)
- play, pause or stop playing
- adjust volume
- bookmark position of song
- like song at last.fm

Media Sources View

Local Music

Local Collection

Browsing tracks in tree view and merged view
Ctrl+F should focus collection search and show local collection even if previously hidden
Searching from collection (artists, albums, year, etc.) in both tree view and merged view
Use "Edit filters" with various presets
Sort/nest tracks, albums and artists with different settings
- collapse and expand the tree with different presets, check if album art is visible in Album sort mode, select/unselect year, etc.
Right-click on artist to...
- add it to the playlist.
- replace the playlist.
- mass-edit track details(artist name, genre)
- organize files(different naming formats, etc.)
- play similiar artists from Last.fm
- bookmark it.
- delete tracks: "Move Tracks to Trash" (remember to have backup!)
Right-click on album to...
- add it to the playlist.
- replace the playlist.
- mass-edit track details(artist name, genre, year, album name)
- organize files(different naming formats, etc.)
- show under various artists
- fetch cover, set cover, display cover, unset cover(for more, check cover manager part of this list)
- bookmark it.
- delete tracks: "Move Tracks to Trash" (remember to have backup!)
Right-click on track to...
- add it to the playlist.
- replace the playlist.
- edit track details
- organize file(different naming formats, etc.)
- show under various artists
- love it at Last.fm
- add position marker
- delete tracks: "Move Tracks to Trash" (remember to have backup!)
Update collection from Tools->Update Collection

iPod Collection

Only iPods supported by libgpod are supported by Amarok. Recent models aren't usually supported until reverse-engineered, please always check that you have latest libgpod and the list of supported devices on gtkpod.org site.

iPod collection should show up in Local Music in a few seconds after iPod is plugged in
copy tracks to/from iPod: album cover images should be transfered in both directions, compilation status should survive copying
drag & drop files to Amarok playlist, play them; stop playling
test disconnect behaviour:
- leave some iPod songs in playlist
- disconnect iPod from within Amarok or Plasma Device Notifier
- iPod tracks in playlist should gray-out (perhaps only when hovered by mouse)
- right-click an iPod song → Edit Track Details. It should be visible that the track is no longer editable
- While transferring tracks.
check that songs, compilations and cover images display/play correctly on iPod

Nepomuk Collection

If Nepomuk is found in the system, Nepomuk collection should show up in Settings -> Configure Amarok -> Plugins
Nepomuk plugin should not be enabled by default.
If Nepomuk and Nepomuk plugin is enabled, Nepomuk collection should start initializing after Amarok starts.
The tracks in Nepomuk collection should start playing when double clicked or added to the playlist.
Right click on any track -> Edit Track details -> Tags, the fields should be grayed out.
The collection should show all tracks from folders indexed by Nepomuk
When you change the rating of a song, other applications like Dolphin which use Nepomuk should reflect these changes
Move a track listed in Nepomuk collection using a file manager like Dolphin, the track should still be usable.

Other Media Devices Collection

Same tests as for iPods, but in particular:

Check detection of automatic mode in MTP/MSC capable players (doesn't work currently)
Check detection and functionalites of MTP devices
Check detection and functionalites of MSC/USB devices

Remote collections

DAAP
UPnP collection
NFS collection
SAMBA shares

Internet

For last.fm (needs to be enabled first in the plugins):
- check that last.fm sees an already open KDE wallet
- check that scrobbling happens
- Check that Love/Skip/Ban do work (check on your last.fm website profile in your recent activity)
For last.fm users with a payed subscription (see also changes to the http://last.fm radio availability from January 2013):
- Check that your radio station works
- Check that your Mix Radio works
- Check that your recommendations works
- Check that your neighborhood works
- Check that the Top Artists work
- Check that the tags show and you can load tracks with these tags
- Check that Friends and Neighbors show
From Cool Streams (script that needs to be enabled first):.
- Add streams to playlist
- Replace playlist with stream
- Copy stream playlists to collection
- Sort streams with different settings
- Edit track details->Tags should be grayed out
From Jamendo.com:
- Update database
- Sort/nest tracks, albums and artists with different settings
- Copy/download albums or tracks to collection
- Play similiar artists from Last.fm
- Bookmark items
- Add tracks to playlist
- Replace playlist with a track
- Edit track details->Tags should be grayed out

Playlists

Ctrl+J should focus playlist search

Dynamic Playlists

Test default biases
Edit biases
Add new biases
Clone playlists
Repopulate playlist

Saved Playlists

Save to disk
Save to database
Load playlist
Replace playlist
Rename playlist
Export playlist

Automatic Playlist Generator

Ensure saved presets have all been loaded with all their constraints
Ensure that presets persist across sessions
Create and delete presets
Export and import constraints
Add and remove constraints from a preset
Change settings in each constraint
Run the Generator using each of the presets, and ensure that the Generator returns reasonable results
Cancel a running Generator job

Files

Browse through some directories, both by clicking on the directories and the icons as well ans with the breadcrumbs
Use different search options
Bookmark paths
- See if the bookmarked paths work on application restart
- Also check to see if you can edit bookmarks and create a bookmark folder

Podcasts

Menu bar

Amarok-menu

Playing media selected with dialog opened by clicking Open media-item
Changing to previous/next track
Start/stop/pause playing
Stop after current track
Quit(is it clean exit with by using it, does Amarok quit properly)

View-menu

"Lock layout" should be selected by default
Unlocking layout should let Context view, Media Sources and Playlist view to be closed
Changing to Slim toolbar from Main toolbar should be clean.
Context view, Media Sources and Playlist view should be always re-sizable

Playlist-menu

Add media from
Save current playlist
- save playlist to Amarok database
- save playlist on disk
Adding media to playlist with Add Media-item
Adding different types of media streams(pls..) by clicking Add Stream-item
Undo/Redo changes made in playlist
Clearing playlist with Clear playlist-item
Removing duplicates with Remove duplicates-item
Exporting playlist
Using different playlist layouts including...
- All default playlist layouts
- Customized layouts
Use Queue Editor

Tools

Bookmark Manager

Does already added bookmarks appear
Adding bookmark of Context View Applets
Adding bookmark of Media Source View
Adding bookmark of Playlist Setup
Adding bookmark of Current Track Position
Adding folders and sub-folders
Does added bookmark loads up cleanly

Cover Manager

Browsing folders by artist
Searching covers by album name
Searching covers by artist name
Searching covers with keyword + albums with cover/albums without cover
Fetching missing covers automatically
Fetching cover for specific album...
- from Last.fm
- from Google
- from Yahoo!
- from Discogs
- Fetching cover with custom keywords
- Sorting covers by size
- Clearing view
- Selecting and changing cover
Setting custom cover from file system(png, jpeg..)
Displaying cover
Unsetting cover

Settings

General

Switch between different moodbar styles (Angry, frozen etc.)
Check if "Automatically scroll playlist to current track" works
Check if "Automatically retrieve cover art" works

Collection

Add directories to collection and check whether all tracks in the specified directories are added
Use Full rescan button to rescan the specified directories
Use different importers to import track information
Select "Watch folders for changes" and check if it works

Metadata

Use "Synchronize Rating" to sync ratings of tracks
Check if "Forget about selected collection" works
Enable Character set detection in ID3 tags
Enable "Write statistics to file" and check if it works

Notifications

Change position of On-Screen-Display
Use custom colors with OSD
Change Duration of OSD
Enable "Don't show when a full screen application is active"

Playback

Change fadeout duration
Change phonon backend and check if amarok crashes
Test if "Resume playback on start" works as expected

Script Manager

Installing scripts
Uninstalling scripts
Enabling scripts
Disabling scripts
Installing new scripts from the Internet

Context View

Add/remove applets
- Add/remove them not only by right clicking>add applet but also by clicking the toolbox button at the bottom right.
Test applet functionalities for
- Current Track
- Wikipedia
- Lyrics
- Albums
- Info: test with Jamenado, Magantune and other services
- Similar Artists
- Guitar Tags
- Upcoming Events
- Photos
- Labels
Re-position applets

Playlist View

Move tracks around changing place
Remove tracks from playlist
test different playlist sorting, including shuffle
Set various track progressions use favors
Test clear playlist button
Load + save a playlist
- Save as a playlist to disk
- Save as a playlist to collection
Add + listen to radio streams
Try adding and playing a podcast
Try changing filter levels and matching by artists,albums and so on

Nice to test

General Layout

Unlocking and locking layout
Removing items from layout
Adding items to layout
Adjusting size of items in layout
Moving items in layout

Equalizer

Using presets
Modifying values
Saving a preset
Deleting a preset
Resetting values to default

Network Request Viewer

Browsing network requests
Viewing details of request