Jump to content

Amarok/Development/Testing

From KDE Community Wiki


Testing Amarok

This is a TODO-list for testing Amarok before release. It's intended to cover all features and functionalities of Amarok. If something is missing, please add it to list.

Warning: Don't report that last.fm doesn't work if you just haven't added your credentials, you need a user account and activate it in the Amarok Settings -> Configure Amarok ->Plugins section by entering your credentials! Some last.fm services (radio) are only available to paying subscribers.

Please report failed tests to https://bugs.kde.org/enter_bug.cgi?product=amarok

For users of Amarok on Windows, please see the tests in this page: Testing on Windows

Important Tests for a release

New Installation

It is very important to test a new installation: this can be done by creating a new user quite easily, as all the configurations are stored individually for each user.

Upgraded Installation

  • Check start-up time the first and the subsequent times
  • Check existing collection
    • ratings, play counts, first & last played times, labels, lyrics
  • Check existing playlists
  • Check existing plugins

Main and Slim Toolbars

  • Using main toolbar to...
    • change track by clicking previous/next song name
    • seek music (with the FastForward - FastBackward keyboard shortcuts and by clicking on the progress slider) in different formats (mp3, flac, ogg..)
    • check artist, album and name of next/previous/current song by hovering
    • play or pause playing
    • adjust volume
    • bookmark position of song
    • like song at last.fm
  • Using slim toolbar to...
    • change track by clicking previous/next -buttons
    • seek music in different formats (mp3, flac, ogg...)
    • play, pause or stop playing
    • adjust volume
    • bookmark position of song
    • like song at last.fm

Media Sources View

Local Music

Local Collection

  • Browsing tracks in tree view and merged view
  • Ctrl+F should focus collection search and show local collection even if previously hidden
  • Searching from collection (artists, albums, year, etc.) in both tree view and merged view
  • Use "Edit filters" with various presets
  • Sort/nest tracks, albums and artists with different settings
    • collapse and expand the tree with different presets, check if album art is visible in Album sort mode, select/unselect year, etc.
  • Right-click on artist to...
    • add it to the playlist.
    • replace the playlist.
    • mass-edit track details(artist name, genre)
    • organize files(different naming formats, etc.)
    • play similiar artists from Last.fm
    • bookmark it.
    • delete tracks: "Move Tracks to Trash" (remember to have backup!)
  • Right-click on album to...
    • add it to the playlist.
    • replace the playlist.
    • mass-edit track details(artist name, genre, year, album name)
    • organize files(different naming formats, etc.)
    • show under various artists
    • fetch cover, set cover, display cover, unset cover(for more, check cover manager part of this list)
    • bookmark it.
    • delete tracks: "Move Tracks to Trash" (remember to have backup!)
  • Right-click on track to...
    • add it to the playlist.
    • replace the playlist.
    • edit track details
    • organize file(different naming formats, etc.)
    • show under various artists
    • love it at Last.fm
    • add position marker
    • delete tracks: "Move Tracks to Trash" (remember to have backup!)
  • Update collection from Tools->Update Collection

iPod Collection

Only iPods supported by libgpod are supported by Amarok. Recent models aren't usually supported until reverse-engineered, please always check that you have latest libgpod and the list of supported devices on gtkpod.org site.

  • iPod collection should show up in Local Music in a few seconds after iPod is plugged in
  • copy tracks to/from iPod: album cover images should be transfered in both directions, compilation status should survive copying
  • drag & drop files to Amarok playlist, play them; stop playling
  • test disconnect behaviour:
    • leave some iPod songs in playlist
    • disconnect iPod from within Amarok or Plasma Device Notifier
    • iPod tracks in playlist should gray-out (perhaps only when hovered by mouse)
    • right-click an iPod song → Edit Track Details. It should be visible that the track is no longer editable
    • While transferring tracks.
  • check that songs, compilations and cover images display/play correctly on iPod

Nepomuk Collection

  • If Nepomuk is found in the system, Nepomuk collection should show up in Settings -> Configure Amarok -> Plugins
  • Nepomuk plugin should not be enabled by default.
  • If Nepomuk and Nepomuk plugin is enabled, Nepomuk collection should start initializing after Amarok starts.
  • The tracks in Nepomuk collection should start playing when double clicked or added to the playlist.
  • Right click on any track -> Edit Track details -> Tags, the fields should be grayed out.
  • The collection should show all tracks from folders indexed by Nepomuk
  • When you change the rating of a song, other applications like Dolphin which use Nepomuk should reflect these changes
  • Move a track listed in Nepomuk collection using a file manager like Dolphin, the track should still be usable.

Other Media Devices Collection

Same tests as for iPods, but in particular:

  • Check detection of automatic mode in MTP/MSC capable players (doesn't work currently)
  • Check detection and functionalites of MTP devices
  • Check detection and functionalites of MSC/USB devices

Remote collections

  • DAAP
  • UPnP collection
  • NFS collection
  • SAMBA shares

Internet

  • For last.fm (needs to be enabled first in the plugins):
    • check that last.fm sees an already open KDE wallet
    • check that scrobbling happens
    • Check that Love/Skip/Ban do work (check on your last.fm website profile in your recent activity)
  • For last.fm users with a payed subscription (see also changes to the http://last.fm radio availability from January 2013):
    • Check that your radio station works
    • Check that your Mix Radio works
    • Check that your recommendations works
    • Check that your neighborhood works
    • Check that the Top Artists work
    • Check that the tags show and you can load tracks with these tags
    • Check that Friends and Neighbors show
  • From Cool Streams (script that needs to be enabled first):.
    • Add streams to playlist
    • Replace playlist with stream
    • Copy stream playlists to collection
    • Sort streams with different settings
    • Edit track details->Tags should be grayed out
  • From Jamendo.com:
    • Update database
    • Sort/nest tracks, albums and artists with different settings
    • Copy/download albums or tracks to collection
    • Play similiar artists from Last.fm
    • Bookmark items
    • Add tracks to playlist
    • Replace playlist with a track
    • Edit track details->Tags should be grayed out

Playlists

  • Ctrl+J should focus playlist search

Dynamic Playlists

  • Test default biases
  • Edit biases
  • Add new biases
  • Clone playlists
  • Repopulate playlist

Saved Playlists

  • Save to disk
  • Save to database
  • Load playlist
  • Replace playlist
  • Rename playlist
  • Export playlist

Automatic Playlist Generator

  • Ensure saved presets have all been loaded with all their constraints
  • Ensure that presets persist across sessions
  • Create and delete presets
  • Export and import constraints
  • Add and remove constraints from a preset
  • Change settings in each constraint
  • Run the Generator using each of the presets, and ensure that the Generator returns reasonable results
  • Cancel a running Generator job

Files

  • Browse through some directories, both by clicking on the directories and the icons as well ans with the breadcrumbs
  • Use different search options
  • Bookmark paths
    • See if the bookmarked paths work on application restart
    • Also check to see if you can edit bookmarks and create a bookmark folder

Podcasts

Menu bar

Amarok-menu

  • Playing media selected with dialog opened by clicking Open media-item
  • Changing to previous/next track
  • Start/stop/pause playing
  • Stop after current track
  • Quit(is it clean exit with by using it, does Amarok quit properly)

View-menu

  • "Lock layout" should be selected by default
  • Unlocking layout should let Context view, Media Sources and Playlist view to be closed
  • Changing to Slim toolbar from Main toolbar should be clean.
  • Context view, Media Sources and Playlist view should be always re-sizable

Playlist-menu

  • Add media from
  • Save current playlist
    • save playlist to Amarok database
    • save playlist on disk
  • Adding media to playlist with Add Media-item
  • Adding different types of media streams(pls..) by clicking Add Stream-item
  • Undo/Redo changes made in playlist
  • Clearing playlist with Clear playlist-item
  • Removing duplicates with Remove duplicates-item
  • Exporting playlist
  • Using different playlist layouts including...
    • All default playlist layouts
    • Customized layouts
  • Use Queue Editor

Tools

Bookmark Manager

  • Does already added bookmarks appear
  • Adding bookmark of Context View Applets
  • Adding bookmark of Media Source View
  • Adding bookmark of Playlist Setup
  • Adding bookmark of Current Track Position
  • Adding folders and sub-folders
  • Does added bookmark loads up cleanly

Cover Manager

  • Browsing folders by artist
  • Searching covers by album name
  • Searching covers by artist name
  • Searching covers with keyword + albums with cover/albums without cover
  • Fetching missing covers automatically
  • Fetching cover for specific album...
    • from Last.fm
    • from Google
    • from Yahoo!
    • from Discogs
    • Fetching cover with custom keywords
    • Sorting covers by size
    • Clearing view
    • Selecting and changing cover
  • Setting custom cover from file system(png, jpeg..)
  • Displaying cover
  • Unsetting cover


Settings

General

  • Switch between different moodbar styles (Angry, frozen etc.)
  • Check if "Automatically scroll playlist to current track" works
  • Check if "Automatically retrieve cover art" works

Collection

  • Add directories to collection and check whether all tracks in the specified directories are added
  • Use Full rescan button to rescan the specified directories
  • Use different importers to import track information
  • Select "Watch folders for changes" and check if it works

Metadata

  • Use "Synchronize Rating" to sync ratings of tracks
  • Check if "Forget about selected collection" works
  • Enable Character set detection in ID3 tags
  • Enable "Write statistics to file" and check if it works

Notifications

  • Change position of On-Screen-Display
  • Use custom colors with OSD
  • Change Duration of OSD
  • Enable "Don't show when a full screen application is active"

Playback

  • Change fadeout duration
  • Change phonon backend and check if amarok crashes
  • Test if "Resume playback on start" works as expected

Script Manager

  • Installing scripts
  • Uninstalling scripts
  • Enabling scripts
  • Disabling scripts
  • Installing new scripts from the Internet

Context View

  • Add/remove applets
    • Add/remove them not only by right clicking>add applet but also by clicking the toolbox button at the bottom right.
  • Test applet functionalities for
    • Current Track
    • Wikipedia
    • Lyrics
    • Albums
    • Info: test with Jamenado, Magantune and other services
    • Similar Artists
    • Guitar Tags
    • Upcoming Events
    • Photos
    • Labels
  • Re-position applets

Playlist View

  • Move tracks around changing place
  • Remove tracks from playlist
  • test different playlist sorting, including shuffle
  • Set various track progressions use favors
  • Test clear playlist button
  • Load + save a playlist
    • Save as a playlist to disk
    • Save as a playlist to collection
  • Add + listen to radio streams
  • Try adding and playing a podcast
  • Try changing filter levels and matching by artists,albums and so on

Nice to test

General Layout

  • Unlocking and locking layout
  • Removing items from layout
  • Adding items to layout
  • Adjusting size of items in layout
  • Moving items in layout

Equalizer

  • Using presets
  • Modifying values
  • Saving a preset
  • Deleting a preset
  • Resetting values to default

Network Request Viewer

  • Browsing network requests
  • Viewing details of request
Retrieved from "https://community.kde.org/index.php?title=Amarok/Development/Testing&oldid=28238"