.. _scripting:
.. index:: Scripting

Scripting
=========

Gerbera allows you to customize the structure of how your media is being presented to your renderer. One of the most
important features introduced since the version 0.8 (`mediatomb`) are the virtual containers and virtual items.

Let's think of possible scenarios:

* You may want to separate your content by music, photo, video, maybe create a special container with all non
  playable stuff

* You may want your music to be sorted by genre, year, artist, album, or maybe by starting letters, so you can
  more easily find your favorite song when browsing the server

* You want to have your photos that you took with your favorite digital camera to appear in a special folder, or
  maybe you even want to separate the photos that you took with flash-on from the ones that you made without flash

* Your media player does not support video, so you do not even want to see the Video container

* It's up to your imagination :)

The scenarios described above and much more can be achieved with the help of an import script.

Gerbera supports a playlist parsing feature, which is also handled by scripting.


How It Works
~~~~~~~~~~~~

This section will give you some overview on how virtual objects related to scripting. For more details see :ref:`Layout <layout>`.

.. Note::

    In order to use the import scripting feature you have to change the attribute ``<virtual-layout type=..`` from ``builtin`` to ``js`` in ``config.xml``

.. Note::

    The sorting of Video and Photo items using the ``rootpath`` object is still somewhat experimental and not
    described here.

UPnP servers usually sort files by artist, album, some servers may just present a view similar to the file system and so on.
Most servers have strong limitations on the structure of the virtual containers, they usually offer a predefined layout of data
and the user has to live with it.

In Gerbera we try to address this shortcoming by introducing the scriptable virtual object engine. It is designed to be:

* maximally flexible
* easily customizable and extendable
* robust and efficient

We try to achieve these goals by embedding a scripting runtime environment that allows the execution of ECMAScript E5/5.1 conform
scripts better known as JavaScript. Gerbera uses `duktape <http://duktape.org/>`__ scripting engine to run JavaScript.

After an item is added to the PC Directory it is automatically fed as input to the import script. The script then creates one
or more virtual items for the given original item. Items created from scripts are always marked virtual.

When the virtual object engine gets notified, the following happens: a javascript object is created mirroring the
properties of the item. The object is introduced to the function arguments (script environment) and bound to the (predefined) variable ``orig``. This
way a variable orig is always defined for every script invocation and represents the original data of the added item.
Then the script is invoked.

.. Note::

    In the current implementation, if you modify the script then you will have to restart the server for the new logic to take
    effect.


Global Variables And Constants
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

In this section we will introduce the properties of the object that will be processed by the script,
as well as functions that are offered by the server.


The Media Object
----------------

Each time an item is added to the database the import script is invoked. So, one script
invocation processes exactly one non virtual item, and creates a number of virtual items and containers. The original item is
made available in the form of the global variable 'orig'. Additionally, when the object being imported is a playlist, it
is made available to the playlist parser script in the form of the global variable 'playlist'. It is usually a good idea to
only read from these variables and to create and only modify local copies.

.. Note::

    modifying the properties of the orig object will not
    propagate the changes to the database, only a call to
    the ``addCdsObject()`` will permanently add the object.

General Properties
------------------

Here is a list of properties of an object, you can set them you create a new object or when you modify a copy of the 'orig'
object.

**RW** means read/write, i.e. - changes made to that property will be transferred into the database.

**RO** means, that this is a read only property, any changes made to it will get lost.

.. js:attribute:: orig.objectType

    **RW**

    This defines the object type, following types are available:

    +----------------------------------+-----------------------------------------------+
    | Key                              | Description                                   |
    +==================================+===============================================+
    | OBJECT_TYPE_CONTAINER            | Object is a container                         |
    +----------------------------------+-----------------------------------------------+
    | OBJECT_TYPE_ITEM                 | Object is an item                             |
    +----------------------------------+-----------------------------------------------+
    | OBJECT_TYPE_ITEM_EXTERNAL_URL    | Object is a link to a resource on the Internet|
    +----------------------------------+-----------------------------------------------+

.. js:attribute:: orig.title

    **RW**

    This is the title of the original object, since the object represents an entry in the PC-Directory, the title will be
    set to it's file name. This field corresponds to ``dc:title`` in the DIDL-Lite XML.

.. js:attribute:: orig.id

    **RO**

    The object ID, make sure to set all refID's (reference IDs) of your virtual objects to that ID.

.. js:attribute:: orig.parentID

    **RO**

    The object ID of the parent container.

.. js:attribute:: orig.searchable

    **RW**

    If set to true for a container it can be found by a UPnP search if config option /server/upnp/searchable-container-flag is set to yes.

.. js:attribute:: orig.upnpclass

    **RW**

    The UPnP class of the item, this corresponds to ``upnp:class`` in the DIDL-Lite XML.

.. js:attribute:: orig.location

    **RO**

    Location on disk, given by the absolute path and file name.

.. js:attribute:: orig.theora

    **RO**

    This property is a boolean value, it is non zero if the particular item is of type OGG Theora. This is useful to
    allow proper sorting of media and thus placing OGG Vorbis into the Audio container and OGG Theora into the Video
    container.

.. js:attribute:: orig.onlineservice

    **RO**

    Identifies if the item belongs to an online service and thus has extended properties. Following types are
    available:

    +----------------------------------+--------------------------------------------------------+
    | Key                              | Description                                            |
    +==================================+========================================================+
    | ONLINE_SERVICE_NONE              | The item does not belong to an online service and does |
    |                                  | not have extended properties.                          |
    +----------------------------------+--------------------------------------------------------+


.. js:attribute:: orig.mimetype

    **RW**

    Mimetype of the object.

.. js:attribute:: orig.meta

    **R**

    Array holding the metadata that was extracted from the object (i.e. id3/exif/etc. information). The array only contains the first value if multiple were extracted.


.. js:attribute:: orig.metaData

    **RW**

    Array holding the metadata that was extracted from the object (i.e. id3/exif/etc. information). Each value is a list of strings regardless whether the source tag is multi valued or not.

    +---------------+--------------------------------------------------------+------------------------------+
    | Key           | Description                                            | DIDL-Lite XML element        |
    +===============+========================================================+==============================+
    | M_TITLE       | | Extracted title (for example the id3 title if the    | ``dc:title``                 |
    |               | | object is an mp3 file), if you want that your new    |                              |
    |               | | virtual object is displayed under this title you will|                              |
    |               | | have to set ``obj.title = orig.meta[M_TITLE][0]``    |                              |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_ARTIST      | Artist information                                     | ``upnp:artist``              |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_ALBUM       | Album information                                      | ``upnp:album``               |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_DATE        | Date, must be in the format of **YYYY-MM-DD**          | ``dc:date``                  |
    |               | (required by the UPnP spec)                            |                              |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_GENRE       | Genre of the item                                      | ``upnp:genre``               |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_DESCRIPTION | Description of the item                                | ``dc:description``           |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_REGION      | Region description of the item                         | ``upnp:region``              |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_TRACKNUMBER | Track number of the item                               | ``upnp:originalTrackNumber`` |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_PARTNUMBER  | Part number of the item.                               | ``upnp:episodeSeason``       |
    |               | This contains the disc number for audio tracks.        |                              |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_CREATOR     | Creator of the media                                   | ``dc:creator``               |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_AUTHOR      | Author of the media                                    | ``upnp:author``              |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_DIRECTOR    | Director of the media                                  | ``upnp:director``            |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_PUBLISHER   | Publisher of the media                                 | ``dc:publisher``             |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_RATING      | Rating of the media                                    | ``upnp:rating``              |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_ACTOR       | Actor of the media                                     | ``upnp:actor``               |
    +---------------+--------------------------------------------------------+------------------------------+
    | M_PRODUCER    | Producer of the media                                  | ``upnp:producer``            |
    +---------------+--------------------------------------------------------+------------------------------+


.. js:attribute:: orig.aux

    **RO**

    Array holding the so called auxiliary data. Aux data is metadata that is not part of UPnP, for example - this
    can be a musical work, its performing artists and their instruments, the name of a personal video collection
    and the episode-ID of a TV show, a camera model that was used to make a photo, or the information if the photo
    was taken with or without flash.


    Currently aux data can be gathered from **taglib, ffmpeg and libexif** (see the
    :ref:`Import section <library-options>` in the main documentation for
    more details). So, this array will hold the tags that you specified in your config.xml, allowing
    you to create your virtual structure according to your liking.

.. js:attribute:: orig.res

    **RO**

    Array holding the resources. Resources represent the files attached to the media item. Got the the web UI to see the names of available
    resources. The names of the first resource (number 0) are stored as they are. Further resources are prepended with `<number>-`.

    Currently resources can be gathered during import process (see the
    :ref:`Import section <library-options>` in the main documentation for
    more details). So, this array will hold further data, allowing you to adjust the virtual structure according to your liking.

.. js:attribute:: orig.playlistOrder

    **RW**

    This property is only available if the object is being created by the playlist script. It's similar to ID3 track
    number, but is used to set the position of the newly created object inside a parsed playlist container. Usually
    you will increment the number for each new object that you create while parsing the playlist, thus ensuring that the
    resulting order is the same as in the original playlist.


Configuration
-------------

The configuration from `config.xml` and values changed via web UI are available in the global dictionary `config`. The key in the dictionary
is the xpath as shown in brackets in the web UI. Array items can be accessed via index, Dictionaries with the key. Complex entries like
transcoding are not available. The autoscan entry corresponding to the active object is stored in `object_autoscan_id`. Examples:

    .. code-block:: js

        print2("Info", config['/server/name']);
        print2("Error", "Empty setting", config['/import/library-options/id3/auxdata/add-data'][0]);
        print2("Warning", "Active mapping for", config['/import/layout/path']['Directories']);
        print2("Debug", "Checking", config['/import/autoscan/directory'][object_autoscan_id].location);


Constants
---------

Actually there are no such things as constants in JS, so those are actually predefined global variables that are set during JS
engine initialization. Do not assign any values to them, otherwise following script invocation will be using wrong
values.

UPnP Classes
^^^^^^^^^^^^

Media and Container Classes:
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | Constant                              | Type    | Value                                | Notes                                         |
    +=======================================+=========+======================================+===============================================+
    | ``UPNP_CLASS_CONTAINER``              | string  | object.container                     |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_CONTAINER_MUSIC_ARTIST`` | string  | object.container.person.musicArtist  |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_CONTAINER_MUSIC_GENRE``  | string  | object.container.genre.musicGenre    |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_CONTAINER_MUSIC_ALBUM``  | string  | object.container.album.musicAlbum    | | This container class will be treated by the |
    |                                       |         |                                      | | server in a special way, all music items in |
    |                                       |         |                                      | | this container will be sorted by ID3 disk   |
    |                                       |         |                                      | | number and track number.                    |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_PLAYLIST_CONTAINER``     | string  | object.container.playlistContainer   | | This container class will be treated by the |
    |                                       |         |                                      | | server in a special way, all items in this  |
    |                                       |         |                                      | | container will be sorted by the number      |
    |                                       |         |                                      | | specified in the playlistOrder property     |
    |                                       |         |                                      | | (this is set when an object is created by   |
    |                                       |         |                                      | | the playlist script).                       |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_ITEM``                   | string  | object.item                          |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_AUDIO_ITEM``             | string  | object.item.audioItem                |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_ITEM_MUSIC_TRACK``       | string  | object.item.audioItem.musicTrack     |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_AUDIO_BOOK``             | string  | object.item.audioItem.musicTrack     |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_AUDIO_BROADCAST``        | string  | object.item.audioItem.audioBroadcast |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_VIDEO_ITEM``             | string  | object.item.videoItem                |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_VIDEO_MOVIE``            | string  | object.item.videoItem.movie          |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_VIDEO_MUSICVIDEOCLIP``   | string  | object.item.videoItem.musicVideoClip |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_VIDEO_BROADCAST``        | string  | object.item.videoItem.videoBroadcast |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_IMAGE_ITEM``             | string  | object.item.imageItem                |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+
    | ``UPNP_CLASS_IMAGE_PHOTO``            | string  | object.item.imageItem.photo          |                                               |
    +---------------------------------------+---------+--------------------------------------+-----------------------------------------------+

Object Types:
    +---------------------------------------+---------+-------+
    | Constant                              | Type    | Value |
    +=======================================+=========+=======+
    | ``OBJECT_TYPE_CONTAINER``             | integer | 1     |
    +---------------------------------------+---------+-------+
    | ``OBJECT_TYPE_ITEM``                  | integer | 2     |
    +---------------------------------------+---------+-------+
    | ``OBJECT_TYPE_ITEM_EXTERNAL_URL``     | integer | 8     |
    +---------------------------------------+---------+-------+

Box Layout Keys
^^^^^^^^^^^^^^^

Provided for convenience in scripts to refer to predefined layout settings which have to be defined in ``config.xml``.

For default Audio Layout:
    +---------------------------------------+---------------------------------+
    | Constant                              | Value                           |
    +=======================================+=================================+
    | ``BK_audioAllAlbums``                 | Audio/allAlbums                 |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAllArtists``                | Audio/allArtists                |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAll``                       | Audio/allAudio                  |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAllComposers``              | Audio/allComposers              |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAllDirectories``            | Audio/allDirectories            |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAllGenres``                 | Audio/allGenres                 |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAllSongs``                  | Audio/allSongs                  |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAllTracks``                 | Audio/allTracks                 |
    +---------------------------------------+---------------------------------+
    | ``BK_audioAllYears``                  | Audio/allYears                  |
    +---------------------------------------+---------------------------------+
    | ``BK_audioArtistChronology``          | Audio/artistChronology          |
    +---------------------------------------+---------------------------------+
    | ``BK_audioRoot``                      | Audio/audioRoot                 |
    +---------------------------------------+---------------------------------+

For Audio Layout with initials:
    +---------------------------------------+---------------------------------+
    | Constant                              | Value                           |
    +=======================================+=================================+
    | ``BK_audioInitialAbc``                | AudioInitial/abc                |
    +---------------------------------------+---------------------------------+
    | ``BK_audioInitialAllArtistTracks``    | AudioInitial/allArtistTracks    |
    +---------------------------------------+---------------------------------+
    | ``BK_audioInitialAllBooks``           | AudioInitial/allBooks           |
    +---------------------------------------+---------------------------------+
    | ``BK_audioInitialAudioBookRoot``      | AudioInitial/audioBookRoot      |
    +---------------------------------------+---------------------------------+

For Structured Audio Layout:
    +---------------------------------------+---------------------------------+
    | Constant                              | Value                           |
    +=======================================+=================================+
    | ``BK_audioStructuredAllAlbums``       | AudioStructured/allAlbums       |
    +---------------------------------------+---------------------------------+
    | ``BK_audioStructuredAllArtistTracks`` | AudioStructured/allArtistTracks |
    +---------------------------------------+---------------------------------+
    | ``BK_audioStructuredAllArtists``      | AudioStructured/allArtists      |
    +---------------------------------------+---------------------------------+
    | ``BK_audioStructuredAllGenres``       | AudioStructured/allGenres       |
    +---------------------------------------+---------------------------------+
    | ``BK_audioStructuredAllTracks``       | AudioStructured/allTracks       |
    +---------------------------------------+---------------------------------+
    | ``BK_audioStructuredAllYears``        | AudioStructured/allYears        |
    +---------------------------------------+---------------------------------+

For default Video Layout:
    +---------------------------------------+---------------------------------+
    | Constant                              | Value                           |
    +=======================================+=================================+
    | ``BK_videoAllDates``                  | Video/allDates                  |
    +---------------------------------------+---------------------------------+
    | ``BK_videoAllDirectories``            | Video/allDirectories            |
    +---------------------------------------+---------------------------------+
    | ``BK_videoAll``                       | Video/allVideo                  |
    +---------------------------------------+---------------------------------+
    | ``BK_videoAllYears``                  | Video/allYears                  |
    +---------------------------------------+---------------------------------+
    | ``BK_videoRoot``                      | Video/videoRoot                 |
    +---------------------------------------+---------------------------------+
    | ``BK_videoUnknown``                   | Video/unknown                   |
    +---------------------------------------+---------------------------------+

For default Photo Layout:
    +---------------------------------------+---------------------------------+
    | Constant                              | Value                           |
    +=======================================+=================================+
    | ``BK_imageAllDates``                  | Image/allDates                  |
    +---------------------------------------+---------------------------------+
    | ``BK_imageAllDirectories``            | Image/allDirectories            |
    +---------------------------------------+---------------------------------+
    | ``BK_imageAll``                       | Image/allImages                 |
    +---------------------------------------+---------------------------------+
    | ``BK_imageAllYears``                  | Image/allYears                  |
    +---------------------------------------+---------------------------------+
    | ``BK_imageRoot``                      | Image/imageRoot                 |
    +---------------------------------------+---------------------------------+
    | ``BK_imageUnknown``                   | Image/unknown                   |
    +---------------------------------------+---------------------------------+


For default Online Item Layout:
    +---------------------------------------+---------------------------------+
    | Constant                              | Value                           |
    +=======================================+=================================+
    | ``BK_trailerAllGenres``               | Trailer/allGenres               |
    +---------------------------------------+---------------------------------+
    | ``BK_trailerAll``                     | Trailer/allTrailers             |
    +---------------------------------------+---------------------------------+
    | ``BK_trailerPostDate``                | Trailer/postDate                |
    +---------------------------------------+---------------------------------+
    | ``BK_trailerRelDate``                 | Trailer/relDate                 |
    +---------------------------------------+---------------------------------+
    | ``BK_trailerRoot``                    | Trailer/trailerRoot             |
    +---------------------------------------+---------------------------------+
    | ``BK_trailerUnknown``                 | Trailer/unknown                 |
    +---------------------------------------+---------------------------------+


For default Playlist Layout:
    +---------------------------------------+---------------------------------+
    | Constant                              | Value                           |
    +=======================================+=================================+
    | ``BK_playlistAll``                    | Playlist/allPlaylists           |
    +---------------------------------------+---------------------------------+
    | ``BK_playlistAllDirectories``         | Playlist/allDirectories         |
    +---------------------------------------+---------------------------------+
    | ``BK_playlistRoot``                   | Playlist/playlistRoot           |
    +---------------------------------------+---------------------------------+


Functions
~~~~~~~~~

The server offers various native functions that can be called from the scripts, additionally there
are some js helper functions that can be used.

Native Server Functions
-----------------------

The so called native functions are implemented in C++ in the server and can be called from the scripts.

Native Functions Available To All Scripts
-----------------------------------------

The server offers three functions which can be called from
within the import and/or the playlist script:


.. js:function:: addCdsObject(object, containerId)

    Adds the object as a virtual object to the container chain

    :param object object:
        A virtual object that is either a copy of or a reference to 'orig'
    :param string containerId:
        A string, containing the container id as optained from ``addContainerTree``.
    :returns: object id for use as result of the import function.


.. js:function:: addContainerTree(arr)

    Creates a hierarchy of containers

    :param array arr: An array of container defintions. It has the object structure as described above.
    :returns: container id for use in ``addCdsObject``

    .. code-block:: js

        const chain = {
            audio: { title: 'Audio', objectType: OBJECT_TYPE_CONTAINER, upnpclass: UPNP_CLASS_CONTAINER },
            allAudio: { title: 'All Audio', objectType: OBJECT_TYPE_CONTAINER, upnpclass: UPNP_CLASS_CONTAINER }
        };
        var container = addContainerTree([chain.audio, chain.allAudio]);
        addCdsObject(obj, container);


.. js:function:: copyObject(originalObject)

    This function returns a copy of the virtual object.

    :param object originalObject:
    :returns: A copy of the virtual object

.. js:function:: print(...)

    This function is useful for debugging scripts, it simply prints an info message in the log.
    It it recommended to use `print2` instead to set the message level. The function may be removed in the future.

.. js:function:: print2(level, ...)

    This function is useful for debugging scripts, it prints a message in the log with the set level.

    :param string level: Set the output message level.
        The following case insensitive values for ``level`` are allowed:

        #) ``error``: Print an error message
        #) ``warning``: Print a warning message
        #) ``info``: Print an info message
        #) ``debug``: Print a debug message, which is only visible if running with `--debug` or setting `debug-mode="script"` in `server` section of the config file.

.. js:function:: f2i(text)

    Converts filesystem charset to internal UTF-8.

    :param string text:

    `The 'from' charsets can be defined in the server configuration`

.. js:function:: m2i(text)

    Converts metadata charset to internal UTF-8.

    :param string text:

    `The 'from' charsets can be defined in the server configuration`

.. js:function:: p2i(text)

    Converts playlist charset to internal UTF-8.

    :param string text:

    `The 'from' charsets can be defined in the server configuration`

.. js:function:: j2i(text)

    Converts js charset to internal UTF-8.

    :param string text:

    `The 'from' charsets can be defined in the server configuration`


Native Functions Available To The Playlist Script
-------------------------------------------------

The following function is only available to the playlist script.

.. js:function:: readln()

    :returns: string

    This function reads and returns exactly one line of text from the playlist that is currently being processed, end of
    line is identified by carriage return/line feed characters. Each subsequent call will return the next line, there is no
    way to go back. The idea is, that you can process your playlist line by
    line and gather the required information to create new objects which can be added to the database.


Helper Functions
----------------

There is a set of helper JavaScript functions which reside in the common.js script.
They can be used by the import and by the playlist script.

.. js:function:: escapeSlash(name)

    Escapes slash '/' characters in a string. This is necessary, because the container chain is
    defined by a slash separated string, where slash has a special meaning - it defines the container hierarchy. That
    means, that slashes that appear in the object's title need to be properly escaped.

    :param string name: A string to be escaped
    :returns: string


.. js:function:: createContainerChain(arr)

    Verifies that the names are properly escaped and adds the slash separators as necessary

    :param array arr: An array of container names
    :returns: string formatted for use in ``addCdsObject``

    .. code-block:: js

        function createContainerChain(arr)
        {
            var path = '';
            for (var i = 0; i < arr.length; i++)
            {
                path = path + '/' + escapeSlash(arr[i]);
            }
            return path;
        }

.. js:function:: mapGenre(genre)

    Map value of the genre in virtual layout

    :param string: Source value of the genre
    :returns: string - Modified value of the genre

    .. code-block:: js

        function mapGenre(genre) {
            const genreConfig = config['/import/scripting/virtual-layout/genre-map/genre'];
            if (genreConfig) {
                const genreNames = Object.getOwnPropertyNames(genreConfig);
                for (var idx = 0; idx < genreNames.length; idx++) {
                    var re = new RegExp('(' + genreNames[idx] + ')', 'i');
                    var match = re.exec(genre);
                    if (match) {
                        genre = genreConfig[genreNames[idx]];
                        break;
                    }
                }
            }
            return genre;
        }

.. js:function:: mapInitial(firstChar)

    Map character to uppercase latin version

    :param string: Source character
    :returns: string - Modified value of the character

    .. literalinclude:: ../scripts/js/common.js
        :start-after: // doc-map-initial-begin
        :end-before: // doc-map-initial-end
        :language: js

.. js:function:: intFromConfig(entry, defValue)

    Read integer config value or use default

    :param string entry: Config Entry
    :param int defValue: Config Entry
    :returns: int - value from config or default

    .. literalinclude:: ../scripts/js/common.js
        :start-after: // doc-map-int-config-begin
        :end-before: // doc-map-int-config-end
        :language: js

.. js:function:: stringFromConfig(entry, defValue)

    Read string config value or use default

    :param string entry: Config Entry
    :param string defValue: Config Entry
    :returns: string - value from config or default

    .. literalinclude:: ../scripts/js/common.js
        :start-after: // doc-map-string-config-begin
        :end-before: // doc-map-string-config-end
        :language: js

.. js:function:: getYear(date)

    :param string: A date formatted in ``yyyy-mm-dd``
    :returns: string - Year value

    .. code-block:: js

        function getYear(date)
        {
            var matches = date.match(/^([0-9]{4})-/);
            if (matches)
                return matches[1];
            else
                return date;
        }

.. js:function:: getPlaylistType(mimetype)

    This function identifies the type of the playlist by the mimetype, it is used in the playlist script to select an
    appropriate parser.

    :param string: A valid mime-type
    :returns: string - playlist type

    .. code-block:: js

        function getPlaylistType(mimetype)
        {
            if (mimetype == 'audio/x-mpegurl')
                return 'm3u';
            if (mimetype == 'audio/x-scpls')
                return 'pls';
            return '';
        }



Walkthrough
~~~~~~~~~~~

Now it is time to take a closer look at the default scripts that are supplied with Gerbera. Usually it is installed in
the ``/usr/share/gerbera/js/`` directory, but you will also find it in ``scripts/js/`` in the Gerbera source tree.

On startup gerbera loads all the javascript files from that directory (`common-folder` in `config.xml`) then loads all files from
`custom-folder`. If a function defined in a common file is also found in the custom folder it overwrites it.

You can still use the former mechanism of defining `common-script` and `custom-script` in `config.xml` which works as follows:
The functions are defined in `common.js` and can easily be overwritten in a file which is set in `custom-script` in `config.xml`.
Compared to former versions of gerbera you do not have to copy the whole file to overwrite one function.

.. Note::
  this is not a JavaScript tutorial, if you are new to JS you should probably make yourself familiar with the
  language.

Import Logic
------------

We start with a walkthrough of the default import script, it is called import.js in the Gerbera distribution.

Below are the import script functions that organize our content in the database by creating the virtual structure.
Each media type - audio, image and video is handled by a separate function.

The entry point of each import function has the following synopsis

.. js:function:: importFile(obj, cont, rootPath, containerType)

    Create virtual layout for a specific file type

    :param object obj: Original object as created in PC Directory
    :param object cont: Container in PC Directory containing the original object
    :param string rootPath: Root folder of the autoscan directoy
    :param string containerType: UPnP  type configured to create containers
    :returns: nothing

Each entry function is a wrapper around the common function that contains the logic

.. literalinclude:: ../scripts/js/import.js
    :start-after: // doc-import-begin
    :end-before: // doc-import-end
    :language: js

Audio Content Handler
^^^^^^^^^^^^^^^^^^^^^

The biggest one is the function that handles audio - the reason
is simple: flac and mp3 files offer a lot of metadata like album,
artist, genre, etc. information, this allows us to create a
nice container layout.

.. literalinclude:: ../scripts/js/common.js
    :start-after: // doc-add-audio-begin
    :end-before: // doc-add-audio-end
    :language: js

Most music file taggers can handle additional metadata that is not part of UPnP, so you could add code to present your music to the
renderer by musical works, their different interpretations, and the performing artists.

.. Note::

    if you want to use those additional metadata you need to compile Gerbera with taglib support and also
    specify the fields of interest in the import section of your configuration file
    (See documentation about library-options).


Image Content Handler
^^^^^^^^^^^^^^^^^^^^^

This function takes care of images. Currently it does very little sorting, but could easily be extended - photos made by
digital cameras provide lots of information in the Exif tag, so you could easily add code to sort your pictures by camera model
or anything Exif field you might be interested in.

.. Note::

    if you want to use those additional Exif fields you need to compile Gerbera with libexif support and also
    specify the fields of interest in the import section of your configuration file
    (See documentation about library-options).

.. literalinclude:: ../scripts/js/common.js
    :start-after: // doc-add-image-begin
    :end-before: // doc-add-image-end
    :language: js

Just like in the addAudio() function - we construct our container chain and add the object.


Video Content Handler
^^^^^^^^^^^^^^^^^^^^^

Not much to say here... I think libextractor is capable of retrieving some information from video files, however I seldom
encountered any video files populated with metadata. You could also try ffmpeg to get more information, however by default we
keep it very simple - we just put everything into the 'All Video' container.

.. Note::

    if you want to use additional metadata fields you need to compile Gerbera with ffmpeg support and also
    specify the fields of interest in the import section of your configuration file
    (See documentation about library-options).

.. literalinclude:: ../scripts/js/common.js
    :start-after: // doc-add-video-begin
    :end-before: // doc-add-video-end
    :language: js


Putting it all together
^^^^^^^^^^^^^^^^^^^^^^^

In the default configuration these functions are registered as entry points so that all parameters are supplied by the runtime


.. code-block:: xml

    <import-function>
        <audio-file>importAudioInitial</audio-file>
        <video-file>importVideo</video-file>
        <image-file>importImage</image-file>
        <playlist create-link="yes">importPlaylist</playlist>
        <meta-file>importMetadata</meta-file>
    </import-function>

If you set the deprecated `import-script` in `config.xml` the script is fully
evaluated for each file and calls the wrapper to select the correct import function.

.. literalinclude:: ../scripts/js/import.js
    :start-after: // Global Variables
    :language: js


Playlist Script
---------------

The default playlist parsing script is called playlists.js, similar to the import script it works with a global object
which is called 'playlist', the fields are similar to the 'orig' that is used in the import script with the exception of
the playlistOrder field which is special to playlists.

Another big difference between playlist and import scripts is, that playlist scripts can add new media to the database, while
import scripts only process already existing objects (the ones found in PC Directory) and just add additional virtual items.

The default playlist script implementation supports parsing of m3u and pls formats, but you can add support for parsing of any
ASCII based playlist format.

Adding Items
^^^^^^^^^^^^

We will first look at a helper function:

.. js:function:: addPlaylistItem(playlist_title, playlistLocation, entry, playlistChain, playlistOrder, result) {

It is defined in common.js, it receives the title, the location (path on disk or HTTP URL), the entry itself and the desired
position of the item in the database layout (remember the container chains used in the import script).

The function first decides if we are dealing with an item that represents a resource on the web, or if we are dealing with a
local file. After that it populates all item fields accordingly and calls the addCdsObject() that was introduced earlier. Note,
that if the object that is being added by the playlist script is not yet in the database, the import script will be invoked.

Below is the complete function with some comments:

.. literalinclude:: ../scripts/js/common.js
    :start-after: // doc-add-playlist-item-begin
    :end-before: // doc-add-playlist-item-end
    :language: js

Main Parsing
^^^^^^^^^^^^

The actual parsing is done in the function ``importPlaylist`` in ``playlist.js``. First, the type of the playlist is determined (based on the
playlist mimetype), then the correct parser is chosen.

The parsing itself is done in the respective function for the playlist type like ``readM3uPlaylist``. Typically there is a loop, where each call
to readln() returns exactly one line of text from the playlist. There is no possibility to go back, each readln() invocation will retrieve
the next line until end of file is reached.

To keep things easy we will only list the m3u parsing here. Again, if you are not familiar with regular expressions, now is
probably the time to take a closer look.

.. literalinclude:: ../scripts/js/common.js
    :start-after: // doc-playlist-m3u-parse-begin
    :end-before: // doc-playlist-m3u-parse-end
    :language: js

**Happy scripting!**


Example: How to import and play CD-Images (CUE-File)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Do you want to archive your CDs without loss? With ExactAudioCopy (EAC) you can easily create an image in FLAC format and a CUE file. The CUE file is a text file containing information about the individual tracks. Gerbera allows you to use scripts to read in the CUE file and play back the individual tracks.

Prerequisits
------------

1) You have a image copy of your CD in the FLAC-format and a CUE-File. The FLAC-File may include the cover art.
#) Gerbera with the External-Link-Patch.
#) Linux (here Ubuntu 18.04 is used).
#) A flac player on your system.

::

  sudo apt install flac



Create a transcoder-script
--------------------------

::

  #!/bin/bash
  # flac2wav.sh transcoding script to play a range from a flac file.
  #
  # Usage flac2wav.sh <base64 encoded parameterstring> <outputfile>
  #
  # The <parameterstring> is a base64-encoded URL:
  # <parameterstring decoded> ::= "params?skip=<time>&until=<time>&filename=<filename>
  #   <time> ::= mm:ss.ms
  #   <filename> : Fulpath to the flac-file
  # The <outputfile> is a FIFO-pipe created by gerbera
  #
  INPUT="$1"
  OUTPUT="$2"
  # parse parameters
  PARAMSTR=`echo ${INPUT} | sed 's/http:\/\/cue2flac\/\(.*\).*/\1/' | base64 --decode`
  SKIP=`echo ${PARAMSTR} | sed 's/params?.*skip=\([0-9:.]*\).*/\1/'`
  UNTIL=`echo ${PARAMSTR} | sed 's/params?.*until=\([0-9:.\-]*\).*/\1/'`
  FILENAME=`echo ${PARAMSTR} | sed 's/params?.*filename=\"\(.*\)\".*/\1/'`
  # default params
  if [ "${SKIP}" == "" ]
  then
    SKIP="0:00.00"
  fi

  if [ "${UNTIL}" == "" ]
  then
    UNTIL="-0:00.00"
  fi

  # if a filename is given, try transcoding
  if [ "${FILENAME}" != "" ]
  then
    # transcoding command from flac to raw wav with a range
    exec /usr/bin/flac -f -c -d "${FILENAME}" --skip=${SKIP} --until=${UNTIL} > ${OUTPUT} 2>/dev/null
  fi


Modify Your Import Scripts
--------------------------

Add following code to the playlists.js script inside the if-statement.

::

  else if (type == 'cue')
  {
    // .cue file parsing tested only with one audio file and multiplse tracks,
    // but this should work also with multiple audio files
    var thisGenre = null;
    var thisDate = null;
    var discArtist = null;
    var discTitle = null;
    var thisArtist = null;
    var thisTitle = null;
    var thisFileName = null;
    var thisTrackIdx = null;
    var thisStart = "0:00.00";
    var thisStop = "-0:00.00";

    var fileType = null;

    var inTrackIdx = 0;
    var indexDone = 0;

    var oldGenre = null;
    var oldDate = null;
    var oldArtist = null;
    var oldTitle = null;
    var oldFileName = null;
    var oldTrackIdx = null;
    var oldStart = "0:00.00";
    var oldStuff = 0;
    var regarray;

    var inLine = readln();
    do
    {
    if ((regarray = inLine.match(/^REM\s*GENRE\s+(\S+)$/))){
      thisGenre = p2i(regarray[1]);
    } else if ((regarray = inLine.match(/^REM\s*DATE\s+(\d+)$/))){
      thisDate = parseInt(regarray[1], 10);
    } else if ((regarray = inLine.match(/^\s*PERFORMER\s+\"(\S.+)\"$/))){
      if (inTrackIdx < 1){
      // no track specified yet -> assign also the  disc artist
      discArtist = p2i(regarray[1]);
      thisArtist = p2i(regarray[1]);
      } else {
      thisArtist = p2i(regarray[1]);
      }
    } else if ((regarray = inLine.match(/^TITLE\s+\"(\S.+)\"$/))){
      if (inTrackIdx < 1){
      // not in track -> disc title
      discTitle = p2i(regarray[1]);
      } else {
      // inside a track -> track title
      thisTitle = p2i(regarray[1]);
      }
    } else if ((regarray = inLine.match(/^\s*FILE\s+\"(\S.+)\"\s+(\S.+)$/))){
      thisFileName = f2i(regarray[1]);
      fileType = regarray[2];
      if (indexDone > 0){
      // multiple files in same cue -> add entry for this one

      createSubItem(thisFileName, thisGenre, thisDate, discArtist, discTitle, thisArtist, thisTitle, thisTrackIdx, thisStart, thisStop);
      indexDone = 0;
      thisStart = "0:00.00";
      thisStop = "-0:00.00";
      inTrackIdx = 0;
      }
    } else if ((regarray = inLine.match(/^\s*TRACK\s+(\d+)\s*AUDIO\s*$/))){
      thisTrackIdx = parseInt(regarray[1], 10);
      if ((thisTrackIdx != inTrackIdx) && (inTrackIdx > 0)){
       // a new track, so the earlier should be ok
       oldGenre = thisGenre;
       oldDate = thisDate;
       oldArtist = thisArtist;
       oldTitle = thisTitle;
       oldFileName = thisFileName;
       oldTrackIdx = inTrackIdx;
       oldStart = thisStart;
       oldStuff = 1;
      }
      inTrackIdx = thisTrackIdx;
      indexDone = 0;

      inTrack = 1;
    } else if ((regarray = inLine.match(/^\s*INDEX\s+(\d+)\s*(\d+):(\d+):(\d+)\s*$/))){
      var tmpIdx = parseInt(regarray[1], 10);
      var tmpMin = parseInt(regarray[2], 10);
      var tmpSec = parseInt(regarray[3], 10);
      var tmpFrames = parseInt(regarray[4], 10);

      // the time stamp is in min:sec:frames format which has to be changes
      var timeSec = tmpSec + tmpFrames/74.0;

      var tmpStamp = null;
      if (timeSec < 10){
      tmpStamp = tmpMin + ':0' + timeSec;
      } else {
      tmpStamp = tmpMin + ':' + timeSec;
      }

      if (indexDone < 1){
       if (oldStuff > 0){
        createSubItem(oldFileName, oldGenre, oldDate, discArtist, discTitle, oldArtist, oldTitle, oldTrackIdx, oldStart, tmpStamp);
        indexDone = 0;
        thisStart = tmpStamp;
        thisStop = "-0:00";

        oldGenre = null;
        oldDate = null;
        oldArtist = null;
        oldTitle = null;
        oldFileName = null;
        oldTrackIdx = null;
        oldStart = null;
        oldStuff = 0;
       } else {
        indexDone = 1;
       }
      }
    }
    inLine = readln();
     }
     while (inLine);
     createSubItem(thisFileName, thisGenre, thisDate, discArtist, discTitle, thisArtist, thisTitle, thisTrackIdx, thisStart, thisStop);
  }

And add a function createSubItem to playlists.js:

::

  function createSubItem(thisFileName, thisGenre, thisDate, thisDiscArtist,
       thisDiscTitle, thisArtist, thisTitle, thisTrackIdx, thisStart, thisStop)
  {
    if (thisFileName && thisFileName.substr(0,1) != '/'){
     thisFileName = playlistLocation + thisFileName;
    }
    var newItem = new Object();
    newItem.objectType = OBJECT_TYPE_ITEM_EXTERNAL_URL;
    // encode the information to a pseudo-url that is parsed in the transcoding script
    newItem.title = thisFileName;
    var param = "params?skip=";
    if (thisStart){
     param += thisStart;
    } else {
     param +=  "0:00.00";
    }
    param +=  "&until=";
    if (thisStop){
     param +=  thisStop;
    } else {
     param +=  "-0:00.00";
    }
    param +=  "&filename=\"" + thisFileName + "\"";
    newItem.parameter = btoa(param);
    newItem.location = playlistLocation;
    newItem.upnpclass = UPNP_CLASS_ITEM_MUSIC_TRACK;
    newItem.theora = 0;
    newItem.onlineservice = ONLINE_SERVICE_NONE;
    newItem.mimetype = "audio/x-cue+flac";
    newItem.meta = new Array();
    if (thisTitle){
    newItem.meta[M_TITLE] = thisTitle;
    } else {
    newItem.meta[M_TITLE] = thisFileName;
    }
    if (thisArtist){
    newItem.meta[M_ARTIST] = thisArtist;
    } else {
    if (thisDiscArtist){
      newItem.meta[M_ARTIST] = thisDiscArtist;
    }
    }
    if (thisDiscTitle){
    newItem.meta[M_ALBUM] = thisDiscTitle;
    }
    if (thisDate){
    newItem.meta[M_DATE] = thisDate;
    }
    if (thisGenre){
     newItem.meta[M_GENRE] = thisGenre;
    }
    if (thisTrackIdx){
     newItem.meta[M_TRACKNUMBER] = thisTrackIdx;
     newItem.playlistOrder = thisTrackIdx;
    }
    addAudio(newItem);
  }

You see that we create for each track a external link object with a mime type "audio/x-cue+flac". We will need "our" mime type to use our transcoding script.

In my case the JavaScipt-funtion btoa was not included in the runtime environment so we add our own btoa() to common.js.

::

  var Base64 = new function() {
    var keyStr = "ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/="
    this.encode = function(input) {
    var output = "";
    var chr1, chr2, chr3, enc1, enc2, enc3, enc4;
    var i = 0;
    input = Base64._utf8_encode(input);
    while (i < input.length) {
      chr1 = input.charCodeAt(i++);
      chr2 = input.charCodeAt(i++);
      chr3 = input.charCodeAt(i++);
      enc1 = chr1 >> 2;
      enc2 = ((chr1 & 3) << 4) | (chr2 >> 4);
      enc3 = ((chr2 & 15) << 2) | (chr3 >> 6);
      enc4 = chr3 & 63;
      if (isNaN(chr2)) {
      enc3 = enc4 = 64;
      } else if (isNaN(chr3)) {
      enc4 = 64;
      }
      output = output + keyStr.charAt(enc1) + keyStr.charAt(enc2) + keyStr.charAt(enc3) + keyStr.charAt(enc4);
    }
    return output;
    }

    this.decode = function(input) {
    var output = "";
    var chr1, chr2, chr3;
    var enc1, enc2, enc3, enc4;
    var i = 0;
    input = input.replace(/[^A-Za-z0-9\+\/\=]/g, "");
    while (i < input.length) {
      enc1 = keyStr.indexOf(input.charAt(i++));
      enc2 = keyStr.indexOf(input.charAt(i++));
      enc3 = keyStr.indexOf(input.charAt(i++));
      enc4 = keyStr.indexOf(input.charAt(i++));
      chr1 = (enc1 << 2) | (enc2 >> 4);
      chr2 = ((enc2 & 15) << 4) | (enc3 >> 2);
      chr3 = ((enc3 & 3) << 6) | enc4;
      output = output + String.fromCharCode(chr1);
      if (enc3 != 64) {
      output = output + String.fromCharCode(chr2);
      }
      if (enc4 != 64) {
      output = output + String.fromCharCode(chr3);
      }
    }
    output = Base64._utf8_decode(output);
    return output;
    }

    this._utf8_encode = function(string) {
    string = string.replace(/\r\n/g, "\n");
    var utftext = "";
    for (var n = 0; n < string.length; n++) {
      var c = string.charCodeAt(n);
      if (c < 128) {
      utftext += String.fromCharCode(c);
      } else if ((c > 127) && (c < 2048)) {
      utftext += String.fromCharCode((c >> 6) | 192);
      utftext += String.fromCharCode((c & 63) | 128);
      } else {
      utftext += String.fromCharCode((c >> 12) | 224);
      utftext += String.fromCharCode(((c >> 6) & 63) | 128);
      utftext += String.fromCharCode((c & 63) | 128);
      }
    }
    return utftext;
    }

    this._utf8_decode = function(utftext) {
    var string = "";
    var i = 0;
    var c = 0,
      c1 = 0,
      c2 = 0,
      c3 = 0;
    while (i < utftext.length) {
      c = utftext.charCodeAt(i);
      if (c < 128) {
      string += String.fromCharCode(c);
      i++;
      } else if ((c > 191) && (c < 224)) {
      c2 = utftext.charCodeAt(i + 1);
      string += String.fromCharCode(((c & 31) << 6) | (c2 & 63));
      i += 2;
      } else {
      c2 = utftext.charCodeAt(i + 1);
      c3 = utftext.charCodeAt(i + 2);
      string += String.fromCharCode(((c & 15) << 12) | ((c2 & 63) << 6) | (c3 & 63));
      i += 3;
      }
    }
    return string;
    }
  }()

  var btoa = Base64.encode;
  var atob = Base64.decode;

Inside the function addAudio(obj) insert following code according to your virtual layout:

::

  if (obj.objectType == OBJECT_TYPE_ITEM_EXTERNAL_URL) {
    chain = new Array('CD Images', artist, album);
    // until now obj.location contains the full path of the object
    // the attribute obj.parameter has got the base64 encoded parameter string
    // now we must create the location with a pseudo-url
    obj.location = "http://cue2flac/" + obj.parameter;
    addCdsObject(obj, createContainerChain(chain), UPNP_CLASS_CONTAINER_MUSIC_ALBUM);
  }


Edit Your config.xml
--------------------

In the config.xml you must tell gerbera to treat cue-files as a playlist. Make sure that <playlist-script> is set correctly:

::

  <mappings>
    ...
    <extension-mimetype ignore-unknown="no">
      ...
      <map from="cue" to="audio/x-cue"/>
      ...
    </extension-mimetype>
    ...
    <mimetype-contenttype>
      ...
      <treat mimetype="audio/x-cue" as="playlist"/>
      ...
    </mimetype-contenttype>
    ...
  </mappings>

Enable transcoding and set the correct path to the transcoding script.

::

  <transcoding enabled="yes">
    <mimetype-profile-mappings>
      ...
      <transcode mimetype="audio/x-cue+flac" using="flac2wav"/>
      ...
    </mimetype-profile-mappings>
    <profiles>
      ...
      <profile name="/your/path/to/flac2wav" enabled="yes" type="external">
        <mimetype>audio/x-wav</mimetype>
        <accept-url>yes</accept-url>
        <first-resource>yes</first-resource>
        <hide-original-resource>yes</hide-original-resource>
        <accept-ogg-theora>no</accept-ogg-theora>
        <agent command="flac2wav.sh" arguments="%in %out"/>
        <buffer size="1048576" chunk-size="131072" fill-size="65536"/>
      </profile>
      ...
    </profiles>
  </transcoding>

Have fun!


Best Practices for Testing
~~~~~~~~~~~~~~~~~~~~~~~~~~
Writing a custom import script can be tricky.
Here are some hints:

- Gerbera needs to be restarted to pick up changes to the import script.
- During startup, Gerbera scans all directories defined in the `autoscan`
  configuration - this takes time.
  Limit autoscan to a directory containing only few files.
- When autoscan is configured, the import script can be triggered by running
  ``touch /path/to/file.ogg``.
  The "Add" button in the web interface does not trigger the import script
  if Gerbera already knows about the file.
- Do not modify the provided files.
  Override its functions in a separate file and let Gerbera load it by
  specifying it in ``script-folder/custom`` in ``config.xml``.
