# Nepomuk MultiMedia (NMM): Description of multimedia objects like Music, Video and Images

Authors:
  - Urho Konttori <urho.konttori@nokia.com>
Editors:
  - Ivan Frade <ivan.frade@nokia.com>
  - Urho Konttori <urho.konttori@nokia.com>
Upstream:

  Not available

ChangeLog:

  Tracker changes

Copyright:

  © 2009, 2010 Nokia

## Overview

### Introduction

This ontology extends NIE (Nepomuk Information Element ontology) and NFO (Nepomuk File Ontology) into the domains of multimedia, including Images, Videos, Music and Radio, and includes a couple of properties to support uPnP sharing.

This ontology replaces/complements NID3 and NEXIF. Those ontologies are a direct map of the respective metadata standards, which makes very difficult to map cleanly other standards (like gstreamer metadata, mp4, ogg, and so on). Besides, those ontologies contain a lot of very low level technical information that is useless to the average user of the desktop.

Our approach in NMM is to keep the minimum properties that make sense for the user, and are present in all (or almost all) specific metadata formats. A profesional photographer (or musician) who needs more fine-grained details for its documents, is free to add also nID3 information or other extensions to the ontology.

### Images domain

The core of images in NMM ontology is the class nmm:Photo. It is (through a long hierarchy) a nie:InformationElement, an interpretation of some bytes. It has properties to store the basic information (camera, metering mode, white balance, flash), and inherits from nfo:Image orientation (nfo:orientation) and resolution (nfo:verticalResolution and nfo:horizontalResolution).

Note that for tags, nie:keywords (from nie:InformationElement) can be used, or the NAO ontology.

Graphical Overview (images domain)

Notation defined in this page

### Music domain

Graphical Overview (music domain)

Notation defined in this page

### Radio domain

NMM includes classes and properties to represent analog and digital radio stations. There is a class nmm:RadioStation on the nie:InformationElement side of the ontology, representing what the user sees about that station (genre via PTY codes, icon, plus title inherited from nie:InformationElement)

A nmm:RadioStation can have one or more nmm:carrier properties representing the different frequencies (or links when it is digitial) it can be tuned. This property links the station with nfo:MediaStream, but usually it will point to one of the subclasses: nmm:DigitalRadio (if digital) or nmm:AnalogRadio (if analog). An analog station has properties as modulation and frequency, while the digial station has streaming bitrate, encoding or protocol.

Note that nfo:MediaStream refers to a flux of bytes/data, and it is on the nie:DataObject side of the ontology

Graphical Overview (radio domain)

Notation defined in this page

## NMM Ontology Classes

### nmm:MusicPiece

Superclasses :

  nfo:Media,

Subclasses :

  --

In domain of :

  nmm:internationalStandardRecordingCode, nmm:trackNumber, nmm:lyrics, nmm:lyricist, nmm:composer, nmm:performer, nmm:beatsPerMinute, nmm:musicAlbumDisc, nmm:musicAlbum,

In range of :

  --

Note:

This class notifies about changes

### nmm:RadioStation

The Radio station in user terms: BBC3, Radio5, YLEX, ... It is linked with 1 or more carriers (different FM frenquencies, online sources in different qualities, etc.). Some RDS information is represented with nie properties, nie:identifier for PI, nie:title for PS

Superclasses :

  nfo:Audio,

Subclasses :

  --

In domain of :

  nmm:carrier, nmm:radioPTY, nmm:radioIcon,

In range of :

  --

Note:

This class notifies about changes

### nmm:MusicAlbumDisc

Superclasses :

  nie:InformationElement,

Subclasses :

  --

In domain of :

  nmm:setNumber, nmm:musicCDIdentifier, nmm:albumDiscAlbum,

In range of :

  nmm:musicAlbumDisc,

### nmm:AnalogRadio

FM Radio carrier signal data. Basically the frequency

Superclasses :

  nfo:MediaStream,

Subclasses :

  --

In domain of :

  nmm:frequency, nmm:modulation,

In range of :

  --

### nmm:RadioModulation

Set of instances for analog radio modulation

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:modulation,

Predefined instances :

  nmm:radio-modulation-fm, nmm:radio-modulation-am,

### nmm:MusicAlbum

Superclasses :

  nfo:MediaList,

Subclasses :

  --

In domain of :

  nmm:albumPeakGain, nmm:albumGain, nmm:albumDuration, nmm:albumTitle, nmm:albumTrackCount, nmm:albumArtist,

In range of :

  nmm:musicAlbum, nmm:albumDiscAlbum,

Note:

This class notifies about changes

### nmm:MeteringMode

Enumeration of different ways a camera determines exposure.

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:meteringMode,

Predefined instances :

  nmm:metering-mode-other, nmm:metering-mode-partial, nmm:metering-mode-pattern, nmm:metering-mode-multispot, nmm:metering-mode-spot, nmm:metering-mode-center-weighted-average, nmm:metering-mode-average,

### nmm:ImageList

An album of images

Superclasses :

  nfo:MediaList,

Subclasses :

  --

In domain of :

  --

In range of :

  --

Note:

This class notifies about changes

### nmm:Artist

An artist.

Superclasses :

  nco:Role, nie:InformationElement,

Subclasses :

  --

In domain of :

  nmm:artistName,

In range of :

  nmm:leadActor, nmm:producedBy, nmm:director, nmm:lyricist, nmm:composer, nmm:performer, nmm:albumArtist,

Note:

This class notifies about changes

### nmm:Playlist

Specific class to split MediaList in Albums and playlists.

Superclasses :

  nfo:MediaList,

Subclasses :

  --

In domain of :

  --

In range of :

  --

Note:

This class notifies about changes

### nmm:WhiteBalance

Camera's white balance setting

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:whiteBalance,

Predefined instances :

  nmm:white-balance-manual, nmm:white-balance-auto,

### nmm:DigitalRadio

Online Radio Stream data object (i.e. as a raw flow of bytes)

Superclasses :

  nfo:MediaStream,

Subclasses :

  --

In domain of :

  nmm:protocol, nmm:encoding, nmm:streamingBitrate,

In range of :

  --

### nmm:Flash

Enumeration of the possible values of flash property

Superclasses :

  rdfs:Resource,

Subclasses :

  --

In domain of :

  --

In range of :

  nmm:flash,

Predefined instances :

  nmm:flash-off, nmm:flash-on,

### nmm:SynchronizedText

Superclasses :

  nfo:PlainTextDocument,

Subclasses :

  --

In domain of :

  nmm:isForHearingImpaired,

In range of :

  nmm:subtitle, nmm:lyrics,

### nmm:Video

Superclasses :

  nfo:Audio, nfo:Video,

Subclasses :

  --

In domain of :

  nmm:isContentEncrypted, nmm:subtitle, nmm:hasSubtitle, nmm:leadActor, nmm:producedBy, nmm:director, nmm:category, nmm:MPAARating, nmm:synopsis, nmm:runTime, nmm:episodeNumber, nmm:season, nmm:isSeries, nmm:videoAlbum,

In range of :

  --

Note:

This class notifies about changes

### nmm:Photo

A photo

Superclasses :

  nfo:Image,

Subclasses :

  --

In domain of :

  nmm:isColorCorrected, nmm:isCropped, nmm:whiteBalance, nmm:meteringMode, nmm:isoSpeed, nmm:focalLength, nmm:fnumber, nmm:flash, nmm:exposureTime,

In range of :

  --

Note:

This class notifies about changes

## NMM Ontology Properties

### nmm:dlnaProfile

DLNA profile of the content, like MP3, MPEG_TS_HD_US, LPCM etc

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:streamingBitrate

Bitrate indicating the quality of the stream in Kbits (usual values 32, 64, 128...)

Type :

  --

Domain :

  nmm:DigitalRadio,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:lyrics

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:SynchronizedText,

Superproperties :

  --

Subproperties :

  --

### nmm:episodeNumber

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:producedBy

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumArtist

main artists of the album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

### nmm:albumDiscAlbum

Album of the disc

Type :

  --

Domain :

  nmm:MusicAlbumDisc,

Range :

  nmm:MusicAlbum,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:protocol

Protocol used for the streaming (HTTP, RTSP)

Type :

  --

Domain :

  nmm:DigitalRadio,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isColorCorrected

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:internationalStandardRecordingCode

ISRC ID. Format: 'CC-XXX-YY-NNNNN'

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  xsd:string,

Superproperties :

  nie:identifier,

Subproperties :

  --

Cardinality :

  1

### nmm:meteringMode

Metering mode refers to the way in which a camera determines the exposure.

Type :

  --

Domain :

  nmm:Photo,

Range :

  nmm:MeteringMode,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:radioPTY

PTY Code (content description) as integer. RDS specs define the translations into human readable descriptions for various languages

Type :

  --

Domain :

  nmm:RadioStation,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:musicAlbum

album the music belongs to

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:MusicAlbum,

Superproperties :

  nie:isLogicalPartOf,

Subproperties :

  --

Cardinality :

  1

### nmm:fnumber

The diameter of the entrance pupil in terms of the focal length of the lens

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumTrackCount

Track count of album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:category

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

### nmm:setNumber

Disc number of album disc

Type :

  --

Domain :

  nmm:MusicAlbumDisc,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:musicCDIdentifier

Music CD identifier to for databases like FreeDB.org. This frame is intended for music that comes from a CD, so that the CD can be identified in databases such as the CDDB. The frame consists of a binary dump of the Table Of Contents, TOC, from the CD, which is a header of 4 bytes and then 8 bytes/track on the CD plus 8 bytes for the 'lead out' making a maximum of 804 bytes. The offset to the beginning of every track on the CD should be described with a four bytes absolute CD-frame address per track, and not with absolute time.

Type :

  --

Domain :

  nmm:MusicAlbumDisc,

Range :

  xsd:string,

Superproperties :

  nie:identifier,

Subproperties :

  --

Cardinality :

  1

### nmm:composer

Composer

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:Artist,

Superproperties :

  nco:contributor,

Subproperties :

  --

Cardinality :

  1

### nmm:synopsis

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:leadActor

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

### nmm:albumTitle

nmm:albumTitle is deprecated, use nie:title instead, extractors still need updating

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:string,

Superproperties :

  nie:title,

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

Note:

This property is deprecated

### nmm:musicAlbumDisc

album disc the music belongs to

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:MusicAlbumDisc,

Superproperties :

  nie:isLogicalPartOf,

Subproperties :

  --

Cardinality :

  1

### nmm:subtitle

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:SynchronizedText,

Superproperties :

  --

Subproperties :

  --

### nmm:performer

Performer

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:Artist,

Superproperties :

  nco:contributor,

Subproperties :

  --

Cardinality :

  1

### nmm:lyricist

Lyricist

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  nmm:Artist,

Superproperties :

  nco:contributor,

Subproperties :

  --

Cardinality :

  1

### nmm:flash

Specifies whether flash was used

Type :

  --

Domain :

  nmm:Photo,

Range :

  nmm:Flash,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:artistName

Name of the artist

Type :

  --

Domain :

  nmm:Artist,

Range :

  xsd:string,

Superproperties :

  dc:title,

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

### nmm:whiteBalance

Type :

  --

Domain :

  nmm:Photo,

Range :

  nmm:WhiteBalance,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:hasSubtitle

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:exposureTime

Exposure time of the photo

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:modulation

Modulation used in the frequency (AM or FM)

Type :

  --

Domain :

  nmm:AnalogRadio,

Range :

  nmm:RadioModulation,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isContentEncrypted

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:frequency

Frequency in the Radio spectrum in Khz (note that usually FM frequencies are in MHz)

Type :

  --

Domain :

  nmm:AnalogRadio,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:genre

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

Text indexed :

  This property is indexed, so it can provide results on text search

### nmm:isSeries

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isCropped

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumGain

Gain of album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:videoAlbum

Type :

  --

Domain :

  nmm:Video,

Range :

  nfo:MediaList,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isForHearingImpaired

Does text stream contain helper tags for hearing-impaired such as <steps in hallway>

Type :

  --

Domain :

  nmm:SynchronizedText,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:encoding

Encoding of the radio. It is a property of the streaming, that it is known before hand, so the applications can choose the encoding they understand.

Type :

  --

Domain :

  nmm:DigitalRadio,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:runTime

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:skipCounter

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:radioIcon

Image used as logo for a radio station

Type :

  --

Domain :

  nmm:RadioStation,

Range :

  nfo:Image,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:carrier

Signal where a radio can be tuned in. There can be more than one.

Type :

  --

Domain :

  nmm:RadioStation,

Range :

  nfo:MediaStream,

Superproperties :

  --

Subproperties :

  --

### nmm:uPnPShared

Tells the uPnP MediaServer (e.g. Rygel) whether to export/share the resource or not

Type :

  --

Domain :

  nfo:Media,

Range :

  xsd:boolean,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:focalLength

A measure of how strongly the lens converges light

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:albumDuration

Duration of the album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:season

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:trackNumber

Track number of the music in its album

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:MPAARating

Type :

  --

Domain :

  nmm:Video,

Range :

  xsd:string,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:director

Type :

  --

Domain :

  nmm:Video,

Range :

  nmm:Artist,

Superproperties :

  --

Subproperties :

  --

### nmm:albumPeakGain

Peak Gain of album

Type :

  --

Domain :

  nmm:MusicAlbum,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:isoSpeed

Measure of a photographic film's sensitivity to light as ISO value

Type :

  --

Domain :

  nmm:Photo,

Range :

  xsd:double,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:beatsPerMinute

beats per minute

Type :

  --

Domain :

  nmm:MusicPiece,

Range :

  xsd:integer,

Superproperties :

  --

Subproperties :

  --

Cardinality :

  1

### nmm:alternativeMedia

Link between to different version of the same media. This is used for instances in uPnp where the server can provide the same video in different resolutions and codecs

Type :

  --

Domain :

  nfo:Media,

Range :

  nfo:Media,

Superproperties :

  --

Subproperties :

  --