Labels on Levels

Labeling of Multi-Scale Multi-Instance and Crowded 3D Biological Environments

David Kouřil, Ladislav Čmolík, Barbora Kozlíková, Hslanc Yun Wu, Graham Johnson, David Goodsell, Arthur Olson, M. Eduard Gröller, Ivan Viola

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Labeling is intrinsically important for exploring and understanding complex environments and models in a variety of domains. We present a method for interactive labeling of crowded 3D scenes containing very many instances of objects spanning multiple scales in size. In contrast to previous labeling methods, we target cases where many instances of dozens of types are present and where the hierarchical structure of the objects in the scene presents an opportunity to choose the most suitable level for each placed label. Our solution builds on and goes beyond labeling techniques in medical 3D visualization, cartography, and biological illustrations from books and prints. In contrast to these techniques, the main characteristics of our new technique are: 1) a novel way of labeling objects as part of a bigger structure when appropriate, 2) visual clutter reduction by labeling only representative instances for each type of an object, and a strategy of selecting those. The appropriate level of label is chosen by analyzing the scene's depth buffer and the scene objects' hierarchy tree. We address the topic of communicating the parent-children relationship between labels by employing visual hierarchy concepts adapted from graphic design. Selecting representative instances considers several criteria tailored to the character of the data and is combined with a greedy optimization approach. We demonstrate the usage of our method with models from mesoscale biology where these two characteristics - multi-scale and multi-instance - are abundant, along with the fact that these scenes are extraordinarily dense.

Original languageEnglish (US)
Article number8440077
Pages (from-to)977-986
Number of pages10
JournalIEEE Transactions on Visualization and Computer Graphics
Volume25
Issue number1
DOIs
StatePublished - Jan 1 2019

Fingerprint

Labeling
Labels
Visualization

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Keywords

  • labeling
  • multi-instance data
  • multi-scale data

Cite this

Kouřil, David ; Čmolík, Ladislav ; Kozlíková, Barbora ; Wu, Hslanc Yun ; Johnson, Graham ; Goodsell, David ; Olson, Arthur ; Gröller, M. Eduard ; Viola, Ivan. / Labels on Levels : Labeling of Multi-Scale Multi-Instance and Crowded 3D Biological Environments. In: IEEE Transactions on Visualization and Computer Graphics. 2019 ; Vol. 25, No. 1. pp. 977-986.
@article{e5c0dcddf4084ae4a81515553f4f83ac,
title = "Labels on Levels: Labeling of Multi-Scale Multi-Instance and Crowded 3D Biological Environments",
abstract = "Labeling is intrinsically important for exploring and understanding complex environments and models in a variety of domains. We present a method for interactive labeling of crowded 3D scenes containing very many instances of objects spanning multiple scales in size. In contrast to previous labeling methods, we target cases where many instances of dozens of types are present and where the hierarchical structure of the objects in the scene presents an opportunity to choose the most suitable level for each placed label. Our solution builds on and goes beyond labeling techniques in medical 3D visualization, cartography, and biological illustrations from books and prints. In contrast to these techniques, the main characteristics of our new technique are: 1) a novel way of labeling objects as part of a bigger structure when appropriate, 2) visual clutter reduction by labeling only representative instances for each type of an object, and a strategy of selecting those. The appropriate level of label is chosen by analyzing the scene's depth buffer and the scene objects' hierarchy tree. We address the topic of communicating the parent-children relationship between labels by employing visual hierarchy concepts adapted from graphic design. Selecting representative instances considers several criteria tailored to the character of the data and is combined with a greedy optimization approach. We demonstrate the usage of our method with models from mesoscale biology where these two characteristics - multi-scale and multi-instance - are abundant, along with the fact that these scenes are extraordinarily dense.",
keywords = "labeling, multi-instance data, multi-scale data",
author = "David Kouřil and Ladislav Čmol{\'i}k and Barbora Kozl{\'i}kov{\'a} and Wu, {Hslanc Yun} and Graham Johnson and David Goodsell and Arthur Olson and Gr{\"o}ller, {M. Eduard} and Ivan Viola",
year = "2019",
month = "1",
day = "1",
doi = "https://doi.org/10.1109/TVCG.2018.2864491",
language = "English (US)",
volume = "25",
pages = "977--986",
journal = "IEEE Transactions on Visualization and Computer Graphics",
issn = "1077-2626",
publisher = "IEEE Computer Society",
number = "1",

}

Kouřil, D, Čmolík, L, Kozlíková, B, Wu, HY, Johnson, G, Goodsell, D, Olson, A, Gröller, ME & Viola, I 2019, 'Labels on Levels: Labeling of Multi-Scale Multi-Instance and Crowded 3D Biological Environments', IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 1, 8440077, pp. 977-986. https://doi.org/10.1109/TVCG.2018.2864491

Labels on Levels : Labeling of Multi-Scale Multi-Instance and Crowded 3D Biological Environments. / Kouřil, David; Čmolík, Ladislav; Kozlíková, Barbora; Wu, Hslanc Yun; Johnson, Graham; Goodsell, David; Olson, Arthur; Gröller, M. Eduard; Viola, Ivan.

In: IEEE Transactions on Visualization and Computer Graphics, Vol. 25, No. 1, 8440077, 01.01.2019, p. 977-986.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Labels on Levels

T2 - Labeling of Multi-Scale Multi-Instance and Crowded 3D Biological Environments

AU - Kouřil, David

AU - Čmolík, Ladislav

AU - Kozlíková, Barbora

AU - Wu, Hslanc Yun

AU - Johnson, Graham

AU - Goodsell, David

AU - Olson, Arthur

AU - Gröller, M. Eduard

AU - Viola, Ivan

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Labeling is intrinsically important for exploring and understanding complex environments and models in a variety of domains. We present a method for interactive labeling of crowded 3D scenes containing very many instances of objects spanning multiple scales in size. In contrast to previous labeling methods, we target cases where many instances of dozens of types are present and where the hierarchical structure of the objects in the scene presents an opportunity to choose the most suitable level for each placed label. Our solution builds on and goes beyond labeling techniques in medical 3D visualization, cartography, and biological illustrations from books and prints. In contrast to these techniques, the main characteristics of our new technique are: 1) a novel way of labeling objects as part of a bigger structure when appropriate, 2) visual clutter reduction by labeling only representative instances for each type of an object, and a strategy of selecting those. The appropriate level of label is chosen by analyzing the scene's depth buffer and the scene objects' hierarchy tree. We address the topic of communicating the parent-children relationship between labels by employing visual hierarchy concepts adapted from graphic design. Selecting representative instances considers several criteria tailored to the character of the data and is combined with a greedy optimization approach. We demonstrate the usage of our method with models from mesoscale biology where these two characteristics - multi-scale and multi-instance - are abundant, along with the fact that these scenes are extraordinarily dense.

AB - Labeling is intrinsically important for exploring and understanding complex environments and models in a variety of domains. We present a method for interactive labeling of crowded 3D scenes containing very many instances of objects spanning multiple scales in size. In contrast to previous labeling methods, we target cases where many instances of dozens of types are present and where the hierarchical structure of the objects in the scene presents an opportunity to choose the most suitable level for each placed label. Our solution builds on and goes beyond labeling techniques in medical 3D visualization, cartography, and biological illustrations from books and prints. In contrast to these techniques, the main characteristics of our new technique are: 1) a novel way of labeling objects as part of a bigger structure when appropriate, 2) visual clutter reduction by labeling only representative instances for each type of an object, and a strategy of selecting those. The appropriate level of label is chosen by analyzing the scene's depth buffer and the scene objects' hierarchy tree. We address the topic of communicating the parent-children relationship between labels by employing visual hierarchy concepts adapted from graphic design. Selecting representative instances considers several criteria tailored to the character of the data and is combined with a greedy optimization approach. We demonstrate the usage of our method with models from mesoscale biology where these two characteristics - multi-scale and multi-instance - are abundant, along with the fact that these scenes are extraordinarily dense.

KW - labeling

KW - multi-instance data

KW - multi-scale data

UR - http://www.scopus.com/inward/record.url?scp=85051800308&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051800308&partnerID=8YFLogxK

U2 - https://doi.org/10.1109/TVCG.2018.2864491

DO - https://doi.org/10.1109/TVCG.2018.2864491

M3 - Article

VL - 25

SP - 977

EP - 986

JO - IEEE Transactions on Visualization and Computer Graphics

JF - IEEE Transactions on Visualization and Computer Graphics

SN - 1077-2626

IS - 1

M1 - 8440077

ER -