Augmenting Sports Videos with VisCommentator

Zhutian Chen, Shuainan Ye, Xiangtong Chu, Haijun Xia, Hui Zhang, Huamin Qu, Yingcai Wu

Research output: Contribution to journalArticlepeer-review

48 Scopus citations

Abstract

Visualizing data in sports videos is gaining traction in sports analytics, given its ability to communicate insights and explicate player strategies engagingly. However, augmenting sports videos with such data visualizations is challenging, especially for sports analysts, as it requires considerable expertise in video editing. To ease the creation process, we present a design space that characterizes augmented sports videos at an element-level (what the constituents are) and clip-level (how those constituents are organized). We do so by systematically reviewing 233 examples of augmented sports videos collected from TV channels, teams, and leagues. The design space guides selection of data insights and visualizations for various purposes. Informed by the design space and close collaboration with domain experts, we design VisCommentator, a fast prototyping tool, to eases the creation of augmented table tennis videos by leveraging machine learning-based data extractors and design space-based visualization recommendations. With VisCommentator, sports analysts can create an augmented video by selecting the data to visualize instead of manually drawing the graphical marks. Our system can be generalized to other racket sports (e.g., tennis, badminton) once the underlying datasets and models are available. A user study with seven domain experts shows high satisfaction with our system, confirms that the participants can reproduce augmented sports videos in a short period, and provides insightful implications into future improvements and opportunities.

Original languageEnglish (US)
Pages (from-to)824-834
Number of pages11
JournalIEEE Transactions on Visualization and Computer Graphics
Volume28
Issue number1
DOIs
StatePublished - Jan 1 2022
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 1995-2012 IEEE.

Keywords

  • Augmented Sports Videos
  • Intelligent Design Tool
  • Sports visualization
  • Storytelling
  • Video-based Visualization

Fingerprint

Dive into the research topics of 'Augmenting Sports Videos with VisCommentator'. Together they form a unique fingerprint.

Cite this