• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

Datta Lab

  • Research
  • The Basics
  • Academics
  • Lab Members
  • Life in the Lab
  • Publications
  • Links
  • Contact

Life in the Lab

February 18, 2023

ArMo: An Articulated Mesh Approach for Mouse 3D Reconstruction

James P. Bohnslav, Mohammed Abdal Monium Osman, Akshay Jaggi, Sofia Soares, Caleb Weinreb, Sandeep Robert Datta, and Christopher D. Harvey (2023)

ArMo: An Articulated Mesh Approach for Mouse 3D Reconstruction

Characterizing animal behavior requires methods to distill 3D movements from video data. Though keypoint tracking has emerged as a widely used solution to this problem, it only provides a limited view of pose, reducing the body of an animal to a sparse set of experimenter-defined points. To more completely capture 3D pose, recent studies have fit 3D mesh models to subjects in image and video data. However, despite the importance of mice as a model organism in neuroscience research, these methods have not been applied to the 3D reconstruction of mouse behavior. Here, we present ArMo, an articulated mesh model of the laboratory mouse, and demonstrate its application to multi-camera recordings of head-fixed mice running on a spherical treadmill. Using an end-to-end gradient based optimization procedure, we fit the shape and pose of a dense 3D mouse model to data-derived keypoint and point cloud observations. The resulting reconstructions capture the shape of the animal’s surface while compactly summarizing its movements as a time series of 3D skeletal joint angles. ArMo therefore provides a novel alternative to the sparse representations of pose more commonly used in neuroscience research.

Posted by

« Newer Posts
Older Post »

Primary Sidebar

Blog Archive

  • May 2024
  • June 2022
  • January 2022
  • December 2021
  • December 2020
  • November 2020
  • October 2020
  • August 2020
  • May 2020
  • April 2020
  • March 2020
  • January 2020
  • December 2019
  • November 2019
  • August 2019
  • June 2019
  • October 2018
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • February 2017
  • December 2016
  • November 2016
  • October 2016
  • July 2016
  • June 2016
  • April 2016
  • March 2016
  • December 2015
  • October 2015
  • September 2015
  • May 2015
  • October 2014
  • January 2014
  • January 2013
  • October 2012
  • June 2012
  • May 2012
  • February 2012
  • December 2011
  • October 2011
  • August 2011
  • July 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • November 2010
  • October 2010
  • September 2010
  • July 2010

HISTORY SHOWS AGAIN AND AGAIN HOW NATURE POINTS OUT THE FOLLY OF MEN – “GODZILLA,” BLUE OYSTER CULT

Sandeep Robert Datta, MD, Ph.D Department of Neurobiology Harvard Medical School