Skip to main content

Showing 1–20 of 20 results for author: Fowlkes, C C

Searching in archive cs. Search in all archives.
.
  1. arXiv:2205.02361  [pdf, other

    cs.CV

    Creating a Forensic Database of Shoeprints from Online Shoe Tread Photos

    Authors: Samia Shafique, Bailey Kong, Shu Kong, Charless C. Fowlkes

    Abstract: Shoe tread impressions are one of the most common types of evidence left at crime scenes. However, the utility of such evidence is limited by the lack of databases of footwear prints that cover the large and growing number of distinct shoe models. Moreover, the database is preferred to contain the 3D shape, or depth, of shoe-tread photos so as to allow for extracting shoeprints to match a query (c… ▽ More

    Submitted 20 October, 2022; v1 submitted 4 May, 2022; originally announced May 2022.

    Comments: published in WACV 2023; 8 pages including 11 figures and 3 tables; contains reference and appendix

  2. arXiv:2109.02161  [pdf, other

    cs.AI

    Modular Framework for Visuomotor Language Grounding

    Authors: Kolby Nottingham, Litian Liang, Daeyun Shin, Charless C. Fowlkes, Roy Fox, Sameer Singh

    Abstract: Natural language instruction following tasks serve as a valuable test-bed for grounded language and robotics research. However, data collection for these tasks is expensive and end-to-end approaches suffer from data inefficiency. We propose the structuring of language, acting, and visual tasks into separate modules that can be trained independently. Using a Language, Action, and Vision (LAV) frame… ▽ More

    Submitted 5 September, 2021; originally announced September 2021.

  3. arXiv:2004.03143  [pdf, other

    cs.CV

    Predicting Camera Viewpoint Improves Cross-dataset Generalization for 3D Human Pose Estimation

    Authors: Zhe Wang, Daeyun Shin, Charless C. Fowlkes

    Abstract: Monocular estimation of 3d human pose has attracted increased attention with the availability of large ground-truth motion capture datasets. However, the diversity of training data available is limited and it is not clear to what extent methods generalize outside the specific datasets they are trained on. In this work we carry out a systematic study of the diversity and biases present in specific… ▽ More

    Submitted 7 April, 2020; originally announced April 2020.

    Comments: http://wangzheallen.github.io/cross-dataset-generalization

  4. arXiv:1908.06552  [pdf, other

    cs.CV

    Weakly-supervised Action Localization with Background Modeling

    Authors: Phuc Xuan Nguyen, Deva Ramanan, Charless C. Fowlkes

    Abstract: We describe a latent approach that learns to detect actions in long sequences given training videos with only whole-video class labels. Our approach makes use of two innovations to attention-modeling in weakly-supervised learning. First, and most notably, our framework uses an attention model to extract both foreground and background frames whose appearance is explicitly modeled. Most prior works… ▽ More

    Submitted 18 August, 2019; originally announced August 2019.

    Comments: To appear at ICCV 2019

  5. arXiv:1902.06729  [pdf, other

    cs.CV

    3D Scene Reconstruction with Multi-layer Depth and Epipolar Transformers

    Authors: Daeyun Shin, Zhile Ren, Erik B. Sudderth, Charless C. Fowlkes

    Abstract: We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered, multi-layer representation of scene geometry adapted from recent methods for single object shape completion. To improve the accuracy of view-centered representat… ▽ More

    Submitted 27 August, 2019; v1 submitted 18 February, 2019; originally announced February 2019.

    Comments: Accepted at ICCV 2019. Paper title changed. Project web page: https://research.dshin.org/iccv19/multi-layer-depth

  6. arXiv:1806.10309  [pdf, other

    cs.CG

    CeMNet: Self-supervised learning for accurate continuous ego-motion estimation

    Authors: Minhaeng Lee, Charless C. Fowlkes

    Abstract: In this paper, we propose a novel self-supervised learning model for estimating continuous ego-motion from video. Our model learns to estimate camera motion by watching RGBD or RGB video streams and determining translational and rotation velocities that correctly predict the appearance of future frames. Our approach differs from other recent work on self-supervised structure-from-motion in its use… ▽ More

    Submitted 27 June, 2018; originally announced June 2018.

  7. arXiv:1804.06032  [pdf, other

    cs.CV

    Pixels, voxels, and views: A study of shape representations for single view 3D object shape prediction

    Authors: Daeyun Shin, Charless C. Fowlkes, Derek Hoiem

    Abstract: The goal of this paper is to compare surface-based and volumetric 3D object shape representations, as well as viewer-centered and object-centered reference frames for single-view 3D shape prediction. We propose a new algorithm for predicting depth maps from multiple viewpoints, with a single depth or RGB image as input. By modifying the network and the way models are evaluated, we can directly com… ▽ More

    Submitted 11 June, 2018; v1 submitted 16 April, 2018; originally announced April 2018.

    Comments: CVPR 2018

  8. Cross-Domain Image Matching with Deep Feature Maps

    Authors: Bailey Kong, James Supancic, Deva Ramanan, Charless C. Fowlkes

    Abstract: We investigate the problem of automatically determining what type of shoe left an impression found at a crime scene. This recognition problem is made difficult by the variability in types of crime scene evidence (ranging from traces of dust or oil on hard surfaces to impressions made in soil) and the lack of comprehensive databases of shoe outsole tread patterns. We find that mid-level features ex… ▽ More

    Submitted 1 October, 2018; v1 submitted 6 April, 2018; originally announced April 2018.

  9. arXiv:1710.01820  [pdf, other

    cs.CV

    Energy-Based Spherical Sparse Coding

    Authors: Bailey Kong, Charless C. Fowlkes

    Abstract: In this paper, we explore an efficient variant of convolutional sparse coding with unit norm code vectors where reconstruction quality is evaluated using an inner product (cosine distance). To use these codes for discriminative classification, we describe a model we term Energy-Based Spherical Sparse Coding (EB-SSC) in which the hypothesized class label introduces a learned linear bias into the co… ▽ More

    Submitted 4 October, 2017; originally announced October 2017.

  10. arXiv:1612.01689  [pdf, other

    cs.CV

    Cluster-Wise Ratio Tests for Fast Camera Localization

    Authors: Raúl Díaz, Charless C. Fowlkes

    Abstract: Feature point matching for camera localization suffers from scalability problems. Even when feature descriptors associated with 3D scene points are locally unique, as coverage grows, similar or repeated features become increasingly common. As a result, the standard distance ratio-test used to identify reliable image feature points is overly restrictive and rejects many good candidate matches. We p… ▽ More

    Submitted 20 May, 2017; v1 submitted 6 December, 2016; originally announced December 2016.

  11. Learning Optimal Parameters for Multi-target Tracking with Contextual Interactions

    Authors: Shaofei Wang, Charless C. Fowlkes

    Abstract: We describe an end-to-end framework for learning parameters of min-cost flow multi-target tracking problem with quadratic trajectory interactions including suppression of overlap** tracks and contextual cues about cooccurrence of different objects. Our approach utilizes structured prediction with a tracking-specific loss function to learn the complete set of model parameters. In this learning fr… ▽ More

    Submitted 5 October, 2016; originally announced October 2016.

    Comments: arXiv admin note: text overlap with arXiv:1412.2066

  12. arXiv:1605.02264  [pdf, other

    cs.CV

    Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation

    Authors: Golnaz Ghiasi, Charless C. Fowlkes

    Abstract: CNN architectures have terrific recognition performance but rely on spatial pooling which makes it difficult to adapt them to tasks that require dense, pixel-accurate labeling. This paper makes two contributions: (1) We demonstrate that while the apparent spatial resolution of convolutional feature maps is low, the high-dimensional feature representation contains significant sub-pixel localization… ▽ More

    Submitted 30 July, 2016; v1 submitted 7 May, 2016; originally announced May 2016.

  13. arXiv:1507.03698  [pdf, other

    cs.CV

    Lifting GIS Maps into Strong Geometric Context for Scene Understanding

    Authors: Raúl Díaz, Minhaeng Lee, Jochen Schubert, Charless C. Fowlkes

    Abstract: Contextual information can have a substantial impact on the performance of visual tasks such as semantic segmentation, object detection, and geometric estimation. Data stored in Geographic Information Systems (GIS) offers a rich source of contextual information that has been largely untapped by computer vision. We propose to leverage such information for scene understanding by combining GIS reso… ▽ More

    Submitted 8 January, 2016; v1 submitted 13 July, 2015; originally announced July 2015.

  14. arXiv:1507.02407  [pdf, other

    cs.DS cs.CG cs.CV

    Planar Ultrametric Rounding for Image Segmentation

    Authors: Julian Yarkony, Charless C. Fowlkes

    Abstract: We study the problem of hierarchical clustering on planar graphs. We formulate this in terms of an LP relaxation of ultrametric rounding. To solve this LP efficiently we introduce a dual cutting plane scheme that uses minimum cost perfect matching as a subroutine in order to efficiently explore the space of planar partitions. We apply our algorithm to the problem of hierarchical image segmentation… ▽ More

    Submitted 9 September, 2015; v1 submitted 9 July, 2015; originally announced July 2015.

    MSC Class: 68T45

  15. arXiv:1506.08347  [pdf, other

    cs.CV

    Occlusion Coherence: Detecting and Localizing Occluded Faces

    Authors: Golnaz Ghiasi, Charless C. Fowlkes

    Abstract: The presence of occluders significantly impacts object recognition accuracy. However, occlusion is typically treated as an unstructured source of noise and explicit models for occluders have lagged behind those for object appearance and shape. In this paper we describe a hierarchical deformable part model for face detection and landmark localization that explicitly models part occlusion. The propo… ▽ More

    Submitted 24 August, 2016; v1 submitted 27 June, 2015; originally announced June 2015.

  16. arXiv:1412.4181  [pdf, other

    cs.CV

    Oriented Edge Forests for Boundary Detection

    Authors: Sam Hallman, Charless C. Fowlkes

    Abstract: We present a simple, efficient model for learning boundary detection based on a random forest classifier. Our approach combines (1) efficient clustering of training examples based on simple partitioning of the space of local edge orientations and (2) scale-dependent calibration of individual tree output probabilities prior to multiscale combination. The resulting model outperforms published result… ▽ More

    Submitted 28 June, 2015; v1 submitted 12 December, 2014; originally announced December 2014.

    Comments: updated to include contents of CVPR version + new figure showing example segmentation results

  17. arXiv:1412.2066  [pdf, other

    cs.CV cs.LG

    Learning Multi-target Tracking with Quadratic Object Interactions

    Authors: Shaofei Wang, Charless C. Fowlkes

    Abstract: We describe a model for multi-target tracking based on associating collections of candidate detections across frames of a video. In order to model pairwise interactions between different tracks, such as suppression of overlap** tracks and contextual cues about co-occurence of different objects, we augment a standard min-cost flow objective with quadratic terms between detection variables. We lea… ▽ More

    Submitted 9 December, 2014; v1 submitted 5 December, 2014; originally announced December 2014.

  18. arXiv:1208.0378  [pdf, other

    cs.CV cs.DS cs.LG stat.ML

    Fast Planar Correlation Clustering for Image Segmentation

    Authors: Julian Yarkony, Alexander T. Ihler, Charless C. Fowlkes

    Abstract: We describe a new optimization scheme for finding high-quality correlation clusterings in planar graphs that uses weighted perfect matching as a subroutine. Our method provides lower-bounds on the energy of the optimal correlation clustering that are typically fast to compute and tight in practice. We demonstrate our algorithm on the problem of image segmentation where this approach outperforms ex… ▽ More

    Submitted 1 August, 2012; originally announced August 2012.

    Comments: This is the extended version of a paper to appear at the 12th European Conference on Computer Vision (ECCV 2012)

  19. arXiv:1202.3771  [pdf

    cs.LG stat.ML

    Tightening MRF Relaxations with Planar Subproblems

    Authors: Julian Yarkony, Ragib Morshed, Alexander T. Ihler, Charless C. Fowlkes

    Abstract: We describe a new technique for computing lower-bounds on the minimum energy configuration of a planar Markov Random Field (MRF). Our method successively adds large numbers of constraints and enforces consistency over binary projections of the original problem state space. These constraints are represented in terms of subproblems in a dual-decomposition framework that is optimized using subgradien… ▽ More

    Submitted 14 February, 2012; originally announced February 2012.

    Report number: UAI-P-2011-PG-770-777

  20. arXiv:1104.1204  [pdf, other

    stat.ML cs.DS

    Planar Cycle Covering Graphs

    Authors: Julian Yarkony, Alexander T. Ihler, Charless C. Fowlkes

    Abstract: We describe a new variational lower-bound on the minimum energy configuration of a planar binary Markov Random Field (MRF). Our method is based on adding auxiliary nodes to every face of a planar embedding of the graph in order to capture the effect of unary potentials. A ground state of the resulting approximation can be computed efficiently by reduction to minimum-weight perfect matching. We sho… ▽ More

    Submitted 6 April, 2011; originally announced April 2011.