Skip to main content

Showing 1–15 of 15 results for author: Schwartz, G

Searching in archive cs. Search in all archives.
.
  1. arXiv:2405.02508  [pdf, other

    cs.CV cs.GR

    Rasterized Edge Gradients: Handling Discontinuities Differentiably

    Authors: Stanislav Pidhorskyi, Tomas Simon, Gabriel Schwartz, He Wen, Yaser Sheikh, Jason Saragih

    Abstract: Computing the gradients of a rendering process is paramount for diverse applications in computer vision and graphics. However, accurate computation of these gradients is challenging due to discontinuities and rendering approximations, particularly for surface-based representations and rasterization-based rendering. We present a novel method for computing gradients at visibility discontinuities for… ▽ More

    Submitted 16 May, 2024; v1 submitted 3 May, 2024; originally announced May 2024.

  2. arXiv:2312.03704  [pdf, other

    cs.GR cs.CV

    Relightable Gaussian Codec Avatars

    Authors: Shunsuke Saito, Gabriel Schwartz, Tomas Simon, Junxuan Li, Giljoo Nam

    Abstract: The fidelity of relighting is bounded by both geometry and appearance representations. For geometry, both mesh and volumetric approaches have difficulty modeling intricate structures like 3D hair geometry. For appearance, existing relighting models are limited in fidelity and often too slow to render in real-time with high-resolution continuous environments. In this work, we present Relightable Ga… ▽ More

    Submitted 27 May, 2024; v1 submitted 6 December, 2023; originally announced December 2023.

    Comments: CVPR2024 (Oral) Website: https://shunsukesaito.github.io/rgca/

  3. arXiv:2305.19245  [pdf, other

    cs.CV

    AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation

    Authors: Thu Nguyen-Phuoc, Gabriel Schwartz, Yuting Ye, Stephen Lombardi, Lei Xiao

    Abstract: This paper presents a method that can quickly adapt dynamic 3D avatars to arbitrary text descriptions of novel styles. Among existing approaches for avatar stylization, direct optimization methods can produce excellent results for arbitrary styles but they are unpleasantly slow. Furthermore, they require redoing the optimization process from scratch for every new input. Fast approximation methods… ▽ More

    Submitted 30 May, 2023; originally announced May 2023.

    Comments: 10 main pages, 14 figures. Project page: https://alteredavatar.github.io

  4. arXiv:2303.14114  [pdf, other

    cs.CV cs.NE

    Object Motion Sensitivity: A Bio-inspired Solution to the Ego-motion Problem for Event-based Cameras

    Authors: Shay Snyder, Hunter Thompson, Md Abdullah-Al Kaiser, Gregory Schwartz, Akhilesh Jaiswal, Maryam Parsa

    Abstract: Neuromorphic (event-based) image sensors draw inspiration from the human-retina to create an electronic device that can process visual stimuli in a way that closely resembles its biological counterpart. These sensors process information significantly different than the traditional RGB sensors. Specifically, the sensory information generated by event-based image sensors are orders of magnitude spar… ▽ More

    Submitted 14 April, 2023; v1 submitted 24 March, 2023; originally announced March 2023.

    Comments: This document is 9 pages and has 6 figures, tables, and algorithms

  5. arXiv:2103.01954  [pdf, other

    cs.GR cs.CV

    Mixture of Volumetric Primitives for Efficient Neural Rendering

    Authors: Stephen Lombardi, Tomas Simon, Gabriel Schwartz, Michael Zollhoefer, Yaser Sheikh, Jason Saragih

    Abstract: Real-time rendering and animation of humans is a core function in games, movies, and telepresence applications. Existing methods have a number of drawbacks we aim to address with our work. Triangle meshes have difficulty modeling thin structures like hair, volumetric representations like Neural Volumes are too low-resolution given a reasonable memory budget, and high-resolution implicit representa… ▽ More

    Submitted 6 May, 2021; v1 submitted 2 March, 2021; originally announced March 2021.

    Comments: 13 pages; SIGGRAPH 2021

  6. Neural Volumes: Learning Dynamic Renderable Volumes from Images

    Authors: Stephen Lombardi, Tomas Simon, Jason Saragih, Gabriel Schwartz, Andreas Lehrmann, Yaser Sheikh

    Abstract: Modeling and rendering of dynamic scenes is challenging, as natural scenes often contain complex phenomena such as thin structures, evolving topology, translucency, scattering, occlusion, and biological motion. Mesh-based reconstruction and tracking often fail in these cases, and other approaches (e.g., light field video) typically rely on constrained viewing conditions, which limit interactivity.… ▽ More

    Submitted 18 June, 2019; originally announced June 2019.

    Comments: Accepted to SIGGRAPH 2019

    Journal ref: ACM Transactions on Graphics (SIGGRAPH 2019) 38, 4, Article 65

  7. arXiv:1801.03127  [pdf, other

    cs.CV

    Recognizing Material Properties from Images

    Authors: Gabriel Schwartz, Ko Nishino

    Abstract: Humans rely on properties of the materials that make up objects to guide our interactions with them. Gras** smooth materials, for example, requires care, and softness is an ideal property for fabric used in bedding. Even when these properties are not visual (e.g. softness is a physical property), we may still infer their presence visually. We refer to such material properties as visual material… ▽ More

    Submitted 9 January, 2018; originally announced January 2018.

  8. arXiv:1611.09394  [pdf, other

    cs.CV

    Material Recognition from Local Appearance in Global Context

    Authors: Gabriel Schwartz, Ko Nishino

    Abstract: Recognition of materials has proven to be a challenging problem due to the wide variation in appearance within and between categories. Global image context, such as where the material is or what object it makes up, can be crucial to recognizing the material. Existing methods, however, operate on an implicit fusion of materials and context by using large receptive fields as input (i.e., large image… ▽ More

    Submitted 12 April, 2017; v1 submitted 28 November, 2016; originally announced November 2016.

  9. arXiv:1605.02688  [pdf, other

    cs.SC cs.LG cs.MS

    Theano: A Python framework for fast computation of mathematical expressions

    Authors: The Theano Development Team, Rami Al-Rfou, Guillaume Alain, Amjad Almahairi, Christof Angermueller, Dzmitry Bahdanau, Nicolas Ballas, Frédéric Bastien, Justin Bayer, Anatoly Belikov, Alexander Belopolsky, Yoshua Bengio, Arnaud Bergeron, James Bergstra, Valentin Bisson, Josh Bleecher Snyder, Nicolas Bouchard, Nicolas Boulanger-Lewandowski, Xavier Bouthillier, Alexandre de Brébisson, Olivier Breuleux, Pierre-Luc Carrier, Kyunghyun Cho, Jan Chorowski, Paul Christiano , et al. (88 additional authors not shown)

    Abstract: Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has been one of the most used CPU and GPU mathematical compilers - especially in the machine learning community - and has shown steady performance improvements. Theano is being actively and continuously developed since 2008, mu… ▽ More

    Submitted 9 May, 2016; originally announced May 2016.

    Comments: 19 pages, 5 figures

  10. arXiv:1604.01345  [pdf, other

    cs.CV

    Integrating Local Material Recognition with Large-Scale Perceptual Attribute Discovery

    Authors: Gabriel Schwartz, Ko Nishino

    Abstract: Material attributes have been shown to provide a discriminative intermediate representation for recognizing materials, especially for the challenging task of recognition from local material appearance (i.e., regardless of object and scene context). In the past, however, material attributes have been recognized separately preceding category recognition. In contrast, neuroscience studies on material… ▽ More

    Submitted 12 April, 2017; v1 submitted 5 April, 2016; originally announced April 2016.

  11. arXiv:1603.08853  [pdf, other

    cs.GT

    Effects of Information Heterogeneity in Bayesian Routing Games

    Authors: Jeffrey Liu, Saurabh Amin, Galina Schwartz

    Abstract: This article studies the value of information in route choice decisions when a fraction of players have access to high accuracy information about traffic incidents relative to others. To model such environments, we introduce a Bayesian congestion game, in which players have private information about incidents, and each player chooses her route on a network of parallel links. The links are prone to… ▽ More

    Submitted 29 March, 2016; originally announced March 2016.

  12. arXiv:1602.07615  [pdf, ps, other

    cs.NI cs.GT

    Content Providers Volunteering to Pay Network Providers: Better than Neutrality?

    Authors: Patrick Maillé, Galina Schwartz

    Abstract: This paper studies the effects on user welfare of imposing network neutrality, using a game-theoretic model of provider interactions based on a two-sided market framework: we assume that the platform--the last-mile access providers (ISPs)--are monopolists, and consider content providers (CPs) entry decisions. All decisions affect the choices made by users, who are sensitive both to CP and ISP inve… ▽ More

    Submitted 24 February, 2016; originally announced February 2016.

  13. arXiv:1404.7173  [pdf, other

    cs.AI

    Nonmonotonic Reasoning as a Temporal Activity

    Authors: Daniel G. Schwartz

    Abstract: A {\it dynamic reasoning system} (DRS) is an adaptation of a conventional formal logical system that explicitly portrays reasoning as a temporal activity, with each extralogical input to the system and each inference rule application being viewed as occurring at a distinct time step. Every DRS incorporates some well-defined logic together with a controller that serves to guide the reasoning proces… ▽ More

    Submitted 28 April, 2014; originally announced April 2014.

    Comments: Proceedings of the 15th International Workshop on Non-Monotonic Reasoning (NMR 2014), Vienna, Austria, 17-19 July 2014

  14. arXiv:1308.5374  [pdf, other

    cs.AI cs.LO

    Dynamic Reasoning Systems

    Authors: Daniel G. Schwartz

    Abstract: A {\it dynamic reasoning system} (DRS) is an adaptation of a conventional formal logical system that explicitly portrays reasoning as a temporal activity, with each extralogical input to the system and each inference rule application being viewed as occurring at a distinct time step. Every DRS incorporates some well-defined logic together with a controller that serves to guide the reasoning proces… ▽ More

    Submitted 24 August, 2013; originally announced August 2013.

  15. Incentive Mechanisms for Internet Congestion Management: Fixed-Budget Rebate versus Time-of-Day Pricing

    Authors: Patrick Loiseau, Galina Schwartz, John Musacchio, Saurabh Amin, S. Shankar Sastry

    Abstract: Mobile data traffic has been steadily rising in the past years. This has generated a significant interest in the deployment of incentive mechanisms to reduce peak-time congestion. Typically, the design of these mechanisms requires information about user demand and sensitivity to prices. Such information is naturally imperfect. In this paper, we propose a \emph{fixed-budget rebate mechanism} that g… ▽ More

    Submitted 29 May, 2013; originally announced May 2013.

    Comments: To appear in IEEE/ACM Transactions on Networking