-
Temporal Grounding of Activities using Multimodal Large Language Models
Authors:
Young Chol Song
Abstract:
Temporal grounding of activities, the identification of specific time intervals of actions within a larger event context, is a critical task in video understanding. Recent advancements in multimodal large language models (LLMs) offer new opportunities for enhancing temporal reasoning capabilities. In this paper, we evaluate the effectiveness of combining image-based and text-based large language m…
▽ More
Temporal grounding of activities, the identification of specific time intervals of actions within a larger event context, is a critical task in video understanding. Recent advancements in multimodal large language models (LLMs) offer new opportunities for enhancing temporal reasoning capabilities. In this paper, we evaluate the effectiveness of combining image-based and text-based large language models (LLMs) in a two-stage approach for temporal activity localization. We demonstrate that our method outperforms existing video-based LLMs. Furthermore, we explore the impact of instruction-tuning on a smaller multimodal LLM, showing that refining its ability to process action queries leads to more expressive and informative outputs, thereby enhancing its performance in identifying specific time intervals of activities. Our experimental results on the Charades-STA dataset highlight the potential of this approach in advancing the field of temporal activity localization and video understanding.
△ Less
Submitted 30 May, 2024;
originally announced July 2024.
-
GNN-based Probabilistic Supply and Inventory Predictions in Supply Chain Networks
Authors:
Hyung-il Ahn,
Young Chol Song,
Santiago Olivar,
Hershel Mehta,
Naveen Tewari
Abstract:
Successful supply chain optimization must mitigate imbalances between supply and demand over time. While accurate demand prediction is essential for supply planning, it alone does not suffice. The key to successful supply planning for optimal and viable execution lies in maximizing predictability for both demand and supply throughout an execution horizon. Therefore, enhancing the accuracy of suppl…
▽ More
Successful supply chain optimization must mitigate imbalances between supply and demand over time. While accurate demand prediction is essential for supply planning, it alone does not suffice. The key to successful supply planning for optimal and viable execution lies in maximizing predictability for both demand and supply throughout an execution horizon. Therefore, enhancing the accuracy of supply predictions is imperative to create an attainable supply plan that matches demand without overstocking or understocking. However, in complex supply chain networks with numerous nodes and edges, accurate supply predictions are challenging due to dynamic node interactions, cascading supply delays, resource availability, production and logistic capabilities. Consequently, supply executions often deviate from their initial plans. To address this, we present the Graph-based Supply Prediction (GSP) probabilistic model. Our attention-based graph neural network (GNN) model predicts supplies, inventory, and imbalances using graph-structured historical data, demand forecasting, and original supply plan inputs. The experiments, conducted using historical data from a global consumer goods company's large-scale supply chain, demonstrate that GSP significantly improves supply and inventory prediction accuracy, potentially offering supply plan corrections to optimize executions.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Generative Probabilistic Planning for Optimizing Supply Chain Networks
Authors:
Hyung-il Ahn,
Santiago Olivar,
Hershel Mehta,
Young Chol Song
Abstract:
Supply chain networks in enterprises are typically composed of complex topological graphs involving various types of nodes and edges, accommodating numerous products with considerable demand and supply variability. However, as supply chain networks expand in size and complexity, traditional supply chain planning methods (e.g., those found in heuristic rule-based and operations research-based syste…
▽ More
Supply chain networks in enterprises are typically composed of complex topological graphs involving various types of nodes and edges, accommodating numerous products with considerable demand and supply variability. However, as supply chain networks expand in size and complexity, traditional supply chain planning methods (e.g., those found in heuristic rule-based and operations research-based systems) tend to become locally optimal or lack computational scalability, resulting in substantial imbalances between supply and demand across nodes in the network. This paper introduces a novel Generative AI technique, which we call Generative Probabilistic Planning (GPP). GPP generates dynamic supply action plans that are globally optimized across all network nodes over the time horizon for changing objectives like maximizing profits or service levels, factoring in time-varying probabilistic demand, lead time, and production conditions. GPP leverages attention-based graph neural networks (GNN), offline deep reinforcement learning (Offline RL), and policy simulations to train generative policy models and create optimal plans through probabilistic simulations, effectively accounting for various uncertainties. Our experiments using historical data from a global consumer goods company with complex supply chain networks demonstrate that GPP accomplishes objective-adaptable, probabilistically resilient, and dynamic planning for supply chain networks, leading to significant improvements in performance and profitability for enterprises. Our work plays a pivotal role in sha** the trajectory of AI adoption within the supply chain domain.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Microbial Life in a Liquid Asphalt Desert
Authors:
Dirk Schulze-Makuch,
Shirin Haque,
Marina Resendes de Sousa Antonio,
Denzil Ali,
Riad Hosein,
Young C. Song,
**shu Yang,
Elena Zaikova,
Denise M. Beckles,
Edward Guinan,
Harry J. Lehto,
Steven J. Hallam
Abstract:
An active microbiota, reaching up to 10 E+7 cells/g, was found to inhabit a naturally occurring asphalt lake characterized by low water activity and elevated temperature. Geochemical and molecular taxonomic approaches revealed novel and deeply branching microbial assemblages mediating anaerobic hydrocarbon degradation, metal respiration and C1 utilization pathways. These results open a window into…
▽ More
An active microbiota, reaching up to 10 E+7 cells/g, was found to inhabit a naturally occurring asphalt lake characterized by low water activity and elevated temperature. Geochemical and molecular taxonomic approaches revealed novel and deeply branching microbial assemblages mediating anaerobic hydrocarbon degradation, metal respiration and C1 utilization pathways. These results open a window into the origin and adaptive evolution of microbial life within recalcitrant hydrocarbon matrices, and establish the site as a useful analog for the liquid hydrocarbon environments on Saturn's moon Titan.
△ Less
Submitted 21 July, 2010; v1 submitted 12 April, 2010;
originally announced April 2010.