SAMI - Situational Awareness from Multimodal Input

:: home

:: people

:: research

We see three primary components in building end to end situational awareness technology, namely technology for situational data management, technology for situational data ingest and synthesis from raw input, and tools for analysis and visualization. We are exploring the following challenges:

Event Modeling

Data models for effectively capturing and representing events.

Publications:

U. Westermann, R. Jain. E - A Generic Event Model for Event-Centric Multimedia Data Management in eChronicle Applications. In Proc. of the IEEE Workshop on Electronic Chronicles (eChronicle 2006), Atlanta, Georgia, Apr. 2006. PDF

Event Storage

Efficient storage and data management of events, where events are treated as first-class data objects.

Publications:

Event Query Languages

Capability for high level situational queries over event information

Publications:

Event Indexing

Indexing techniques for efficient retrieval of event information. An area we have contributed to is representation and indexing of spatial references in text

Publications:

Dmitri V. Kalashnikov, Yiming Ma, Sharad Mehrotra, and Ram Hariharan. Index for Fast Retrieval of Uncertain Spatial Point Data . In Proc. of International Symposium on Advances in Geographic Information Systems (ACM GIS), Nov. 2006. PDF

Dmitri V. Kalashnikov , Yiming Ma, Sharad Mehrotra, and Ram Hariharan. Modeling and Querying Uncertain Spatial Information for Situational Awareness Applications. In Proc. of International Symposium on Advances in Geographic Information Systems (ACM GIS), Nov. 2006. PDF

Dmitri Kalashnikov, Yiming Ma, Sharad Mehrotra, Ram Hariharan, Nalini Venkatasubramanian. SAT: Spatial Awareness from Textual Input. EDBT 2006 (Demo) PDF

Knowledge Management and Semantics

The representation of and integrated with with domain knowledge and semantics in situational querying and analysis

Publications:

Event Extraction from Text

Extracting events from text. A particular focus is on exploiting domain knowledge, semantics, data, and common-sense in enhancing the extraction.

Publications:

Audio-Visual Event Extraction

Extraction of events from audio, visual, or audio-visual information streams

Publications:

M. M. Trivedi, T. L. Gandhi, K. S. Huang, "Distributed Interactive Video Arrays for Event Capture and Enhanced Situational Awareness," IEEE Intelligent Systems, Special Issue on AI in Homeland Security, Volume 20, Issue 5, Sept.-Oct. 2005 PDF

Information Disambiguation and Refinement

Automated information disambiguation and consolidation. We have made contributions to new and effective disambiguation techniques based on relationship analysis.

Publications:

Zhaoqi Chen, Dmitri V. Kalashnikov, Sharad Mehrotra. Adaptive Graphical Approach to Entity Resolution . In Proc. of the ACM IEEE Joint Conference on Digital Libraries (ACM IEEE JCDL), Vancouver, BC, Canada, June 2007. PDF

Rabia Nuray-Turan, Dmitri V. Kalashnikov, Sharad Mehrotra. Self-tuning in Graph-based Reference Disambiguation . In Proc. of the Int'l Conference on Databse Systems for Advance Applications (DASFAA), Bangkok, Thailand, Apr. 2007. PDF

Dmitri V. Kalashnikov, Sharad Mehrotra, Zhaoqi Chen, Rabia Nuray-Turan, Naveen Ashish. Disambiguation Algorithm for People Search on the Web . In Proc. of the IEEE International Conference on Data Engineering (IEEE ICDE), Istanbul, Turkey, Apr. 2007. PDF

Dmitri V. Kalashnikov and Sharad Mehrotra. Domain-independent data cleaning via analysis of entity-relationship graph . In ACM Transactions on Database Systems (ACM TODS) , 31(2):716-767, June 2006. PDF

Dmitri Kalashnikov, Sharad Mehrotra and Zhaoqi Chen. Exploiting Relationships for Domain-independent Data Cleaning. SIAM Data Mining (SDM) Conference 2005. PDF

Graph Analysis

Development of a graph algebra and graph query language, with a particular focus on querying and analyzing events and relationships represented as graphs

Publications:

GIS Integration

Integration of GIS information and datasets with presenting results of situational queries and analyses

Publications:

Ramaswamy Hariharan, Michal Shmueli-Scheuer, Chen Li and Sharad Mehrotra: Quality-driven approximate methods for integrating GIS data. GIS 2005. PDF

Damage Assesment Technologies

Integration of disaster loss and damage assesment technologies in situational information management systems

Publications:

Predictive Modeling and Inference

Bayesian modeling and inferencing techniques to able to aid in situational analysis that has a predictive inference element

Publications:

Vibhav Gogate, Bozhena Bidyuk and Rina Dechter, Studies in Lower Bounding Probability of Evidence using the Markov Inequality, In 23rd Conference on Uncertainty in Artificial Intelligence (UAI), 2007. PDF

Vibhav Gogate and Rina Dechter, Approximate Counting by Sampling the Backtrack-free Search Space, In 22nd Conference on Artificial Intelligence (AAAI), 2007. PDF

Vibhav Gogate and Rina Dechter, SampleSearch: A Scheme that Searches for Consistent Samples, In 11th International Conference on Artificial Intelligence and Statistics (AISTATS), 2007. PDF

Vibhav Gogate and Rina Dechter, A New Algorithm for Sampling CSP Solutions Uniformly at Random, In 12th International Conference on Principles and Practice of Constraint Programming (CP), 2006. PDF

Vibhav Gogate, Rina Dechter, Bozhena Bidyuk, James Marca and Craig Rindt, Modeling Travel and Activity Routines using Hybrid Dynamic Mixed Networks, In 85th annual meeting of the Transportation Research Board (TRB), 2006. PDF

Vibhav Gogate and Rina Dechter, Approximate Inference Algorithms for Hybrid Bayesian Networks with Discrete Constraints, In 21st Conference on Uncertainty in Artificial Intelligence (UAI), 2005. PDF

Vibhav Gogate, Rina Dechter, Bozhena Bidyuk, Craig Rindt and James Marca. Modeling Transportation Routines using Hybrid Dynamic Mixed Networks. UAI 2005. PDF

Information Reliability

Representation and reasoning of reliability measures for the information and information sources in situational systems

Publications: