Dr. Daniel Reininger, President & CEO
The proliferation of high definition cameras for security and surveillance applications has created a flood of video data. Given the increasing quantity, this data can neither be quickly processed, nor can it be used to prevent threats. Since manual review of security and surveillance video is exceptionally time-consuming and cumbersome, automatic means to triage this firehose of data is a necessity.
Perfectly poised to address this challenge is—Semandex Networks—a pioneer in the development of semantic software for information management. The company develops software to transform large volumes of data into actionable information. It is renowned for developing effective solutions for the most challenging data analysis tasks facing national security, law enforcement, and information assurance professionals.
Since 2000, Semandex develops technologies that can ingest and correlate data from structured and unstructured sources, identifying connections in the data. The company’s customer base is the Federal Government, in particular the Department of Defense and other government agencies.
The SALSA VIP platform
Semandex partnered with iGolgi— one of the leading companies that develops video processing solutions for commercial broadcast, distribution and analytics—to create the Semantic Analysis and Linking for Situational Awareness (SALSA), Video Intelligence Platform (VIP). “Since 2000, Semandex has developed a technology that can ingest and correlate data from structured and unstructured sources, identifying connections in the data. SALSA VIP platform was developed to provide solutions that are capable of processing a large number of video feeds in near real-time as well as massive amounts of archived video to identify only portions that are worth noticing,” asserts Dr. Daniel Reininger, President and CEO at Semandex Networks.
SALSA VIP creates a Video Knowledge Graph (VKG) that improves the confidence of identification and localization of objects of interest, enables similarity matching, anomalies identification, and automated alerting. The SALSA VIP VKG provides security personnel a unique Common Intelligence Picture (CIP) that identifies objects of interest and alert of suspicious activities. This CIP incorporates information visualization principles from cognitive engineering to orient personnel to where to look and to help identify and track objects of interest.
Combining Traditional Pattern Recognition and AI Techniques
We have built extensive know-how over years of past performance and developing customer-specific solutions
The Semandex iGolgi Intelligent Video Technology Solution utilizes deep learning, pattern recognition, and graph clustering algorithms to identify, characterize, and track objects of interest, index them, and enable visual search and match functionality. SALSA VIP integrates data from a variety of video sources and disparate sensors. It detects, characterizes, and tracks objects of interest across large camera networks. The solution continuously performs data analytics to correlate similar observations across both space and time and derive patterns of activity of objects that are arriving/ departing from an area of interest. It enables visual searches to determine when and where an object of interest has been seen before.
SALSA VIP efficiently extracts useful analytics at the pixel layer using a combination of traditional pattern recognition and AI techniques. It then uses that information to make informed higher-level semantic decisions. This unique capability allows SALSA VIP to integrate visual search and alerting in order to remove the need for long, manual sifting through large quantities of video data to identify objects and activities of interest. Moreover, it directs personnel attention quickly with less false alarm rates (FARs).
Reliable, Scalable and Efficient Data Processing
To protect the critical infrastructure of a facility, SALSA VIP provides advanced analytics using distributed sensors placed inside, outside and on the perimeter of a critical facility. While conventional Physical Security Information Management (PSIM) solutions only monitor critical areas of the facility and trigger automatic alerts when unauthorized activity occurs, SALSA VIP further exploits sensor data to continuously characterize and track objects in the environment to maintain the facility on a proactive “left-of-incident” security stance.
The SALSA VIP software consists of a series of services deployed as containers that can be installed on commodity computing servers supporting high availability replicated servers for automatic failover—delivering reliable, scalable and efficient data processing. While the SALSA VIP API enables rapid integration with IP-based network sensors and physical security products, an SDK allows for augmenting SALSA by integrating new devices, capabilities, and custom functionality.
Having been in the business for 20 years dealing with problems of large data analytics and data processing, Semandex has created a niche in the market due to its effective solutions. “We have built extensive know-how over years of past performance and developing customer-specific solutions. This allows us to customize our products and address the evolving customer requirements in diverse operational environments effectively,” concludes Dr. Reininger.