Video alarm management enhanced by generative AI plug-in

Milestone Systems has announced a forthcoming generative AI-powered video analytics plug-in for its XProtect video management software, developed in collaboration with NVIDIA.

Designed to help operators contextualise alarms and focus on what truly matters, the new tool is said to automate video review, filters out false alarms and based on initial findings could reduce up to 30% of operator alarm fatigue.

A beta version will reportedly debut at Smart City Expo World Congress in Barcelona, November 4-6, with general availability coming later this year.

Leveraging generative AI

According to the company, today’s video systems capture vast amounts of data, yet reviewing footage remains time consuming and largely manual.

Milestone Systems’ new XProtect plug-in is said to address this challenge by leveraging generative AI to automatically summarise, contextualise and validate video content in real time, helping teams respond faster, manage video more efficiently and effectively reduce operator alarm fatigue.

Key capabilities include:

• Automated incident reports: Selected video clips are instantly converted into incident summaries and structured reports, helping operators reduce time spent on documentation
• Event validation: The plug-in can be configured to analyse motion events and validate alarms, reducing false positives and improving alert handling. This feature is fully integrated with the XProtect rule engine
• Contextual bookmark summaries: Bookmarked footage is automatically summarised using natural-language output, allowing fast triage without reviewing each clip manually

The plug-in reportedly integrates directly with the XProtect rule engine and is deployable on-premises or in the cloud to support compliance and deployment flexibility.

Ethical real-world data

This new solution is said to be built on Milestone’s Hafnia Vision Language Model (VLM) trained on 75,000 hours of ethically sourced, real-world video data from either Europe or the US, using NVIDIA Cosmos Curator for data preparation and running either on cloud infrastructure or regional data centers powered by NVIDIA.

Milestone has reported that it leverages the NVIDIA Cosmos Reason VLM, making it one of the most advanced and compliant video AI platforms in the industry.

“A pivotal step in our mission”

Thomas Jensen, CEO, Milestone Systems said: “With this new XProtect plug-in, we are making advanced video intelligence accessible to cities, organisations and operators everywhere who manage traffic systems – helping them unlock new levels of efficiency, safety and insight.

“XProtect users will get access to state-of-the-art generative AI capabilities and our partners will be able to build value on top of those new capabilities now available within XProtect.

“It truly marks a pivotal step in our mission to transform how the world manages and learns from visual data, responsibly and at scale.”