An agent framework that assists with the interpretation of streaming physiological data is presented. The framework operates as a module within an existing remote monitoring system for streaming physiological data. Agents complement the remote monitoring system by enhancing the users' view of the signals through the addition of annotations and the creation of derived views of the signals. © 2011 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering.