Please note that when a Playlist is opened, all Application, Option Set and Checking Rule information is cached for performance reasons. This means that if you create a brand new item or even just a new version that you wish to reference in your Playlist, the Playlist must be closed and re-opened to have the new items available.