There is a section in the CMS called "Alert Section" - if you rename it, it will not show up. To turn it on and off, you can add "off" to the end of the section name (ie: Alert Section - off) and then name is back to Alert Section if you want to turn it back on.

The "description" field shows the text on the flag, and the content area will show up in the alert on the page.