Hi Rhys,
On a given design, you can go to ‘View’ (ribbon), ‘Display’, ‘Options’ and uncheck ‘Named View Wall Annotations’.
To disable for all designs, you can go to ‘File’, ‘Options’, ‘Named Views’, ‘Automatic Creation of Named Elevation Views Settings’ and uncheck ‘Show corresponding wall annotations in plan view’.
Cheers,
Jim