Solution:
RewriteRule ^(blog|wordpress)($|/) - [L]
The above htaccess rule applied before any of the other rules seems to work!
