What counts as an API call against my allowance?

Every call to the gateway counts, including refused ones — otherwise a broken loop hammering you with invalid keys would be free, and that's the traffic you most want to notice.

The allowance is pooled across the whole account, not per key. Adding keys doesn't add allowance. And if you're caching entitlement tokens properly your real usage is usually a fraction of your page views.