First, how well do you tip the delivery driver? Living in the "wealthiest neighborhood" means squat when the "wealthy" don't tip.

Is your neighborhood a gated community? That might explain reluctance to deliver. Difficult and slow to get in and out.

Since the store is merely 3 miles and 5 minutes away, you might consider driving there yourself or ordering on the way home. Then, you won't have that pesky "tip or not" issue.

You might try "disallowing" deliveries from Jimmy John's to your hospital. But if the Peds staff or Obstetrics Nurses decide that they want Jimmy John's, someone will go out to get it. Or have a spouse bring it in. You might "disallow" delivery, but you can't very well prohibit hospital employees from eating what they want, from where they want.

I don't even know what to say about the implicit racism, except that I can't believe that an esteemed, wealthy doctor like you would even bring that up.