I'm curious...the clip was in the gun, but wasn't "locked in?" What kind of gun was it? I've always carried/transported handguns with the magazine either in or out. If I have it in the gun, I push it in all the way but may not chamber a round. So I'm having a hard time picturing the configuration or understanding why you'd mess with elastic bands vs locking it in or keeping it separate.
Unless I'm missing something, it sounds like someone could see this and think you're trying to skirt the restriction against a "loaded" firearm by carrying it in such a way that you could claim the magazine wasn't installed. However, you could simply give it a tap before drawing and it'd be locked. So it sounds like the case will hinge on the legal definition of "loaded" -- in which case you may be trying to argue that you weren't smoking because you didn't inhale.