Perm interview only requires US citizen or GC holders, other visas are not
helpful at all. If you got rejected very soon, it is probably there is
already somebody accepted the offer or internally transferred or whatever
the position is canceled. Perm iv usually does not require you to be on-site
. But some big rich company cares about their image of "fairness", so they
actually send everyone to be on-sited to hide their actually purpose. Small
company never does this.