"...it would mean that Asians must be oppressing and discriminating against whites, which is obviously absurd."

No it wouldn't, and nobody has made the claim that discrimination is the only reason for any differentials, just that it is the most important factor.