My concern with eliminating athletic scholarships would be that schools would try that much hard to offer less above-board incentives to recruit student athletes.
I do wish that there were more academic merit scholarships or other merit scholarships -- music or art. They exist, but are dwarfed by the athletic scholarships.