Many users are surprised when they discover they can’t sort by category. It is possible to sort by category but you need to use the By Category view.

It works this way because the category field can contain multiple categories (and few would want to sort by the first category only), while each group is made up only of items in one category.

And no, upgrading to the latest, greatest version will not change how this feature works.