You can restrict a single user on workflow transition only you can use dynamic group method but this idea depends upon the Project like if you are working for that project only in that way that dynamic group work and you have to add those members whom you want to give access except restricted user o.w. there is no way to restrict a single user.