by Jungle Dongle.
I actually searched with exact same words but I didn't find anything for me.
I dont use groups at all. I just manually assign users to my course.
When I added user to assignment local student role (gave the user student role to that one assignment), everything works fine.