Hmmm, okay.... seems like User B has 0 entries in his user menu, so as a fallback(?) the whole sap menu (about 75000 entries) is searched? Compared to about 75 entries in the User A user menu.
When we assign a small user menu for User B then the call is as fast as for User A. Interesting...