Hi Mart,
You can try using qCalendarView CAML filter feature.
You display all your calendars into the qCalendarView and set conditions based on the SharePoint users/groups or you can create specific common fields that you would use to filter the calendar data to be displayed.