That could happen with any HMD even without controllers, the only recommendation I can provide you is the following:
Move the base stations to a position where all the posible angles are covered, imaging it as cameras and you need to be in the field of view of both.
If you can perfectly move and track when both the controllers and the headset are looking in front of you you might need to set a base station almost on the back of your room.
Also you can check this two articles:
https://www.vrheads.com/how-solve-tr...ssues-htc-vive How to best position HTC Motion Tracking Boxes - Virtual Reality - Virtual Reality/Augmented Reality
Hopefully you will find this information helpful.