Having lived full time at Birch Bay for over 7 years (North east portion of lake / 2nd lake to locals), I will agree that the fishing is quite hit and miss. However, if you find the submerge reefs (a few in the 1st and 2nd lakes) as well as the sand bar between the 1st and 2nd lakes, and troll very slowly, you might get into some decent walleye. If you want better pike, you need to go to the northern portion of the 2nd lake by the channel to the 3rd lake, and in the bigger bays of the 3rd lake. If you are confused by the numbering of the "lakes", just look at a map of the full lake and it'll make sense. Good luck out there. I warn you you though, the bar at sunny side gets pretty greasy, with lots of locals looking for fights with visitors haha. It's a beautiful place to spend a summer though.
If you want amazing fishing in the Canadian shield, just head 200km North