4 hours? More like 1.5 to 2 isn't it? Nice area though. You won't have any problem finding water or fish.
Maps says 2h41m. I remember it taking us close to 5 hr to get to Minocqua and we're only an hour south of GB, hence my 4 hr estimate.
That area of the state is a treasure; almost more water than land. If you can get on some of the small lakes with a canoe (many are no boat access) be prepared for a super great time. If you can't find bass or pike, the panfish are huge. I'm sure you'll have a great time up there!
Your Winnebago story is much like one of mine. We spent a day fishing rock piles at the end of a channel and easily boated over 100 bass. Slow no wake area so boaters would see us doing well and ask what we're catching. You should've seen the look on their faces when we would say bass. It's a dirty word there. We rarely catch walleye, and even bass is usually slow. I don't like the lake. It's over fished. I assume you guys saw the story out of MN where a group was almost 700 fish over their limit? Only facing a $3000 fine. Should be more.