The town of North Fork claims ownership of the location but you must drive 6 miles out of town to the actual monument.

Driving instructions:
From Bass Lake,  Drive towards North Fork (8 Miles) on road 274, turn left at the bottom of the hill on Rd 225 (Mamouth Pool Road) for about 6 miles. The road becomes Italian Bar Road but in most cases signs will say Road 225. It will be on the left, 50 feet from the road.

Here are some links for more information: Photo and Google map