Come on a weekday. If really have to come on a weekend, take the 5-6pm timing.
U will have around 1-2hrs only but i am sure its enough. During that timing u can walk around more comfortably especially when u are coming with family members.
Either that, or u come early in the morning at the opening hours of 10am and Queue with the Tour groups consisting of mainly ATs.