We paid the separate entrance fee (¥700) to see more of the lanterns, and we thought it was worth it. A lot less busy than Tōdai-ji, but still a decent amount of people at 11:30am. I’d say there were ~10 others in the paid area with us, but a lot more outside of it.