If you can build the visitors center and trails without disturbing the soil - go right ahead.  The plutonium is still there, it is just covered over.  Digging a building foundation is NOT safe under those circumstances.  Sure - it may be safe for wildlife as it is now but once digging begins all bets are off.