UN human rights experts said the US had refused to grant them the right to speak to detainees in private.
UN senior official Manfred Nowak said private interviews were a “totally non-negotiable pre-condition” for conducting the visit.
Some 500 terror suspects are being held at the US military camp.
Only the International Committee of the Red Cross has been given access to the prisoners. It reports its findings only to the detaining authorities.