Its a moot point, the US either closed, or turned them over to the host nation years ago. The most recent being the bases in Newfoundland and Bermuda, which while not formally part of the agreement were treated similarly. Both of which were useful for expanding ASW patrol coverage further into the Atlantic.

The US packed up and left both in the mid 90's, which was part of the general trend of the US military's contraction following the collapse of the USSR. This was also concurrent and part of several rounds of BRAC(Base Realignment and CLosure) that went on through the 90's in the name of saving costs and consolidating the numerous small bases spread around.

A notable base on foreign soil in the Caribbean does remain though. AUTEC in the Bahamas is essentially a joint British and American Undersea test range. Utilizing an area of isolated deep water near Andros Island it allows for ASW tests and firings in a convenient location. The majority of the bases elsewhere were closed by the early 50's.

More on the US bases in Newfoundland Here.

History of the US Military in Bermuda Here.