Wind simulations can contain significant errors, which can lead to inaccurate estimates of wind energy generation. Using observations from a floating lidar off Hawai'i, we hypothesize and establish that distinct simulation datasets will exhibit diverse ranges of errors in this offshore environment. The most commonly used simulation dataset produces the largest wind speed biases due to underestimation of fast wind speeds and misrepresentation of how wind speed varies throughout the day and night.