International visitor numbers and spending have fallen even as global travel demand rises sharply worldwide.