It's fairly certain the wisards were from Babylon.
Remember how Daniel interpreted the dream of
King Nebuchadnezzar 500 years earlier and was made head of the wise men during the Babylonian captivity of the Jews?
(Daniel chapter 2)
The wisards of the Christmas story were likely a succeeding remnant of the wise men of Daniel.