Then Herod called the Magi secretly and found out from them the exact time the star had appeared. He sent them to Bethlehem and said, “Go and make a careful search for the child. As soon as you find him, report to me, so that I too may go and worship him.”
...an angel of the Lord appeared to Joseph in a dream. “Get up,” he said, “take the child and his mother and escape to Egypt. Stay there until I tell you, for Herod is going to search for the child to kill him.”
When Herod realized that he had been outwitted by the Magi, he was furious, and he gave orders to kill all the boys in Bethlehem and its vicinity who were two years old and under, in accordance with the time he had learned from the Magi. Matthew 2:7-8, 13, 16
The wise men did not visit Jesus when he was born. Your nativity scenes are wrong.
Remember, the star appeared when he was born. By the time they packed up, traveled to Jerusalem, talked to Herod, followed the star again, this time in Nazareth, two years had passed. That's why Herod killed all the children in Bethlehem and its vicinity who were two years old and under, in accordance to the time the wise men told him.
So they visited Jesus around the age of two years old in Nazareth.