וְלֹ֨א יִהְיֶ֜ה פָּלִ֤יט וְשָׂרִיד֙ לִשְׁאֵרִ֣ית יְהוּדָ֔ה הַבָּאִ֥ים לָגֽוּר־שָׁ֖ם בְּאֶ֣רֶץ מִצְרָ֑יִם וְלָשׁ֣וּב ׀ אֶ֣רֶץ יְהוּדָ֗ה אֲשֶׁר־הֵ֜מָּה מְנַשְּׂאִ֤ים אֶת־נַפְשָׁם֙ לָשׁוּב֙ לָשֶׁ֣בֶת שָׁ֔ם כִּ֥י לֹֽא־יָשׁ֖וּבוּ כִּ֥י אִם־פְּלֵטִֽים׃ (ס)
Rashi on Jeremiah
only fugitives Jeremiah and Baruch returned from there, for Nebuchadnezzar exiled them when the land of Egypt was delivered into his hand in the twenty-seventh year of his reign (Ezek. 29:17). So we learned in Seder Olam (ch. 26).