All is well and good, but...
In the question: This is all true, but it is necessary to point out that..., the remark intended to qualify what was said
(The modern Hebrew follows the expression "good and beautiful")
Translation
Expression (Hebrew)
הַכֹּל טוֹב וְיָפֶה אֲבָל...
Definition (Hebrew)
בְּהַשְׁאָלָה: זֶה נָכוֹן כָּל מָה שֶׁאָמַרְתָּ, אֲבָל צָרִיךְ לְצַיֵּן ש..., הֶעָרָה הַנּוֹעָדָהּ לְסַיֵּג דְּבַר מָה שֶׁנֶּאֱמַר
(הָעִבְרִית הַחֲדָשָׁה בְּעִקְבוֹת הַבִּטּוּי "טוֹב וְיָפֶה")