All by Myself First recording by Frank Crumit (April 21, 1921) First release by All Star Trio and Their Orchestra (July 1921)