[Zubersoft]

At the moment, no, there is no way to delete a song while you are viewing it. If you return to the library screen and view the "Recent" tab, the song you just loaded will be at the top. Long press it and you can delete it from that tab. 

Mike