Have I made it clear to my friend that I'm ONLY interested in being friends?

Sounds like you've been a friend with benefits, which means it would be unreasonable to expect him to view you with the dignity and respect you desire. Once tried never denied. A logical alternative would be to end this "friendship" altogether.