That's not the case at all. My musical taste is 100% the sum of all the music I've listened to all my life - music created by other people (and even then I would be hesitant to suggest that the ideas used in the music I've listened to are the original ideas of those artists' - they were influenced by someone as well, surely).
What I'm asking is, how do I avoid being accused of intentionally ripping of another artist's (well, I wouldn't call myself a artist but you get the point...) work even though I've never done it (consciously).