One wrong and one right don't make two rights, and many rights don't erase a single wrong.
However, in recent years, the negativity has lightened, in part due to the cultural visibility of otaku through the popularization of dramas and novels like Densha Otoko [Train Man].
However, in modern use, both words may carry a shadow of the right connotations of obsessive interest and/or social ineptitude; see the geek and nerd pages for details.
Think of the older, more pejorative senses of get slung around in a similar manner.
Otaku Crush have recently released their website for all.
As part of The Fan Crush Network, Otaku Crush exists specifically to match Anime/Manga fans with other Anime/Manga fans.