If the potential performance hit is a concern I'd say allow the option to be toggled in the root settings.conf and only have the caching/searching executed if the option is enabled. That way people who have their media matching already wouldn't be affected by possible slowdowns. I know I'd personally rather not sacrifice any performance if possible, no matter how minor, for a feature I would never use.
