remove the search / refresh buttons if Library is disabled?

I am preferring folder organised structure via NFS or SMB, the search doesn’t return anything if Library is disabled completely. can Infuse hide the unused buttons from the UI? I sometimes hit the search button if I swipe remote too fast.