Fetching up next list

When scanning for changes under library infuse always takes a long time fetching the up next list. I have this option disabled, but still I see this being displayed and taking relatively long, sometimes even longer than getting the actual metadata for the changes detected.

Shouldn’t this be not happening since I disabled that option?

Not a big deal by the way, just noticed that this is maybe strange.