If the smearing (temperature) values adopted in the DFT calculations significantly affect your results, it means that you have to decrease the artificial temperature value. It also means that you should first decide on what is the target accuracy for the physical quantities you want to calculate. This is rather similar to choosing any other computational settings for numerical calculations, in general, e.g., choosing mesh density, k-point sampling and so on.