Trump has pulled Dr. Fauci's security detail after President Biden pardoned him