Search for a new heavy resonance decaying to a top quark and a neutral scalar boson in proton-proton collisions at s=13TeV

A first search at the LHC for a new heavy resonance decaying to a top quark and a neutral scalar boson ϕ in the fully hadronic final state is presented, where the ϕ boson is identified by its decay into a bottom quark-antiquark pair. The search is focused on final states in which the decay products of the highly Lorentz boosted top quark and ϕ boson are each reconstructed as a single, large-radius jet with distinct substructure. The analysis is performed using proton-proton collision data at a center-of-mass energy of 13TeV, corresponding to an integrated luminosity of 138fb⁻¹, recorded with the CMS detector at the LHC in 2016–2018. The single production of a vector-like top quark, T′, is used as a benchmark model for the signal process. The results of this search are combined with those of a previous CMS search in which semileptonic decays of the top quark were used. No significant excess of data is observed with respect to the background prediction. For the case where the neutral scalar is a standard model Higgs boson and the T′ quark width is 5% of its mass, T′ quark masses between 0.85 and 1.3TeV are excluded at 95% confidence level and the most stringent limits to date are set for masses above 2TeV. For other ϕ boson masses, upper limits as low as 0.1fb are set on the product of the T′ quark production cross section and branching fraction for its decay to a top quark and a ϕ boson.