Toyomori became a hatamoto of Uesugi Kenshin around 1569 and was responsible for negotiating a peace treaty with the Hôjô in 1570. He was entrusted with the defense of Kasugayama while Kenshin was away fighting in 1572 and died of illness in 1577.