Gut microbial metabolite trimethylamine-N-oxide (TMAO) is associated with type 2 diabetes (T2DM). Decreased insulin sensitivity is a significant etiological factor of T2DM. Adipocytes, myocytes, and hepatocytes are the three major target cells for insulin. This study aims to investigate the effects and mechanisms of TMAO on the insulin sensitivity of these target cells. Research results indicate that in different ages of db/db diabetic mice, plasma TMAO levels were increased. TMAO significantly inhibits the insulin signaling pathways in these three major insulin target cells, reduces glucose uptake in 3T3-L1 adipocytes and L6 myocytes and downregulates genes related to gluconeogenesis in primary mouse hepatocytes. Furthermore, in mice with normal insulin sensitivity, elevating plasma TMAO levels to those seen in db/db mice using a minipump results in impaired glucose tolerance and hyperinsulinemia. All animal experiments were carried out with approval of the Experimental Animal Welfare Ethics Committee of the Institute of Materia Medica (Chinese Academy of Medical Sciences and Peking Union Medical College). Mechanistic studies suggest that TMAO exposure increases the levels of endoplasmic reticulum stress-related proteins in these three major insulin target cells. In summary, TMAO directly attenuates insulin sensitivity in insulin target cells, and its mechanism of action may involve enhancing endoplasmic reticulum stress.