Sugar isn't the biggest Your morning coffee may be packing more calories than you realize, and sugar isn't the biggest reason. Your morning coffee may be packing more calories than you realize, and sugar isn't the biggest reason.