Johnson was pulled from Monday's game while accompanied by a trainer, Alex Speier of the Boston Globe reports.
Johnson gave up hits to all four batters he faced and appeared to leave the game with an injury. It is not yet known if the 25-year-old re-injured his left elbow or if it is something new, but more information should be released in the near future.