The pre-DH era in the AL was a bit before my time, but I do recall that Rick Wise was a decent hitter in the NL before coming to the Red Sox.
Also, having looked into the subject a bit, I learned about 'Bullet' Joe Bush, who pitched for the Sox from 1918-1921, batting .253 for his career (.325...