Yes, something like that. The poster child for such an acquisition is the 2011 Red Sox, ever patiently waiting for Clay Buchholz to come back; resulting in numerous extra starts for Tim Wakefield, Cooney Weiland and the torn ucl version of John Lackey; plus killing that particular bullpen as well.In terms of sheer appearances, the Red Sox have 198 appearances totaling 203.1 innings from their six most frequently-used relievers so far - Barnes, Brasier, Brewer, Hembree, Walden, and Workman. Among plausible contenders, only Oakland has relied on any group of six relievers more heavily.
I think there's definitely an argument to be made that the best solution for the pen would be to trade for a 3rd- or 4th-starter type. Worry about what happens when Eovaldi is healthy when and if that time comes.