Shallow vs Deep Fusion for Language Models