I can’t think of any direct way to transform contextual vectors back to words because the contextual vector is a distributed representation and also same word with different context have different word vectors. On the other hand, TF-IDF vector is a weighted bag of word representation and can be inversely transformed to words by getting the nonzero values in the vector.