You asked

how does the new testament concept of 'god with us' (e.g., in jesus or the holy spirit) relate to this psalm?

Reading with you…