You asked

what was the physical 'middle wall' paul might have been referencing in the temple complex?

Reading with you…