Yes, it is correct that we cannot use a contracted negative form when we use inverted word order to express unreal or impossible condition in the past. Instead, we are obliged to use the full form ...

There are a few conjunctions which change the word order but do not subordinate the verb. In the clause where they are used, they are the first idea, so the verb - the second idea - must come next.