When a revert comes to Islam, is the debt that had been accumulated before the reversion still counted against them. Are they responsible for that in front of Allah or does it get wiped away like a clean state?

Yes the debts remain to be paid. They remain responsible to pay them off. Conversion doesn't cancel debts to other human beings.