By completing ALL the papers of CAT, F1-F3 of ACCA will be exempt. F1-F3 are CBE(Computer Based Exams) and can be passed without much difficulty. It is thus better if you clear 5 papers of CAT and transfer to ACCA.
Either if you choose to attempt 5 papers of CAT or ALL the papers, your CA training would not be affected in any way.