And many of them that believed, came confessing and declaring their deeds. And many of them who had followed curious arts, brought together their books, and burnt them before all… (Acts 19:18-19)
The burning of heretical books goes back to Apostolic Times as we see above in the Acts of the Apostles. In our era, when the ecumenical apostasy has swept through the Catholic Church, it might seem inappropriate to burn Protestant Bibles. Protestantism is not a form of Christianity, but a heresy and the Bibles of heretics are altered or include text or footnotes odious to true Christians.
A Christian to whom a Bible has been offered by a Protestant or an agent of the Protestants should reject it with disgust, because it is forbidden by the Church. If it was accepted by inadvertence, it must be burnt as soon as possible or handed in to the Parish Priest. (Catechism of Pius X)