Did All Early Christian Authors Believe In Baptismal Regeneration?

It is often asserted by Catholics, Lutherans, Orthodox and many others that every early Christian taught baptismal regeneration. Even if it were true, it is not sufficient to establish belief in the doctrine, as we must remember the principle of sola scriptura. However, it is not true that every early Christian taught Baptismal regeneration. 

A Treatise on Re-Baptism (c. 255) unknown author

And further, as you are not ignorant, the Holy Spirit is found to have been given to men who believe, by the Lord without baptism of water, as is contained in the Acts of the Apostles after this manner: While Peter was still speaking these words, the Holy Ghost fell upon all them who heard the word. And they who were of the circumcision which believed were astonished, as many as came with Peter, because that on the Gentiles also was poured out the gift of the Holy Spirit. For they heard them speak with their tongues, and they magnified God. Then answered Peter, Can any man forbid water, that these should not be baptized, who have received the Holy Ghost as well as we? And he commanded them to be baptized in the name of Jesus Christ. Acts 10:44-48 Even as Peter also subsequently most abundantly taught us about the same Gentiles, saying: And He put no difference between us and them, their hearts being purified by faith. Acts 15:9 And there will be no doubt that men may be baptized with the Holy Ghost without water — as you observe that these were baptized before they were baptized with water; that the announcements of both John and of our Lord Himself were satisfied — forasmuch as they received the grace of the promise both without the imposition of the apostle's hands and without the laver, which they attained afterwards. And their hearts being purified, God bestowed upon them at the same time, in virtue of their faith, remission of sins; so that the subsequent baptism conferred upon them this benefit alone, that they received also the invocation of the name of Jesus Christ, that nothing might appear to be wanting to the integrity of their service and faith.

The author says that as we have already been justified by faith, Baptism is just an "invocation of the name of Jesus Christ", which means a public declaration of faith.

Jovinian (died 405ad)

Jovinian was an early Christian author known for opposing ascetism. However, he made a distinction between baptism by the Spirit (which is salvific) and baptism of water which isn't:

 "He limits the impossibility of relapse to the truly regenerate, who “plena fide in baptismate renati sunt,” and makes a distinction between the mere baptism of water and the baptism of the Spirit, which involves also a distinction between the actual and the ideal church."

Philip Schaff: History of the Christian Church, Volume III

Apostolic Fathers

The most early Christian writers do not make mention of baptismal regeneration, Polycarp, Didache, Ignatius, Clement and Mathetes never call baptism salvific. Though arguments from silence aren't that strong, it does raise questions on the silence? The earliest mention comes from Hermas, however Hermas also taught heresies such as binitarianism and did not have access to most of the New Testament (only quoting from Revelation and some epistles), the book also claims to have gotten its doctrine from an "angel", however the Bible warns us about Satan discuising himself as an angel.

Aristides of Athens 2nd century

According to Aristedes, we become Christians only when "we have been persuaded" of Christianity, thus saying that we are not saved by "infant baptism", but by faith.

Further, if one or other of them have bondmen and bondwomen or children, through love towards them they persuade them to become Christians, and when they have done so, they call them brethren without distinction.

The Apology of Aristides