If you are mainly concerned about your child learning about religion, there is no need to baptize them for that purpose.
You can not only teach them all you want them to learn about religion at home, you can also go to church with them without having made the promise of raising them Catholic (which is what a baptism is). Nobody will stop you from telling them stories from the Bible or sending them to Sunday school, if such a thing exists where you are.
Even if you don't do that, living in a society that is dominated by Christianity, your child will pick up on a lot (Christmas Story, Easter story, etc) even without you explicitly telling these things and will likely have questions that you can use as a starting point for talking about religion.
In addition to that, you can also talk to your child about other religions, and why you are not baptized (I couldn't determine from the question whether you identify as non-religious or just not belonging to a specific Christian group).
From experience (raised Protestant, but went to Catholic school, now an Atheist), the Catholic Church takes baptism rather seriously. Since your child can always get baptized later if they wish to, I'd at least have a long talk with a priest before considering baptism. And your wife, of course. Depending on her beliefs, she might be very invested in having a child baptised, to free the child of the original sin.
While it's not something many people who later leave the faith are bothered by, you might also want to know that
In late August 2010, the Holy See confirmed that it was no longer possible to defect formally from the Catholic Church
Source: Wikipedia
According to the Vatican, baptism binds you for life (there are exceptions, like if you comitt a grave sin you are automatically excommunicated, but that's beyond the scope of this answer, I think)