Jake,
So, as asked, how are you charging your car at home? Are you using a normal household plug (Level 1 charging), or did you have a 240v plug installed with an EVSE to charge it with(Level 2)?
If you are using level 1 charging, yes, it will be slow, especially if you take the battery down...