I've done non-partisan work at the polls as well. I could be wrong (not an election law expert) but I wouldn't think talking to someone not voting (e.g., another campaigner) would violate non-partisan status. Just my 2 cents. Kudos on doing the work ... that's a long shift.
Non-partisan election work