Variations in the spatial configuration of the interstellar magnetic field (ISMF) near the Sun can be constrained by comparing the ISMF direction at the heliosphere found from the Interstellar Boundary Explorer (IBEX) spacecraft observations of a "Ribbon" of energetic neutral atoms (ENAs), with the ISMF direction derived from optical polarization data for stars within ~40 pc. Using interstellar polarization observations toward ~30 nearby stars within ~90° of the heliosphere nose, we find that the best fits to the polarization position angles are obtained for a magnetic pole directed toward ecliptic coordinates of λ, β ~ 263°, 37° (or galactic coordinates of ell, b ~ 38°, 23°), with uncertainties