When 'to_field' is specified with a FK, then we need to check the pk value the object.
Signed-off-by: Jason Myers <jason@jasonamyers.com>