Installing GoCV requires a few extra environment variables to be set.
Before the make install phase, set the following variables
export GOPATH=/home/frank/go
export PKG_CONFIG_PATH=/usr/local/lib64/pkgconfig
export LD_LIBRARY_PATH=/usr/local/lib64
It is also easier to install the OpenCV libraries system-wide by running make install as the root user.