A person who is not acceptable, usually as a member of a group or club.
If you do not pay commission to the director of the committee, he will black ball you.
The expression is derived from 18th century clubs. New applications for membership were examined by the ruling committee - secret votes were then cast by putting balls into a container. Red balls meant acceptance and black ones rejection. It only needed one black ball for the application to fail.