Except for the whole problem of occasional baking of excessive Gamma radiation on all the planets in the system, and the repeated extermination of all forms of life as a result of it, sure its fine.
Black Hole as a central star? Wow. Bad idea. Black holes tend to suck. Litterally. A planet would not last long near one, and if it happend to go fast enough to maintain a semi stable orbit, its atmosphere probobly would have been stripped off long ago. As for a Neutron star, those form after a supernova... So chances are there won't be any planets anyway (explosion would destroy them).
And even if it entered another solar system, or was drawn to this black hole, it'd eventually be sucked up anyway. Though it would have a oppertunity to throughly eliminate all life on the surrounding planets too (not to mention the effects its gravity well would have disturbing the balance of the orbiting planets already. Some would be flinged away, others would hit the star itself, and still others would be thrown into the black hole)