Colormap Question with Specific Values

So I have a custom RGB colormap that basically looks like jet but with black in the middle. However, for the type of data that I have, I want to make values below 0 a color not on the colorbar. I have played with adding the color then playing with the limits but this is not giving me the desired look of the plot. Is there a way to specify certain values have a particular color?