It's probably a border edge (look at the object in smooth preview) so you might have some merging/welding to do before you can get rid of it.