If this is the case, depending on your career goals, this would not be a wise move. Research niches tend to be small and everyone knows everyone. You never know when you might run into someone again (conferences, grant or pub reviewer, search committee) and when something like this could come back and bite you. I would think very carefully before doing this.