Your lawyer is right. This kind of references are better than a totally unknown person, because they can say that your work inspired their own research. 。 Remember, even for the people you know from conference, don't mention this, but just say that they don't know you personally. There were cases on this board that such cases were counted as dependent references. Just do it on the safe side.