You have errors in your code. You are trying to use pairwise on array of shape (N, 3), while it should be (N,M), or you should save your ids, and transform it to CSR matrix