The family of The Vivienne, real name James Lee Williams, have said the drag artist died after taking ketamine.