Men can where shorts and pants that are comfortable. Make sure your backside is covered during bending poses! Some of my male students have shown parts that should not be shown!!
Some folks like to wear socks. I tried some toe socks with made for yoga that had none slip material on the bottom. This pair came in general S-M-L sizes. The small fit, but I would have liked the socks be a bit snugger some my foot would not slide inside it. Someone gave me "maryjanes" made of lycra/polyester cloth with the no-slip bottom. They fit my feet better.
In the end, it is what you find comfortable!
What do you find comfortable for yoga practice?