I have a preference for normal. But I have been wondering on this topic also. I am currently implementing FixUp initialization for GANs, I would do some comparison tests with the normal and uniform vs fixup and come to a precise conclusion. I would post it within the next 36 hours.
Distraction-free reading. No ads.
Organize your knowledge with lists and highlights.
Tell your story. Find your audience.
Read member-only stories
Support writers you read most
Earn money for your writing
Listen to audio narrations
Read offline with the Medium app
Full-stack software engineer. Love hiking & orienteering, painting in various mediums, and occasionally crafting origami.
