Science funders and research organizations in Europe are joining forces to expand open-access publishing and make the peer-review process more transparent
6238117.8K
Posts with #openscience
Public posts on X that use #openscience.
Greg Brockman @gdbAnnouncing three major scientific discoveries, one each in mathematics (harmonic analysis), computer science (complexity theory), and physics (quantum field theory). AI starting to help us improve our understanding of the universe!
New York Post @nypostMassive salt mine 2,000 feet under Lake Erie forced to shut down for terrifying reason
Greg Brockman @gdbAnnouncing three major scientific discoveries, one each in mathematics (harmonic analysis), computer science (complexity theory), and physics (quantum field theory). AI starting to help us improve our understanding of the universe!
Thomas Jiralerspong @tomjiralerspongPSA to everyone doing neuron interp after the recent monosemantic neuron posts: the model's training recipe matters a lot. e.g. GPT2 seems to have been trained WITH dropout (modern LLMs are not), which seems to increase redundancy and (maybe) polysemanticity but reduce superposition (see sources in comments). Other choices probably also have an effect (e.g. SwiGLU vs GELU MLPs, optimizer, amount of weight decay, etc.) and I think we should be careful not to generalize too much. Currently working on a project to characterize the effects of these choices on neuron interpretability (a lot of the existing work is done on older/toy models which I'm not sure are representative), feel free to reach out if interested!