A pulsed fast neutron source is critical for applications of fast neutron resonance radiography and fast neutron absorption spectroscopy. However, due to the large transversal source size (of the order of mm) and long pulse duration (of the order of ns) of traditional pulsed fast neutron sources, it is difficult to realize high-contrast neutron imaging with high spatial resolution and a fine absorption spectrum. Here, we experimentally present a micro-size ultra-short pulsed neutron source by a table-top laser–plasma wakefield electron accelerator driving a photofission reaction in a thin metal converter. A fast neutron source with source size of approximately 500 μm and duration of approximately 36 ps has been driven by a tens of MeV, collimated, micro-size electron beam via a hundred TW laser facility. This micro-size ultra-short pulsed neutron source has the potential to improve the energy resolution of a fast neutron absorption spectrum dozens of times to, for example, approximately 100 eV at 1.65 MeV, which could be of benefit for high-quality fast neutron imaging and deep understanding of the theoretical model of neutron physics.