Coherent broadband light generation has attracted massive attention due to its numerous applications ranging from metrology, sensing, and imaging to communication. In general, spectral broadening is realized via third-order and higher-order nonlinear optical processes (e.g., self-phase modulation, Raman transition, four-wave mixing, multiwave mixing), which are typically weak and thus require a long interaction length and the phase matching condition to enhance the efficient nonlinear light-matter interaction for broad-spectrum generation. Here, for the first time, we report octave-spanning coherent light generation at the nanometer scale enabled by a phase-matching-free frequency down-conversion process. Up to octave-spanning coherent light generation with a -40dB spectral width covering from ~ 565 to 1906 nm is demonstrated via difference-frequency generation, a second-order nonlinear process in gallium selenide and niobium oxide diiodide crystals at the 100-nanometer scale. Compared with conventional coherent broadband light sources based on bulk materials, our demonstration is ~5 orders of magnitude thinner and requires ~ 3 orders of magnitude lower excitation power. Our results open a new way to possibly create compact, versatile and integrated ultra-broadband light sources.