A recently developed ultrafast burst imaging method known as sequentially timed all-optical mapping photography (STAMP) [Nat. Photonics8, 695 (2014)10.1038/nphoton.2014.163] has been shown effective for studying a diverse range of complex ultrafast phenomena. Its all-optical image separation circumvents mechanical and electronic restrictions that traditional burst imaging methods have long struggled with, hence realizing ultrafast, continuous, burst-type image recording at a fame rate far beyond what is achievable with conventional methods. In this Letter, considering various design parameters and limiting factors, we present an optimum design for STAMP in terms of temporal properties including exposure time and frame rate. Specifically, we first derive master equations that can be used to predict the temporal performance of a STAMP system and then analyze them to realize optimum conditions. This Letter serves as a general guideline for the camera parameters of a STAMP system with optimum temporal performance that is expected to be of use for tackling problems in science that are previously unsolvable with conventional imagers.