An explosion at a madrasa near Dhaka left four people injured, including two children, prompting authorities to launch an investigation.