Not sure if diff , in particular, allows multiple files, but in general P4 allows wildcards through ... , so for all txt files in a specific subdirectory you can say
//depot/stuff/whatever/....txt
This will filter out all .txt files on this particular path.
source share