merged from v1.54 and development and added loop for processing 100 at a time