Skip to content

Commit ea0d6c4

Browse files
authored
increase client concurrency to 50 (#133)
### Notes Tested concurrency settings with a 2500 page PDF. Notes on various settings: 15 threads: 29 minutes 50 threads: 11 minutes 150 threads: 5 minutes Memory usage: 15 threads: Partition of a set of 530464 objects. Total size = 150187404 bytes. (~150MB) 50 threads: Partition of a set of 530606 objects. Total size = 150206646 bytes. (~150MB) 150 threads: Partition of a set of 530654 objects. Total size = 150221029 bytes. (~150MB) For now proposing we increase this to a max of 50. We can always keep increasing later.
1 parent d3ebda8 commit ea0d6c4

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

src/hooks/custom/common.ts

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,9 +21,9 @@ export const PARTITION_FORM_SPLIT_PDF_CONCURRENCY_LEVEL =
2121
export const EXTRACT_IMAGE_BLOCK_TYPES = "extract_image_block_types";
2222

2323
export const DEFAULT_STARTING_PAGE_NUMBER = 1;
24-
export const DEFAULT_NUMBER_OF_PARALLEL_REQUESTS = 8;
24+
export const DEFAULT_NUMBER_OF_PARALLEL_REQUESTS = 10;
2525
export const DEFAULT_SPLIT_PDF_ALLOW_FAILED_KEY = false;
26-
export const MAX_NUMBER_OF_PARALLEL_REQUESTS = 15;
26+
export const MAX_NUMBER_OF_PARALLEL_REQUESTS = 50;
2727

2828
export const MIN_PAGES_PER_THREAD = 2;
2929
export const MAX_PAGES_PER_THREAD = 20;

0 commit comments

Comments
 (0)