-
- Notifications
You must be signed in to change notification settings - Fork 33.7k
bpo-31558: Add gc.freeze() #3705
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 1 commit
Commits
Show all changes
3 commits Select commit Hold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
address comments
- Loading branch information
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| | @@ -817,7 +817,7 @@ collect(int generation, Py_ssize_t *n_collected, Py_ssize_t *n_uncollectable, | |
| for (i = 0; i < NUM_GENERATIONS; i++) | ||
| PySys_FormatStderr(" %zd", | ||
| gc_list_size(GEN_HEAD(i))); | ||
| PySys_WriteStderr("\ngc: objects in permanent generation: %d", | ||
| PySys_WriteStderr("\ngc: objects in permanent generation: %zd", | ||
| gc_list_size(&_PyRuntime.gc.permanent_generation.head)); | ||
| t1 = _PyTime_GetMonotonicClock(); | ||
| | ||
| | @@ -1411,17 +1411,19 @@ gc_is_tracked(PyObject *module, PyObject *obj) | |
| return result; | ||
| } | ||
| | ||
| PyDoc_STRVAR(gc_freeze__doc__, | ||
| "freeze() -> None\n" | ||
| "\n" | ||
| "Freeze all current tracked objects and ignore them for future collections.\n" | ||
| "This can be used before a fork to make the gc copy-on-write friendly.\n" | ||
| "Note: collection before a fork may free pages for future allocation\n" | ||
| "which can cause copy-on-write.\n" | ||
| ); | ||
| /*[clinic input] | ||
| gc.freeze | ||
| | ||
| Freeze all current tracked objects and ignore them for future collections. | ||
| | ||
| This can be used before a fork to make the gc copy-on-write friendly. | ||
| ||
| Note: collection before a fork may free pages for future allocation | ||
| which can cause copy-on-write. | ||
| [clinic start generated code]*/ | ||
| | ||
| static PyObject * | ||
| gc_freeze(PyObject *module) | ||
| gc_freeze_impl(PyObject *module) | ||
| /*[clinic end generated code: output=502159d9cdc4c139 input=8798c406cd01d7c4]*/ | ||
| { | ||
| for (int i = 0; i < NUM_GENERATIONS; ++i) { | ||
| gc_list_merge(GEN_HEAD(i), &_PyRuntime.gc.permanent_generation.head); | ||
| | @@ -1430,14 +1432,16 @@ gc_freeze(PyObject *module) | |
| Py_RETURN_NONE; | ||
| } | ||
| | ||
| PyDoc_STRVAR(gc_get_freeze_stats__doc__, | ||
| "get_freeze_stats() -> n\n" | ||
| "\n" | ||
| "Return the number of objects in permanent generations.\n" | ||
| ); | ||
| /*[clinic input] | ||
| gc.get_freeze_count -> int | ||
| | ||
| static PyObject * | ||
| gc_get_freeze_stats(PyObject *module) { | ||
| Return the number of objects in permanent generations. | ||
| [clinic start generated code]*/ | ||
| | ||
| static int | ||
| gc_get_freeze_count_impl(PyObject *module) | ||
| /*[clinic end generated code: output=e4e2ebcc77e5cbf3 input=590241a6a398cfa2]*/ | ||
| { | ||
| return Py_BuildValue("i", gc_list_size(&_PyRuntime.gc.permanent_generation.head)); | ||
| } | ||
| | ||
| | @@ -1460,7 +1464,7 @@ PyDoc_STRVAR(gc__doc__, | |
| "get_referrers() -- Return the list of objects that refer to an object.\n" | ||
| "get_referents() -- Return the list of objects that an object refers to.\n" | ||
| "freeze() -- Freeze all tracked objects and ignore them for future collections.\n" | ||
| "get_freeze_stats() -- Return the number of objects in the permanent generation.\n"); | ||
| "get_freeze_count() -- Return the number of objects in the permanent generation.\n"); | ||
| | ||
| static PyMethodDef GcMethods[] = { | ||
| GC_ENABLE_METHODDEF | ||
| | @@ -1479,8 +1483,8 @@ static PyMethodDef GcMethods[] = { | |
| gc_get_referrers__doc__}, | ||
| {"get_referents", gc_get_referents, METH_VARARGS, | ||
| gc_get_referents__doc__}, | ||
| {"freeze", gc_freeze, METH_NOARGS, gc_freeze__doc__}, | ||
| {"get_freeze_stats", gc_get_freeze_stats, METH_NOARGS, gc_get_freeze_stats__doc__}, | ||
| GC_FREEZE_METHODDEF | ||
| GC_GET_FREEZE_COUNT_METHODDEF | ||
| {NULL, NULL} /* Sentinel */ | ||
| }; | ||
| | ||
| | ||
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You should really undo the freezing after this test. We don't want tests to have so large side effects.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good point! This will require adding the "thaw" or "unfreeze" function that will move objects back from the permanent generation to a properly collected one. Do you think it would be enough for that call to move all of them to gen0? This won't be exactly "undoing the freeze" but doesn't require keeping track of which object belonged to which generation before.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Anything that empties the permanent generation is good enough IMHO. People can call
gc.collectexplicitly afterwards if they want to collect those objects.PS: as a non-native English locutor, I much prefer "unfreeze" to "thaw" :-)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Oh, didn't notice your "general comment" until now. So it seems we agree that moving everything to a single generation makes sense. But you're suggesting the oldest generation (gen2) instead. Makes sense.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ok, I was just too lazy to add it but fine will update..