Closed
Description
Bug report
TemporaryDirectory.__exit__ usually raises PermissionError if another process keeping a handle to a file in the tmp directory has just finished its execution.
Bug description:
Please consider the following block of code:
import multiprocessing import os import tempfile import time def _open_func(file_path): with open(file_path, "w"): time.sleep(1000) def test(): with tempfile.TemporaryDirectory(suffix="used_by_another_process") as dir_path: file_path = os.path.join(dir_path, "file_being_used") proc = multiprocessing.Process(target=_open_func, args=(file_path,)) proc.start() while not os.path.exists(file_path): time.sleep(0.1) proc.terminate() proc.join() if __name__ == "__main__": test()Despite the child process being terminated and joined, the __exit__ method of TemporaryDirectory sometimes raises PermissionError:
Traceback (most recent call last): File "C:\Python\python.3.12.1\tools\Lib\shutil.py", line 634, in _rmtree_unsafe os.unlink(fullname) PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\\Users\\kamil\\AppData\\Local\\Temp\\tmpvaou_oibused_by_another_process\\file_being_used' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\kamil\tmp_test\tmpdir.py", line 24, in <module> test() File "C:\Users\kamil\tmp_test\tmpdir.py", line 13, in test with tempfile.TemporaryDirectory(suffix="used_by_another_process") as dir_path: File "C:\Python\python.3.12.1\tools\Lib\tempfile.py", line 946, in __exit__ self.cleanup() File "C:\Python\python.3.12.1\tools\Lib\tempfile.py", line 950, in cleanup self._rmtree(self.name, ignore_errors=self._ignore_cleanup_errors) File "C:\Python\python.3.12.1\tools\Lib\tempfile.py", line 930, in _rmtree _shutil.rmtree(name, onexc=onexc) File "C:\Python\python.3.12.1\tools\Lib\shutil.py", line 808, in rmtree return _rmtree_unsafe(path, onexc) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Python\python.3.12.1\tools\Lib\shutil.py", line 636, in _rmtree_unsafe onexc(os.unlink, fullname, err) File "C:\Python\python.3.12.1\tools\Lib\tempfile.py", line 905, in onexc _os.unlink(path) PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\\Users\\kamil\\AppData\\Local\\Temp\\tmpvaou_oibused_by_another_process\\file_being_used' It does not reproduce in 100% but most executions fail. I can reproduce it only using Python 3.12.1. It does not happen to me on 3.12.0 or 3.11. It seems to be a regression in the last release.
With some small sleep after the proc.join() it stops reproducing so it looks like a kind of race condition.
The Windows version I use is:
Edition: Windows 10 Enterprise
Version: 21H2
OS build: 19044.3693
CPython versions tested on:
3.12
Operating systems tested on:
Windows
Linked PRs
Metadata
Metadata
Assignees
Labels
Projects
Status
Done