JOJ/JOJ3
24
5
Fork 0
Code Issues 5 Pull Requests Actions Packages Projects Releases Wiki Activity

JOJ3 itself will be killed due to OOM when copyOut files are large #86

New Issue
Closed
opened 2025-04-29 21:29:32 +08:00 by 张泊明518370910136 · 2 comments
张泊明518370910136 commented 2025-04-29 21:29:32 +08:00
Owner
Copy Link

As described in https://docs.goj.ac/design#memory-usage, it should be fine when /dev/shm has 8G and memory has 16G on joj-dev. But in practice, 100 cases of 1M copy out stdout & stderr will cause JOJ3 oom.

As described in https://docs.goj.ac/design#memory-usage, it should be fine when /dev/shm has 8G and memory has 16G on joj-dev. But in practice, 100 cases of 1M copy out stdout & stderr will cause JOJ3 oom.
张泊明518370910136 added the
bug
priority
p0
 labels 2025-04-29 21:29:32 +08:00
张泊明518370910136 commented 2025-04-30 07:43:39 +08:00
Author
Owner
Copy Link

It relates to running JOJ3 in act_runner. Run JOJ3 directly on joj-dev will not cause OOM but inside act_runner it will.

It relates to running JOJ3 in act_runner. Run JOJ3 directly on joj-dev will not cause OOM but inside act_runner it will.
张泊明518370910136 commented 2025-05-09 16:38:55 +08:00
Author
Owner
Copy Link

Fixed in 07cbf29792. os/exec in golang does not fork the process, so rlimit will be applied to the current parent process. Check https://www.reddit.com/r/golang/comments/inpsqv/how_to_limit_memory_usage_in_a_child_process/.

Fixed in 07cbf29792438217952a6c834c84baa05169cfaf. `os/exec` in golang does not fork the process, so rlimit will be applied to the current parent process. Check https://www.reddit.com/r/golang/comments/inpsqv/how_to_limit_memory_usage_in_a_child_process/.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
bug

Something is not working

  
component
executor
executors in different stages

  
component
framework
software architecture

  
component
parser
parsers in different stages

  
component
UI
drone, gitea, and config interfaces

  
duplicate

This issue or pull request already exists

  
enhancement

New feature

  
help wanted

Need some help

  
invalid

Something is wrong

  
priority
p0

  
priority
p1

  
priority
p2

  
priority
p3

  
question

More information is needed

  
wontfix

This won't be fixed

No Label
bug
component
executor
component
framework
component
parser
component
UI
duplicate
enhancement
help wanted
invalid
priority
p0
priority
p1
priority
p2
priority
p3
question
wontfix
Milestone
Clear milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: JOJ/JOJ3#86
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?