[Orca] Known Issues Update (#7569)
* add known issue for no space left * update style * update with comments * new update
This commit is contained in:
parent
29e52af49b
commit
73f6d79e8c
1 changed files with 40 additions and 0 deletions
|
|
@ -148,3 +148,43 @@ For Spark Dynamic Allocation mode, you are also recommended to manually set `num
|
||||||
```python
|
```python
|
||||||
init_orca_context(..., num_ray_nodes=2, ray_node_cpu_cores=4)
|
init_orca_context(..., num_ray_nodes=2, ray_node_cpu_cores=4)
|
||||||
```
|
```
|
||||||
|
|
||||||
|
### No Space Left on Device
|
||||||
|
This error may happen when your disk even has free space, the reason could be:
|
||||||
|
1. Inodes do not have enough space.
|
||||||
|
2. Processes are still using deleted files.
|
||||||
|
|
||||||
|
To solve this issue, please follow the steps below:
|
||||||
|
1. Checkout Spaces on Inodes
|
||||||
|
|
||||||
|
Please check the space on available inodes using the command below:
|
||||||
|
```bash
|
||||||
|
sudo df -i
|
||||||
|
```
|
||||||
|
|
||||||
|
Then you will see the overview information of all Inodes and the availability state.
|
||||||
|
```bash
|
||||||
|
Filesystem Inodes IUsed IFree IUse% Mounted on
|
||||||
|
udev 98880204 3552 98876652 1% /dev
|
||||||
|
tmpfs 98889585 3381 98886204 1% /run
|
||||||
|
/dev/sda2 14622720 2119508 12503212 15% /
|
||||||
|
tmpfs 98889585 18225 98871360 1% /dev/shm
|
||||||
|
tmpfs 98889585 5 98889580 1% /run/lock
|
||||||
|
tmpfs 98889585 19 98889566 1% /sys/fs/cgroup
|
||||||
|
```
|
||||||
|
|
||||||
|
If there is a disk that uses a small part but the Inode table is full, you should delete useless files.
|
||||||
|
|
||||||
|
2. Restart the Process to Free Space
|
||||||
|
|
||||||
|
Files that were deleted (while processes are still running) could keep the space reserved, you should restart processes to free up the space.
|
||||||
|
|
||||||
|
Please run the command below to see which processes have opened descriptors to deleted files:
|
||||||
|
```bash
|
||||||
|
sudo lsof | grep deleted
|
||||||
|
```
|
||||||
|
|
||||||
|
Then you could restart the processes to free up the reserved space.
|
||||||
|
```bash
|
||||||
|
sudo systemctl restart service_name
|
||||||
|
```
|
||||||
|
|
|
||||||
Loading…
Reference in a new issue