Update gpu configuration (#10760)
This commit is contained in:
		
							parent
							
								
									b5209d3ec1
								
							
						
					
					
						commit
						486df2764a
					
				
					 2 changed files with 15 additions and 6 deletions
				
			
		| 
						 | 
					@ -135,15 +135,11 @@ Please also set the following environment variable if you would like to run LLMs
 | 
				
			||||||
         set SYCL_CACHE_PERSISTENT=1
 | 
					         set SYCL_CACHE_PERSISTENT=1
 | 
				
			||||||
         set BIGDL_LLM_XMX_DISABLED=1
 | 
					         set BIGDL_LLM_XMX_DISABLED=1
 | 
				
			||||||
 | 
					
 | 
				
			||||||
   .. tab:: Intel Arc™ A300-Series or Pro A60
 | 
					   .. tab:: Intel Arc™ A-Series
 | 
				
			||||||
 | 
					
 | 
				
			||||||
      .. code-block:: cmd
 | 
					      .. code-block:: cmd
 | 
				
			||||||
 | 
					
 | 
				
			||||||
         set SYCL_CACHE_PERSISTENT=1
 | 
					         set SYCL_CACHE_PERSISTENT=1
 | 
				
			||||||
 | 
					 | 
				
			||||||
   .. tab:: Other Intel dGPU Series
 | 
					 | 
				
			||||||
 | 
					 | 
				
			||||||
      There is no need to set further environment variables.
 | 
					 | 
				
			||||||
```
 | 
					```
 | 
				
			||||||
 | 
					
 | 
				
			||||||
```eval_rst
 | 
					```eval_rst
 | 
				
			||||||
| 
						 | 
					@ -572,6 +568,17 @@ To use GPU acceleration on Linux, several environment variables are required or
 | 
				
			||||||
 | 
					
 | 
				
			||||||
      Please note that ``libtcmalloc.so`` can be installed by ``conda install -c conda-forge -y gperftools=2.10``
 | 
					      Please note that ``libtcmalloc.so`` can be installed by ``conda install -c conda-forge -y gperftools=2.10``
 | 
				
			||||||
 | 
					
 | 
				
			||||||
 | 
					   .. tab:: Intel iGPU
 | 
				
			||||||
 | 
					
 | 
				
			||||||
 | 
					      .. code-block:: bash
 | 
				
			||||||
 | 
					
 | 
				
			||||||
 | 
					         # Configure oneAPI environment variables. Required step for APT or offline installed oneAPI.
 | 
				
			||||||
 | 
					         # Skip this step for PIP-installed oneAPI since the environment has already been configured in LD_LIBRARY_PATH.
 | 
				
			||||||
 | 
					         source /opt/intel/oneapi/setvars.sh
 | 
				
			||||||
 | 
					
 | 
				
			||||||
 | 
					         export SYCL_CACHE_PERSISTENT=1
 | 
				
			||||||
 | 
					         export BIGDL_LLM_XMX_DISABLED=1
 | 
				
			||||||
 | 
					
 | 
				
			||||||
```
 | 
					```
 | 
				
			||||||
 | 
					
 | 
				
			||||||
### Known issues
 | 
					### Known issues
 | 
				
			||||||
| 
						 | 
					
 | 
				
			||||||
| 
						 | 
					@ -117,7 +117,9 @@ You can verify if `ipex-llm` is successfully installed following below steps.
 | 
				
			||||||
  
 | 
					  
 | 
				
			||||||
     .. tab:: Intel Arc™ A770
 | 
					     .. tab:: Intel Arc™ A770
 | 
				
			||||||
  
 | 
					  
 | 
				
			||||||
        There is no need to set further environment variables.
 | 
					        .. code-block:: cmd
 | 
				
			||||||
 | 
					  
 | 
				
			||||||
 | 
					           set SYCL_CACHE_PERSISTENT=1
 | 
				
			||||||
  ```
 | 
					  ```
 | 
				
			||||||
  
 | 
					  
 | 
				
			||||||
  ```eval_rst
 | 
					  ```eval_rst
 | 
				
			||||||
| 
						 | 
					
 | 
				
			||||||
		Loading…
	
		Reference in a new issue