Conda environment created with –prefix has issues with PYTHONHOME on linux computing cluster /u/jaaxk122 Python Education

I’m on my universities HPC cluster and I ran out of disk space in my home directory, so I made an environment in my scratch space using the command:

`conda env create –prefix ./comebin_env –file comebin_env.yml

pip install torch==1.12.1+cu113 –extra-index-url https://download.pytorch.org/whl/cu113`

Right after creating the environment, I activate it and my program runs successfully. When I close my shell and open it back up the next day, I can activate the environment successfully with:

`conda activate /gpfs/scratch/jvaska/COMEBIN/environments/comebin_env`

But when I try to run my program I get the error:

`Could not find platform independent libraries <prefix>

Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]`

and the program fails to run.

Additionally, when I try `python –version`, I get the same error, but it gives me the version:

`(/gpfs/scratch/jvaska/COMEBin/environments/comebin_env) [jvaska@login1 .conda]$ python –version

Could not find platform independent libraries <prefix>

Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]

Python 3.7.12`

I’ve tried setting PYTHONHOME to `/gpfs/scratch/jvaska/COMEBin/environments/comebin_env`

But when I run the program I get some other error about encodings. When trying to fix that by upgrading encodings I get this error:

`pip install –upgrade –force-reinstall –no-cache-dir encodings`

Could not find platform independent libraries <prefix>

Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]

Fatal Python error: initfsencoding: Unable to get the locale encoding

LookupError: no codec search functions registered: can’t find encoding

Current thread 0x00002aaaaaaf2ec0 (most recent call first):

Aborted (core dumped)

Here is my conda info:

`(/gpfs/scratch/jvaska/COMEBin/environments/comebin_env) [jvaska@login1 .conda]$ conda info`

` active environment : /gpfs/scratch/jvaska/COMEBin/environments/comebin_env

active env location : /gpfs/scratch/jvaska/COMEBin/environments/comebin_env

shell level : 2

user config file : /gpfs/home/jvaska/.condarc

populated config files : /gpfs/home/jvaska/.condarc

conda version : 24.5.0

conda-build version : 3.27.0

python version : 3.10.12.final.0

solver : libmamba (default)

virtual packages : __archspec=1=haswell

__conda=24.5.0=0

__glibc=2.17=0

__linux=3.10.0=0

__unix=0=0

base environment : /gpfs/software/Anaconda (read only)

conda av data dir : /gpfs/software/Anaconda/etc/conda

conda av metadata url : None

channel URLs : https://repo.anaconda.com/pkgs/main/linux-64

https://repo.anaconda.com/pkgs/main/noarch

https://repo.anaconda.com/pkgs/r/linux-64

https://repo.anaconda.com/pkgs/r/noarch

package cache : /gpfs/home/jvaska/.conda/packages

/gpfs/home/jvaska/.conda

envs directories : /gpfs/home/jvaska/.conda/envs

/gpfs/software/Anaconda/envs

platform : linux-64

user-agent : conda/24.5.0 requests/2.31.0 CPython/3.10.12 Linux/3.10.0-1160.81.1.el7.x86_64 centos/7.9.2009 glibc/2.17 solver/libmamba conda-libmamba-solver/23.11.1 libmambapy/1.5.4

UID:GID : 113236684:113236684

netrc file : None

offline mode : False`

Again, I’m on a cluster and loaded conda using module load anaconda/3.

My home conda directory is /gpfs/home/jvaska/.conda, where in environments.txt, /gpfs/scratch/jvaska/COMEBin/environments/comebin_env exists.

I’m new to conda and environments and this is my first time posting on stackoverflow, anything helps thank you!

submitted by /u/jaaxk122
[link] [comments]

​r/learnpython I’m on my universities HPC cluster and I ran out of disk space in my home directory, so I made an environment in my scratch space using the command: `conda env create –prefix ./comebin_env –file comebin_env.yml pip install torch==1.12.1+cu113 –extra-index-url https://download.pytorch.org/whl/cu113` Right after creating the environment, I activate it and my program runs successfully. When I close my shell and open it back up the next day, I can activate the environment successfully with: `conda activate /gpfs/scratch/jvaska/COMEBIN/environments/comebin_env` But when I try to run my program I get the error: `Could not find platform independent libraries <prefix> Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]` and the program fails to run. Additionally, when I try `python –version`, I get the same error, but it gives me the version: `(/gpfs/scratch/jvaska/COMEBin/environments/comebin_env) [jvaska@login1 .conda]$ python –version Could not find platform independent libraries <prefix> Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>] Python 3.7.12` I’ve tried setting PYTHONHOME to `/gpfs/scratch/jvaska/COMEBin/environments/comebin_env` But when I run the program I get some other error about encodings. When trying to fix that by upgrading encodings I get this error: `pip install –upgrade –force-reinstall –no-cache-dir encodings` Could not find platform independent libraries <prefix> Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>] Fatal Python error: initfsencoding: Unable to get the locale encoding LookupError: no codec search functions registered: can’t find encoding Current thread 0x00002aaaaaaf2ec0 (most recent call first): Aborted (core dumped) Here is my conda info: `(/gpfs/scratch/jvaska/COMEBin/environments/comebin_env) [jvaska@login1 .conda]$ conda info` ` active environment : /gpfs/scratch/jvaska/COMEBin/environments/comebin_env active env location : /gpfs/scratch/jvaska/COMEBin/environments/comebin_env shell level : 2 user config file : /gpfs/home/jvaska/.condarc populated config files : /gpfs/home/jvaska/.condarc conda version : 24.5.0 conda-build version : 3.27.0 python version : 3.10.12.final.0 solver : libmamba (default) virtual packages : __archspec=1=haswell __conda=24.5.0=0 __glibc=2.17=0 __linux=3.10.0=0 __unix=0=0 base environment : /gpfs/software/Anaconda (read only) conda av data dir : /gpfs/software/Anaconda/etc/conda conda av metadata url : None channel URLs : https://repo.anaconda.com/pkgs/main/linux-64 https://repo.anaconda.com/pkgs/main/noarch https://repo.anaconda.com/pkgs/r/linux-64 https://repo.anaconda.com/pkgs/r/noarch package cache : /gpfs/home/jvaska/.conda/packages /gpfs/home/jvaska/.conda envs directories : /gpfs/home/jvaska/.conda/envs /gpfs/software/Anaconda/envs platform : linux-64 user-agent : conda/24.5.0 requests/2.31.0 CPython/3.10.12 Linux/3.10.0-1160.81.1.el7.x86_64 centos/7.9.2009 glibc/2.17 solver/libmamba conda-libmamba-solver/23.11.1 libmambapy/1.5.4 UID:GID : 113236684:113236684 netrc file : None offline mode : False` Again, I’m on a cluster and loaded conda using module load anaconda/3. My home conda directory is /gpfs/home/jvaska/.conda, where in environments.txt, /gpfs/scratch/jvaska/COMEBin/environments/comebin_env exists. I’m new to conda and environments and this is my first time posting on stackoverflow, anything helps thank you! submitted by /u/jaaxk122 [link] [comments] 

I’m on my universities HPC cluster and I ran out of disk space in my home directory, so I made an environment in my scratch space using the command:

`conda env create –prefix ./comebin_env –file comebin_env.yml

pip install torch==1.12.1+cu113 –extra-index-url https://download.pytorch.org/whl/cu113`

Right after creating the environment, I activate it and my program runs successfully. When I close my shell and open it back up the next day, I can activate the environment successfully with:

`conda activate /gpfs/scratch/jvaska/COMEBIN/environments/comebin_env`

But when I try to run my program I get the error:

`Could not find platform independent libraries <prefix>

Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]`

and the program fails to run.

Additionally, when I try `python –version`, I get the same error, but it gives me the version:

`(/gpfs/scratch/jvaska/COMEBin/environments/comebin_env) [jvaska@login1 .conda]$ python –version

Could not find platform independent libraries <prefix>

Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]

Python 3.7.12`

I’ve tried setting PYTHONHOME to `/gpfs/scratch/jvaska/COMEBin/environments/comebin_env`

But when I run the program I get some other error about encodings. When trying to fix that by upgrading encodings I get this error:

`pip install –upgrade –force-reinstall –no-cache-dir encodings`

Could not find platform independent libraries <prefix>

Consider setting $PYTHONHOME to <prefix>[:<exec_prefix>]

Fatal Python error: initfsencoding: Unable to get the locale encoding

LookupError: no codec search functions registered: can’t find encoding

Current thread 0x00002aaaaaaf2ec0 (most recent call first):

Aborted (core dumped)

Here is my conda info:

`(/gpfs/scratch/jvaska/COMEBin/environments/comebin_env) [jvaska@login1 .conda]$ conda info`

` active environment : /gpfs/scratch/jvaska/COMEBin/environments/comebin_env

active env location : /gpfs/scratch/jvaska/COMEBin/environments/comebin_env

shell level : 2

user config file : /gpfs/home/jvaska/.condarc

populated config files : /gpfs/home/jvaska/.condarc

conda version : 24.5.0

conda-build version : 3.27.0

python version : 3.10.12.final.0

solver : libmamba (default)

virtual packages : __archspec=1=haswell

__conda=24.5.0=0

__glibc=2.17=0

__linux=3.10.0=0

__unix=0=0

base environment : /gpfs/software/Anaconda (read only)

conda av data dir : /gpfs/software/Anaconda/etc/conda

conda av metadata url : None

channel URLs : https://repo.anaconda.com/pkgs/main/linux-64

https://repo.anaconda.com/pkgs/main/noarch

https://repo.anaconda.com/pkgs/r/linux-64

https://repo.anaconda.com/pkgs/r/noarch

package cache : /gpfs/home/jvaska/.conda/packages

/gpfs/home/jvaska/.conda

envs directories : /gpfs/home/jvaska/.conda/envs

/gpfs/software/Anaconda/envs

platform : linux-64

user-agent : conda/24.5.0 requests/2.31.0 CPython/3.10.12 Linux/3.10.0-1160.81.1.el7.x86_64 centos/7.9.2009 glibc/2.17 solver/libmamba conda-libmamba-solver/23.11.1 libmambapy/1.5.4

UID:GID : 113236684:113236684

netrc file : None

offline mode : False`

Again, I’m on a cluster and loaded conda using module load anaconda/3.

My home conda directory is /gpfs/home/jvaska/.conda, where in environments.txt, /gpfs/scratch/jvaska/COMEBin/environments/comebin_env exists.

I’m new to conda and environments and this is my first time posting on stackoverflow, anything helps thank you!

submitted by /u/jaaxk122
[link] [comments] 

Leave a Reply

Your email address will not be published. Required fields are marked *