Related
I'm super new to spark, so my issues might have a "no duh" answer that I can't quite grasp.
Firstly, I downloaded spark 1.5.2 and extracted it. In the python folder, I tried to run pyspark, but it said something along the lines that it needs a main.py, so I copied init.py to main.py and started getting weird syntax errors. I realized I was using python 2.9, so I switched to 2.7 and got a different error:
Traceback (most recent call last):
File "C:\Python27\lib\runpy.py", line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "C:\Python27\lib\runpy.py", line 72, in _run_code
exec code in run_globals
File "C:\spark-1.5.2\python\pyspark\__main__.py", line 40, in <module>
from pyspark.conf import SparkConf
ImportError: No module named pyspark.conf
I found this question that looked like the same error here: What to set `SPARK_HOME` to?
So I set up my environment variables as they did (except with C:/spark-1.5.2 instead of C:/spark), but that didn't fix the error for me. Then I realized they were using spark 1.4 from github. So I made a new folder and tried it as they did. I got stuck with the command:
build/mvn -DskipTests clean package
showing the error:
Java HotSpot(TM) Client VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
Error occurred during initialization of VM
Could not reserve enough space for 2097152KB object heap
I tried adding "-XX:MaxHeapSize=3g" but no change. Noting the comment "support was removed in 8.0", I downloaded java 7, but that didn't change anything either.
Thanks in advance
there is surprisingly little documentation or tutorials about this.
I want to run pylearn2 on my Mac OSX 10.11.1.
Acoording to the tutorial I should run at first this line:
cd pylearn/pylearn2/scripts/tutorials/grbm_smd/
python make_dataset.py
Yet the script fails with this exception:
Traceback (most recent call last):
File "/Users/username/python/pylearn2/pylearn2/utils/string_utils.py", line 53, in preprocess
else os.environ[varname])
File "/Users/username/anaconda/lib/python3.4/os.py", line 633, in __getitem__
raise KeyError(key) from None
KeyError: 'PYLEARN2_DATA_PATH'
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "make_dataset.py", line 27, in <module>
train = cifar10.CIFAR10(which_set="train")
File "/Users/username/python/pylearn2/pylearn2/datasets/cifar10.py", line 71, in __init__
string_utils.preprocess('${PYLEARN2_DATA_PATH}'),
File "/Users/username/python/pylearn2/pylearn2/utils/string_utils.py", line 56, in preprocess
reraise_as(NoDataPathError())
File "/Users/username/python/pylearn2/pylearn2/utils/exc.py", line 90, in reraise_as
six.reraise(type(new_exc), new_exc, orig_exc_traceback)
File "/Users/username/anaconda/lib/python3.4/site-packages/theano/compat/six.py", line 321, in reraise
raise value.with_traceback(tb)
File "/Users/username/python/pylearn2/pylearn2/utils/string_utils.py", line 53, in preprocess
else os.environ[varname])
File "/Users/username/anaconda/lib/python3.4/os.py", line 633, in __getitem__
raise KeyError(key) from None
pylearn2.utils.exc.NoDataPathError: You need to define your PYLEARN2_DATA_PATH environment variable. If you are
using a computer at LISA, this should be set to /data/lisa/data.
Platform-specific instructions for setting environment variables:
Linux
=====
On most linux setups, you can define your environment variable by adding this
line to your ~/.bashrc file:
export PYLEARN2_VIEWER_COMMAND="eog --new-instance"
*** YOU MUST INCLUDE THE WORD "export". DO NOT JUST ASSIGN TO THE ENVIRONMENT VARIABLE ***
If you do not include the word "export", the environment variable will be set
in your bash shell, but will not be visible to processes that you launch from
it, like the python interpreter.
Don't forget that changes from your .bashrc file won't apply until you run
source ~/.bashrc
or open a new terminal window. If you're seeing this from an ipython notebook
you'll need to restart the ipython notebook, or maybe modify os.environ from
an ipython cell.
Mac OS X
========
Environment variables on Mac OS X work the same as in Linux, except you should
modify and run the "source" command on ~/.profile rather than ~/.bashrc.
Original exception:
KeyError: PYLEARN2_DATA_PATH
I inserted the following information from the exception into ~/.profile
export PYLEARN2_VIEWER_COMMAND="eog --new-instance"
and ran
source ~/.bashrc
As it still threw an exception I did some research and found out I must put the .profile file into the .bash_profile. So I added this line to .bash_profile:
#.profile
source ~/.profile
However the outcome is still the same :(
Additional information
According to the installation guide says I should add another information to the path envoirement, yet I cannot understand which in particular.
hidden files in my system
.bash_history
.bash_profile
.bash_profile-anaconda.bak
.bash_sessions
.config
.ipython
.local
.profile
.python_history
.theano
.vminfo
After going through the code myself I've found the solution. There is a bug in the sourcecode, which is missing the download_cifar10.sh script. Plus the tutorial is missing a PATH variable which is necessary.
Instruction
1.) set the PATH variable
export PYLEARN2_VIEWER_COMMAND="eog --new-instance"
export PYLEARN2_DATA_PATH=/YOURPATHTOHERE/pylearn2/datasets
2.) download cifar-10 (python version)
3.) unpack it
You will get a "cifar-10-batches-py" folder
4.) Wrap "cifar-10-batches-py" in a "cifar-10" folder
5.) Put the "cifar-10" folder into /pylearn2/datasets
The final path containing the cifar-10 files should be:
../pylearn2/datasets/cifar-10-batches-py/cifar-10
You're ready to go!
The download script exist:
https://github.com/lisa-lab/pylearn2/blob/master/pylearn2/scripts/datasets/download_cifar10.sh
Did you download Pylearn2 correctly? Did you delete files in it by mistake?
Having trouble with virtualenv on Windows 7.
I run:
virtualenv _testenv
It returns:
Traceback (most recent call last):
File "C:\Python27\Scripts\virtualenv-script.py", line 9, in <module>
load_entry_point('virtualenv==1.5.2', 'console_scripts', 'virtualenv')()
File "C:\Python27\lib\site-packages\virtualenv.py", line 558, in main
prompt=options.prompt)
File "C:\Python27\lib\site-packages\virtualenv.py", line 647, in create_environment
site_packages=site_packages, clear=clear))
File "C:\Python27\lib\site-packages\virtualenv.py", line 771, in install_python
copy_required_modules(home_dir)
File "C:\Python27\lib\site-packages\virtualenv.py", line 725, in copy_required_modules
dst_filename = change_prefix(filename, dst_prefix)
File "C:\Python27\lib\site-packages\virtualenv.py", line 710, in change_prefix
(filename, prefixes)
AssertionError: Filename c:\Python27\Lib\os.py does not start with any of these prefixes: ['C:\\Python27']
I have the following environment variables:
PYTHONHOME=C:\Python27
PYTHONPATH=c:\Python27;c:\Python27\Lib
PYTHONSTARTUP=C:\Users\Larry\.pythonrc
PATH=%PYTHONHOME%\;%PYTHONHOME%\Scripts;etc
Installed ActiveState Python:
ActivePython 2.7.2.5 (ActiveState Software Inc.) based on
Python 2.7.2 (default, Jun 24 2011, 12:21:10) [MSC v.1500 32 bit (Intel)] on win32
I updated the PYTHONPATH=C:\Python27;C:\Python27\Lib
Still looking for a solution, I found and removed AppData/Python*. Reinstalled Python and now have a different error:
C:\xbz>virtualenv _t
PYTHONHOME is set. You *must* activate the virtualenv before using it
Overwriting _t\Lib\site.py with new content
New python executable in _t\Scripts\python2.7.exe
Not overwriting existing python script _t\Scripts\python.exe (you must use _t\Scripts\python2.7.exe)
Overwriting _t\Lib\distutils\__init__.py with new content
Installing setuptools..............
Complete output from command C:\xbz\_t\Scripts\python2.7.exe -c "#!python
\"\"\"Bootstrap setuptoo...
" --always-copy -U setuptools:
Traceback (most recent call last):
File "<string>", line 278, in <module>
File "<string>", line 210, in main
File "<string>", line 132, in download_setuptools
File "C:\Python27\Lib\urllib2.py", line 94, in <module>
import httplib
File "C:\Python27\Lib\httplib.py", line 71, in <module>
import socket
File "C:\Python27\Lib\socket.py", line 47, in <module>
import _socket
ImportError: No module named _socket
----------------------------------------
...Installing setuptools...done.
Traceback (most recent call last):
File "C:\Python27\Scripts\virtualenv-script.py", line 9, in <module>
load_entry_point('virtualenv==1.5.2', 'console_scripts', 'virtualenv')()
File "C:\Python27\lib\site-packages\virtualenv.py", line 558, in main
prompt=options.prompt)
File "C:\Python27\lib\site-packages\virtualenv.py", line 654, in create_environment
install_setuptools(py_executable, unzip=unzip_setuptools)
File "C:\Python27\lib\site-packages\virtualenv.py", line 384, in install_setuptools
_install_req(py_executable, unzip)
File "C:\Python27\lib\site-packages\virtualenv.py", line 360, in _install_req
cwd=cwd)
File "C:\Python27\lib\site-packages\virtualenv.py", line 624, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command C:\xbz\_t\Scripts\python2.7.exe -c "#!python
\"\"\"Bootstrap setuptoo...
" --always-copy -U setuptools failed with error code 1
I hacked Lib/socket.py and inserted:
import sys
sys.path = ['', 'C:\\Python27\\lib\\site-packages\\dotcloud-0.3.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\dotcloud.cli-0.3.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\flask-0.7dev_20110622-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\werkzeug-0.6.2-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\gunicorn-0.12.2-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\wtforms-0.6.3-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\repoze.browserid-0.3-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\paste-1.7.5.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\django_pjax-1.0-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\paramiko-1.7.7.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\pycrypto-2.4.1-py2.7-win32.egg', 'C:\\Python27', 'C:\\Python27\\Lib', 'C:\\Windows\\system32\\python27.zip', 'C:\\Python27\\DLLs', 'C:\\Python27\\lib\\plat-win', 'C:\\Python27\\lib\\lib-tk', 'C:\\Python27\\lib\\site-packages', 'C:\\Python27\\lib\\site-packages\\PIL', 'C:\\Python27\\lib\\site-packages\\win32', 'C:\\Python27\\lib\\site-packages\\win32\\lib', 'C:\\Python27\\lib\\site-packages\\Pythonwin', 'C:\\Python27\\lib\\site-packages\\setuptools-0.6c11-py2.7.egg-info', 'C:\\Python27\\Scripts', 'C:\\Python27\\Lib\\site-packages\\django\\bin']
Above
import _socket
The reason was that I was able to import socket from straight python prompt! So stuffed my existing path. I haven't narrowed down exactly which directory made it happy. It at least will reveal to someone else why I am getting the error without it.
Ideas? Suggestions?
Thank you. :)
I hacked Lib/socket.py and inserted:
import sys
sys.path.append('C:\\Python27\\DLLs')
Above
import _socket
3 year old question, but hopefully this answer can still help someone. Rather than setting the environment variables (which mysteriously didn't work for me), you can pass the path to your Python installation when setting up the virtual environment. In Windows, you have to path out to python.exe, but it seems that in Linux/OS X you just path to the folder. Examples:
Windows:
virtualenv -p <PATH TO PYTHON.EXE> venv
Linux/Mac:
virtualenv -p </user/path/to/python> venv
Both create a virtual environment in subfolder "venv" in current directory.
Try to set PYTHONPATH to PYTHONPATH=C:\Python27;C:\Python27\Lib (uppercase C at the start).
This can be done at the command prompt by typing set PYTHONPATH=C:\Python27;C:\Python27\Lib.
PYTHONPATH will revert back to whatever it previously was once that command prompt window is closed.
There is similar problem currently that shows error:
AssertionError: Filename C:\Python27\Lib\os.py does not start with any of
these prefixes: ['C:\\python27']
The difference is in 'C:\python27' being lower case. So the problem manifest itself in that you can not install new virtualenv or make a nested virtualenvs (we do it for testing sometimes).
The cause is in the conent of the PYTHONPATH
PYTHONPATH=C:\Python27;C:\Python27\Lib
For some reason sys.path in virtualenv.py will return c:\python27, but path to required modules will come form the PYTHONPATH and start with 'C:\Python27\Lib', hence the assertion error.
Long story short, just unset the PYTHONPATH.
For the _socket error, change your pythonpython path to:
PYTHONPATH=C:\Python27;C:\Python27\Lib;C:\Python27\DLLs
You can try the following (supppose your python is in global path):
python -m virtualenv [foldername]
This works for me, Win 10, virtualenv 15.1.0
I get it from this video, it will excute the python lib instead of calling windows exe.
I have added
if is_win:
prefixes.append('C:\PYTHON27')
to virtualenv.py and it works.
Its strange but from the error message
AssertionError: Filename c:\Python27\Lib\os.py does not start with any of these prefixes: ['C:\\Python27']
It seems, it expects the path-name for the file os.py to start with upper case 'C' and the prefix sanity check is case sensitive.
As the path to the library is derived from PYTHONPATH and in your case the drive letter is in lower case, it seems logical to change it to upper case to resolve the issue.
like
PYTHONPATH=C:\Python27;C:\Python27\Lib
I hate "summary" answers, but as I just went through a very similar issue I thought I would post my solution here as well which draws from several of these answers.
The assert error was caused because I did not have a PYTHONPATH
environment variable setup.
The socket error was caused because I did not include the
PythonXX\DLLs folder.
The full PYTHONPATH environment variable should look follows:
PYTHONPATH=C:\Python27;C:\Python27\Lib;C:\Python27\DLLs
This is an error already submitted to the Python development team: https://github.com/pypa/virtualenv/pull/697
In the meanwhile why not just change the Python installation folder name to (ptyhon27) to make the assertion work, or if you feel more confortable with that just reinstall python using the alternative location. It works with no issue.
I also ran into this problem on Windows 7. My Python27 installation was under C:\Program Files, which obviously contains a space in the path. So, on a separate Windows 7 system that did not contain Python, I did a fresh install of Python27 under C:\Python27 (the default installation path), followed by an install of setuptools (for easy_install).
Afterwards, I was able to install virtualenv CLEANLY without the above assertion error (I used easy_install).
I know that the OP's system is already using the default path, but I thought I would add my experience here as a possible solution for certain specific cases.
This issue is presumably a hangover from other more case-sensitive file systems.
Complete solution:
Read the error message from virtualenv. Remember the part where it says "does not start with any of these prefixes: ['C:\\Python27']".
Edit PYTHONPATH, or create it if you don't have one (Start+Break, Advanced system settings, Environment Variables). It shouldn't matter if it's a user variable or a system variable, unless you plan to switch user accounts.
Make the case match the error message. BOTH the drive letter AND the folder name must match (presumably intermediate folders as well, if you didn't install to C:\Python27). You can ignore the double backslash, one is fine.
The only change I made to fix the bug was as follows. The change should take effect for any new command / terminal sessions (close your open cmd.exe / powershell / etc. windows).
Old state: PYTHONPATH = C:\PYTHON27;C:\PYTHON27\LIB;C:\PYTHON27\DLLS
New state: PYTHONPATH = C:\Python27;C:\Python27\LIB;C:\Python27\DLLS
If you have any other items in your PYTHONPATH, you might as well change those too, but it probably won't affect virtualenv's ability to run.
Change "virtualenv.py" --> change_prefix with:
def change_prefix(filename, dst_prefix):
...
prefixes = sorted(prefixes, key=len, reverse=True)
filename = str(os.path.abspath(filename))[0].lower() + str(os.path.abspath(filename))[1:]
for src_prefix in prefixes:
if filename.startswith(src_prefix):
_, relpath = filename.split(src_prefix, 1)
if src_prefix != os.sep: # sys.prefix == "/"
assert relpath[0] == os.sep
relpath = relpath[1:]
return join(dst_prefix, relpath)
assert False, "Filename %s does not start with any of these prefixes: %s" % \
(filename, prefixes)
...
I had the same assertion error from a slightly different cause. The error was does not start with any of these prefixes: ['C:\\python27'] and note the lowercase "p". The actual folder names all use capital-P Python27. All the prefixes in PTYHONPATH were correct. However I had entered the PYTHONHOME variable as C:\python27 and although this was fine for Python, it caused the error in virtualenv.
Windows solution:
This is due to the difference between PYTHONPATH variable path and the one pipenv is expecting.
Suppose System Variable has below PYTHONPATH,
PYTHONPATH = C:\User\Bruce\AppData\Local\Programs\Python\Python37-32
And pipenv is looking for PYTHONPATH something like below:
PYTHONPATH = C:\users\bruce\appdata\local\programs\python\python37-32
Here, observe that the path text pipenv is looking has different case than what is set in System Environment variable.
To solve this issue try below steps by opening command prompt in folder where pipenv is to run:
> set PYTHONPATH=C:\users\bruce\appdata\local\programs\python\python37-32
You need to give exact same path that is shown in the AssertionError.
Then run below command to create pipenv
> pipenv install numpy
Any other library can be installed
I'm running Windows 7, and using python version 2.7.
I've been trying to use pygraphviz, but whenever I use G.layout() on a graph, I get the error message;
Traceback (most recent call last):
File "<pyshell#16>", line 1, in <module>
G.layout()
File "C:\Python27\lib\site-packages\pygraphviz\agraph.py", line 1305, in layout
data=self._run_prog(prog,' '.join([args,"-T",fmt]))
File "C:\Python27\lib\site-packages\pygraphviz\agraph.py", line 1251, in _run_prog
runprog=r'"%s"'%self._get_prog(prog)
File "C:\Python27\lib\site-packages\pygraphviz\agraph.py", line 1239, in _get_prog
raise ValueError("Program %s not found in path."%prog)
ValueError: Program neato not found in path.
I know, however, that the Graphviz files are installed, and the directory is in my path (I've manually gone and added it).
I've tried the simlink solution given here but all I get when I enter that into the command line (administrator mode) is a message saying it is not recognized as an internal or external command, operable program, or batch file. I'm not experienced enough to know whether there's something I'm failing to do with that though.
Is there something I can do to make this work?
I had the same problem with conda. Apparently there is something wrong with the libraries. This comment in here worked for me:
https://github.com/conda/conda/issues/1851#issuecomment-314924385
In the Anaconda prompt do both:
conda install -c anaconda graphviz
and
conda install -c anaconda python-graphviz
Then import graphviz will work.
Having trouble with virtualenv on Windows 7.
I run:
virtualenv _testenv
It returns:
Traceback (most recent call last):
File "C:\Python27\Scripts\virtualenv-script.py", line 9, in <module>
load_entry_point('virtualenv==1.5.2', 'console_scripts', 'virtualenv')()
File "C:\Python27\lib\site-packages\virtualenv.py", line 558, in main
prompt=options.prompt)
File "C:\Python27\lib\site-packages\virtualenv.py", line 647, in create_environment
site_packages=site_packages, clear=clear))
File "C:\Python27\lib\site-packages\virtualenv.py", line 771, in install_python
copy_required_modules(home_dir)
File "C:\Python27\lib\site-packages\virtualenv.py", line 725, in copy_required_modules
dst_filename = change_prefix(filename, dst_prefix)
File "C:\Python27\lib\site-packages\virtualenv.py", line 710, in change_prefix
(filename, prefixes)
AssertionError: Filename c:\Python27\Lib\os.py does not start with any of these prefixes: ['C:\\Python27']
I have the following environment variables:
PYTHONHOME=C:\Python27
PYTHONPATH=c:\Python27;c:\Python27\Lib
PYTHONSTARTUP=C:\Users\Larry\.pythonrc
PATH=%PYTHONHOME%\;%PYTHONHOME%\Scripts;etc
Installed ActiveState Python:
ActivePython 2.7.2.5 (ActiveState Software Inc.) based on
Python 2.7.2 (default, Jun 24 2011, 12:21:10) [MSC v.1500 32 bit (Intel)] on win32
I updated the PYTHONPATH=C:\Python27;C:\Python27\Lib
Still looking for a solution, I found and removed AppData/Python*. Reinstalled Python and now have a different error:
C:\xbz>virtualenv _t
PYTHONHOME is set. You *must* activate the virtualenv before using it
Overwriting _t\Lib\site.py with new content
New python executable in _t\Scripts\python2.7.exe
Not overwriting existing python script _t\Scripts\python.exe (you must use _t\Scripts\python2.7.exe)
Overwriting _t\Lib\distutils\__init__.py with new content
Installing setuptools..............
Complete output from command C:\xbz\_t\Scripts\python2.7.exe -c "#!python
\"\"\"Bootstrap setuptoo...
" --always-copy -U setuptools:
Traceback (most recent call last):
File "<string>", line 278, in <module>
File "<string>", line 210, in main
File "<string>", line 132, in download_setuptools
File "C:\Python27\Lib\urllib2.py", line 94, in <module>
import httplib
File "C:\Python27\Lib\httplib.py", line 71, in <module>
import socket
File "C:\Python27\Lib\socket.py", line 47, in <module>
import _socket
ImportError: No module named _socket
----------------------------------------
...Installing setuptools...done.
Traceback (most recent call last):
File "C:\Python27\Scripts\virtualenv-script.py", line 9, in <module>
load_entry_point('virtualenv==1.5.2', 'console_scripts', 'virtualenv')()
File "C:\Python27\lib\site-packages\virtualenv.py", line 558, in main
prompt=options.prompt)
File "C:\Python27\lib\site-packages\virtualenv.py", line 654, in create_environment
install_setuptools(py_executable, unzip=unzip_setuptools)
File "C:\Python27\lib\site-packages\virtualenv.py", line 384, in install_setuptools
_install_req(py_executable, unzip)
File "C:\Python27\lib\site-packages\virtualenv.py", line 360, in _install_req
cwd=cwd)
File "C:\Python27\lib\site-packages\virtualenv.py", line 624, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command C:\xbz\_t\Scripts\python2.7.exe -c "#!python
\"\"\"Bootstrap setuptoo...
" --always-copy -U setuptools failed with error code 1
I hacked Lib/socket.py and inserted:
import sys
sys.path = ['', 'C:\\Python27\\lib\\site-packages\\dotcloud-0.3.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\dotcloud.cli-0.3.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\flask-0.7dev_20110622-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\werkzeug-0.6.2-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\gunicorn-0.12.2-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\wtforms-0.6.3-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\repoze.browserid-0.3-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\paste-1.7.5.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\django_pjax-1.0-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\paramiko-1.7.7.1-py2.7.egg', 'C:\\Python27\\lib\\site-packages\\pycrypto-2.4.1-py2.7-win32.egg', 'C:\\Python27', 'C:\\Python27\\Lib', 'C:\\Windows\\system32\\python27.zip', 'C:\\Python27\\DLLs', 'C:\\Python27\\lib\\plat-win', 'C:\\Python27\\lib\\lib-tk', 'C:\\Python27\\lib\\site-packages', 'C:\\Python27\\lib\\site-packages\\PIL', 'C:\\Python27\\lib\\site-packages\\win32', 'C:\\Python27\\lib\\site-packages\\win32\\lib', 'C:\\Python27\\lib\\site-packages\\Pythonwin', 'C:\\Python27\\lib\\site-packages\\setuptools-0.6c11-py2.7.egg-info', 'C:\\Python27\\Scripts', 'C:\\Python27\\Lib\\site-packages\\django\\bin']
Above
import _socket
The reason was that I was able to import socket from straight python prompt! So stuffed my existing path. I haven't narrowed down exactly which directory made it happy. It at least will reveal to someone else why I am getting the error without it.
Ideas? Suggestions?
Thank you. :)
I hacked Lib/socket.py and inserted:
import sys
sys.path.append('C:\\Python27\\DLLs')
Above
import _socket
3 year old question, but hopefully this answer can still help someone. Rather than setting the environment variables (which mysteriously didn't work for me), you can pass the path to your Python installation when setting up the virtual environment. In Windows, you have to path out to python.exe, but it seems that in Linux/OS X you just path to the folder. Examples:
Windows:
virtualenv -p <PATH TO PYTHON.EXE> venv
Linux/Mac:
virtualenv -p </user/path/to/python> venv
Both create a virtual environment in subfolder "venv" in current directory.
Try to set PYTHONPATH to PYTHONPATH=C:\Python27;C:\Python27\Lib (uppercase C at the start).
This can be done at the command prompt by typing set PYTHONPATH=C:\Python27;C:\Python27\Lib.
PYTHONPATH will revert back to whatever it previously was once that command prompt window is closed.
There is similar problem currently that shows error:
AssertionError: Filename C:\Python27\Lib\os.py does not start with any of
these prefixes: ['C:\\python27']
The difference is in 'C:\python27' being lower case. So the problem manifest itself in that you can not install new virtualenv or make a nested virtualenvs (we do it for testing sometimes).
The cause is in the conent of the PYTHONPATH
PYTHONPATH=C:\Python27;C:\Python27\Lib
For some reason sys.path in virtualenv.py will return c:\python27, but path to required modules will come form the PYTHONPATH and start with 'C:\Python27\Lib', hence the assertion error.
Long story short, just unset the PYTHONPATH.
For the _socket error, change your pythonpython path to:
PYTHONPATH=C:\Python27;C:\Python27\Lib;C:\Python27\DLLs
You can try the following (supppose your python is in global path):
python -m virtualenv [foldername]
This works for me, Win 10, virtualenv 15.1.0
I get it from this video, it will excute the python lib instead of calling windows exe.
I have added
if is_win:
prefixes.append('C:\PYTHON27')
to virtualenv.py and it works.
Its strange but from the error message
AssertionError: Filename c:\Python27\Lib\os.py does not start with any of these prefixes: ['C:\\Python27']
It seems, it expects the path-name for the file os.py to start with upper case 'C' and the prefix sanity check is case sensitive.
As the path to the library is derived from PYTHONPATH and in your case the drive letter is in lower case, it seems logical to change it to upper case to resolve the issue.
like
PYTHONPATH=C:\Python27;C:\Python27\Lib
I hate "summary" answers, but as I just went through a very similar issue I thought I would post my solution here as well which draws from several of these answers.
The assert error was caused because I did not have a PYTHONPATH
environment variable setup.
The socket error was caused because I did not include the
PythonXX\DLLs folder.
The full PYTHONPATH environment variable should look follows:
PYTHONPATH=C:\Python27;C:\Python27\Lib;C:\Python27\DLLs
This is an error already submitted to the Python development team: https://github.com/pypa/virtualenv/pull/697
In the meanwhile why not just change the Python installation folder name to (ptyhon27) to make the assertion work, or if you feel more confortable with that just reinstall python using the alternative location. It works with no issue.
I also ran into this problem on Windows 7. My Python27 installation was under C:\Program Files, which obviously contains a space in the path. So, on a separate Windows 7 system that did not contain Python, I did a fresh install of Python27 under C:\Python27 (the default installation path), followed by an install of setuptools (for easy_install).
Afterwards, I was able to install virtualenv CLEANLY without the above assertion error (I used easy_install).
I know that the OP's system is already using the default path, but I thought I would add my experience here as a possible solution for certain specific cases.
This issue is presumably a hangover from other more case-sensitive file systems.
Complete solution:
Read the error message from virtualenv. Remember the part where it says "does not start with any of these prefixes: ['C:\\Python27']".
Edit PYTHONPATH, or create it if you don't have one (Start+Break, Advanced system settings, Environment Variables). It shouldn't matter if it's a user variable or a system variable, unless you plan to switch user accounts.
Make the case match the error message. BOTH the drive letter AND the folder name must match (presumably intermediate folders as well, if you didn't install to C:\Python27). You can ignore the double backslash, one is fine.
The only change I made to fix the bug was as follows. The change should take effect for any new command / terminal sessions (close your open cmd.exe / powershell / etc. windows).
Old state: PYTHONPATH = C:\PYTHON27;C:\PYTHON27\LIB;C:\PYTHON27\DLLS
New state: PYTHONPATH = C:\Python27;C:\Python27\LIB;C:\Python27\DLLS
If you have any other items in your PYTHONPATH, you might as well change those too, but it probably won't affect virtualenv's ability to run.
Change "virtualenv.py" --> change_prefix with:
def change_prefix(filename, dst_prefix):
...
prefixes = sorted(prefixes, key=len, reverse=True)
filename = str(os.path.abspath(filename))[0].lower() + str(os.path.abspath(filename))[1:]
for src_prefix in prefixes:
if filename.startswith(src_prefix):
_, relpath = filename.split(src_prefix, 1)
if src_prefix != os.sep: # sys.prefix == "/"
assert relpath[0] == os.sep
relpath = relpath[1:]
return join(dst_prefix, relpath)
assert False, "Filename %s does not start with any of these prefixes: %s" % \
(filename, prefixes)
...
I had the same assertion error from a slightly different cause. The error was does not start with any of these prefixes: ['C:\\python27'] and note the lowercase "p". The actual folder names all use capital-P Python27. All the prefixes in PTYHONPATH were correct. However I had entered the PYTHONHOME variable as C:\python27 and although this was fine for Python, it caused the error in virtualenv.
Windows solution:
This is due to the difference between PYTHONPATH variable path and the one pipenv is expecting.
Suppose System Variable has below PYTHONPATH,
PYTHONPATH = C:\User\Bruce\AppData\Local\Programs\Python\Python37-32
And pipenv is looking for PYTHONPATH something like below:
PYTHONPATH = C:\users\bruce\appdata\local\programs\python\python37-32
Here, observe that the path text pipenv is looking has different case than what is set in System Environment variable.
To solve this issue try below steps by opening command prompt in folder where pipenv is to run:
> set PYTHONPATH=C:\users\bruce\appdata\local\programs\python\python37-32
You need to give exact same path that is shown in the AssertionError.
Then run below command to create pipenv
> pipenv install numpy
Any other library can be installed