I just got a new Macbook with a M1 chip. I managed to install python version 3.7.12 and wanted to continue working on a jupyter notebook I created on my old Mac. Hereby, I came across the issue that after I imported all the relevant packages in the first cell, these imports were not found in the next cell (see below).
To reproduce:
Imports
import pandas as pd
import numpy as np
from sklearn.preprocessing import MinMaxScaler, LabelEncoder
from keras.models import Sequential
Check Import
test_df = pd.DataFrame()
See Output (the following for me)
NameError: name 'pd' is not defined
I already read about and tried the issue of dying kernels (https://github.com/jupyter/notebook/issues/5882). Interestingly, when playing with the sequence of the imports, I realized that the keras import seems to be the problem.
To reproduce:
import pandas as pd
test_df = pd.DataFrame()
from keras.layers import Dense
test_df = pd.DataFrame()
Here, I obersed that cell 2 works just fine, but cell 4 (after the keras imports) again returns "the NameError: name 'pd' is not defined" error. For now, as a workaround, I just changed the sequence of my imports and split it into different cells.
This is my first question on StackOverflow, so if any information is missing, please let me know. Thanks in advance for any help!
Pip list:
absl-py 1.0.0
appnope 0.1.2
argcomplete 1.12.3
argon2-cffi 21.1.0
astunparse 1.6.3
attrs 21.2.0
awscli 1.22.14
backcall 0.2.0
bleach 4.1.0
boto3 1.20.14
botocore 1.23.14
cached-property 1.5.2
cachetools 4.2.4
certifi 2021.10.8
cffi 1.15.0
charset-normalizer 2.0.8
colorama 0.4.3
debugpy 1.5.1
decorator 5.1.0
defusedxml 0.7.1
docutils 0.15.2
entrypoints 0.3
flatbuffers 2.0
gast 0.4.0
google-auth 2.3.3
google-auth-oauthlib 0.4.6
google-pasta 0.2.0
grpcio 1.42.0
h5py 3.6.0
idna 3.3
importlib-metadata 4.8.2
importlib-resources 5.4.0
ipykernel 6.5.1
ipython 7.30.0
ipython-genutils 0.2.0
ipywidgets 7.6.5
jedi 0.18.1
Jinja2 3.0.3
jmespath 0.10.0
joblib 1.1.0
jsonschema 4.2.1
jupyter 1.0.0
jupyter-client 7.1.0
jupyter-console 6.4.0
jupyter-core 4.9.1
jupyterlab-pygments 0.1.2
jupyterlab-widgets 1.0.2
keras 2.7.0
Keras-Preprocessing 1.1.2
libclang 12.0.0
Markdown 3.3.6
MarkupSafe 2.0.1
matplotlib-inline 0.1.3
mistune 0.8.4
nbclient 0.5.9
nbconvert 6.3.0
nbformat 5.1.3
nest-asyncio 1.5.1
notebook 6.4.6
numpy 1.21.4
oauthlib 3.1.1
opt-einsum 3.3.0
packaging 21.3
pandas 1.3.4
pandocfilters 1.5.0
parso 0.8.2
pexpect 4.8.0
pickleshare 0.7.5
pip 21.3.1
prometheus-client 0.12.0
prompt-toolkit 3.0.23
protobuf 3.19.1
psycopg2-binary 2.9.2
ptyprocess 0.7.0
PuLP 2.5.1
pyasn1 0.4.8
pyasn1-modules 0.2.8
pyathena 2.3.1
pycparser 2.21
Pygments 2.10.0
pyparsing 3.0.6
pyrsistent 0.18.0
python-dateutil 2.8.2
pytz 2021.3
PyYAML 5.4.1
pyzmq 22.3.0
qtconsole 5.2.1
QtPy 1.11.2
red-panda 1.0.2
requests 2.26.0
requests-oauthlib 1.3.0
rsa 4.7.2
s3transfer 0.5.0
scikit-learn 1.0.1
scipy 1.7.3
Send2Trash 1.8.0
setuptools 59.3.0
six 1.16.0
tenacity 8.0.1
tensorboard 2.7.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.0
tensorflow 2.7.0
tensorflow-estimator 2.7.0
tensorflow-io-gcs-filesystem 0.22.0
termcolor 1.1.0
terminado 0.12.1
testpath 0.5.0
threadpoolctl 3.0.0
tornado 6.1
traitlets 5.1.1
typing_extensions 4.0.0
urllib3 1.26.7
wcwidth 0.2.5
webencodings 0.5.1
Werkzeug 2.0.2
wheel 0.37.0
widgetsnbextension 3.5.2
wrapt 1.13.3
zipp 3.6.0
Related
This one line python program fails with the error message above on windows 10 with python 310:
from keras.models import Sequential
Preceding the keras's with 'tensorflow.' does not help.
Edit 1: Seems like none of my pthon files that us tensorflow are now failing with this error. I must have installed something that is incompatible. How does one find out what the problem is?
Edit 2: Any import of tensorflow or keras gets a stack trace (please see below). They all seem to get intp module_util and end up in _make_function_type.
Traceback (most recent call last):
File "D:\ray\eclisepython\2py\src\p\t.py", line 3, in <module>
import tensorflow as tf
File "C:\Users\raz\AppData\Local\Programs\Python\Python310\lib\site-packages\tensorflow\__init__.py", line 37, in <module>
from tensorflow.python.tools import module_util as _module_util
...
File "C:\Users\raz\AppData\Local\Programs\Python\Python310\lib\site-packages\tensorflow\python\eager\polymorphic_function\function_spec.py", line 272, in _make_function_type
type_constraint = trace_type.from_value(
AttributeError: module 'tensorflow.core.function.trace_type' has no attribute 'from_value'
Package Version
---------------------------- -----------
absl-py 1.3.0
altgraph 0.17.2
anyio 3.6.1
appdirs 1.4.4
argon2-cffi 21.3.0
argon2-cffi-bindings 21.2.0
arrow 1.2.3
asgiref 3.5.2
asttokens 2.2.1
astunparse 1.6.3
attrs 22.2.0
backcall 0.2.0
beautifulsoup4 4.11.1
bleach 5.0.1
blosc2 2.0.0
cachetools 5.2.1
certifi 2022.9.24
cffi 1.15.1
charset-normalizer 2.1.1
click 8.1.3
colorama 0.4.5
comm 0.1.2
contextvars 2.4
contourpy 1.0.6
cryptography 39.0.0
cycler 0.11.0
Cython 0.29.33
dash 2.7.1
dash-core-components 2.0.0
dash-html-components 2.0.0
dash-table 5.0.0
debugpy 1.6.5
decorator 5.1.1
defusedxml 0.7.1
entrypoints 0.4
et-xmlfile 1.1.0
executing 1.2.0
fastjsonschema 2.16.2
finta 1.3
Flask 2.2.2
flatbuffers 23.1.4
fonttools 4.38.0
fqdn 1.5.1
frozendict 2.3.4
future 0.18.2
gast 0.4.0
google-auth 2.16.0
google-auth-oauthlib 0.4.6
google-pasta 0.2.0
grpcio 1.51.1
h11 0.13.0
h5py 3.7.0
html5lib 1.1
htmltools 0.1.2
idna 3.3
immutables 0.18
ipykernel 6.20.1
ipython 8.8.0
ipython-genutils 0.2.0
ipywidgets 8.0.4
isoduration 20.11.0
itsdangerous 2.1.2
jedi 0.18.2
Jinja2 3.1.2
joblib 1.2.0
jsonpointer 2.3
jsonschema 4.17.3
jupyter 1.0.0
jupyter_client 7.4.8
jupyter-console 6.4.4
jupyter_core 5.1.3
jupyter-events 0.6.2
jupyter_server 2.0.6
jupyter_server_terminals 0.4.4
jupyterlab-pygments 0.2.2
jupyterlab-widgets 3.0.5
keras 2.10.0
Keras-Preprocessing 1.1.2
kiwisolver 1.4.4
libclang 15.0.6.1
linkify-it-py 2.0.0
lxml 4.9.2
Markdown 3.4.1
markdown-it-py 2.1.0
MarkupSafe 2.1.1
matplotlib 3.6.2
matplotlib-inline 0.1.6
mdurl 0.1.1
mistune 2.0.4
msgpack 1.0.4
multitasking 0.0.11
nbclassic 0.4.8
nbclient 0.7.2
nbconvert 7.2.7
nbformat 5.7.2
nest-asyncio 1.5.6
notebook 6.5.2
notebook_shim 0.2.2
numexpr 2.8.4
numpy 1.24.2
oauthlib 3.2.2
openpyxl 3.1.0
opt-einsum 3.3.0
packaging 21.3
pandas 1.5.3
pandas-datareader 0.10.0
pandocfilters 1.5.0
parso 0.8.3
patsy 0.5.3
pefile 2022.5.30
pickleshare 0.7.5
Pillow 9.4.0
pip 23.0
platformdirs 2.6.2
plotly 5.11.0
prometheus-client 0.15.0
prompt-toolkit 3.0.36
protobuf 3.19.6
psutil 5.9.3
pure-eval 0.2.2
py-cpuinfo 9.0.0
py4j 0.10.9.5
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycparser 2.21
Pygments 2.14.0
pyinstaller 5.3
pyinstaller-hooks-contrib 2022.8
pyparsing 3.0.9
pyrsistent 0.19.3
pyspark 3.3.1
python-dateutil 2.8.2
python-json-logger 2.0.4
python-multipart 0.0.5
pytz 2022.7
pywin32 305
pywin32-ctypes 0.2.0
pywinpty 2.0.10
PyYAML 6.0
pyzmq 24.0.1
qtconsole 5.4.0
QtPy 2.3.0
requests 2.28.1
requests-oauthlib 1.3.1
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rsa 4.9
scikit-learn 1.2.0
scipy 1.10.0
seaborn 0.12.2
Send2Trash 1.8.0
setuptools 63.2.0
shiny 0.2.4
simplejson 3.18.1
six 1.16.0
sniffio 1.2.0
soupsieve 2.3.2.post1
stack-data 0.6.2
starlette 0.20.4
statsmodels 0.13.5
tables 3.8.0
tenacity 8.1.0
tensorboard 2.10.1
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.1
tensorflow 2.11.0
tensorflow-estimator 2.10.0
tensorflow-intel 2.11.0
tensorflow-io-gcs-filesystem 0.29.0
termcolor 2.2.0
terminado 0.17.1
Theano 1.0.5
threadpoolctl 3.1.0
tinycss2 1.2.1
tornado 6.2
traitlets 5.8.1
typing_extensions 4.3.0
uc-micro-py 1.0.1
uri-template 1.2.0
urllib3 1.26.12
uvicorn 0.18.2
watchdog 2.1.9
wcwidth 0.2.5
webcolors 1.12
webencodings 0.5.1
websocket-client 1.4.2
websockets 10.3
Werkzeug 2.2.2
wheel 0.38.4
widgetsnbextension 4.0.5
wrapt 1.14.1
xgboost 1.7.3
yahoo-finance 1.4.0
yfinance 0.2.3
Try setting your script up like it's described in the keras docs
edit: Alright, my next recommendation would be to create a new virtual environment and try installing your packages there and run your one line import and see if it works. It seems like there could be some issues with your current installed packages. Open up command prompt:
mkdir venvFolder
cd venvFolder
python3 -m venv testVenv
cd testVenv\Scripts
activate
You should now see (testVenv) in front of your prompt. Now:
(testVenv) C:\> pip3 install tensorflow
(testVenv) C:\> pip3 install keras
(testVenv) C:\> python3
Now that you have python open:
>>> from keras.models import Sequential
>>> exit()
If the above runs without throwing an error, your next step would be:
(testVenv) C:\> deactivate
C:\> pip3 uninstall keras tensorflow
C:\> pip3 install keras tensorflow
It's very important that you deactivate your virtual environment or you will be using the wrong pip for packages.
Then try running your import again in whatever you were originally using to run your script and see if it works now.
I am running Spyder IDE on Red Hat Linux. I installed Spyder in a virtual environment as outlined https://docs.spyder-ide.org/current/installation.html and this was running without a problem. I now following message when I launch
Traceback (most recent call last):
File "/home/<my_name>/spyder-env/bin/spyder", line 8, in <module>
sys.exit(main())
File "/home/<my_name>/spyder-env/lib64/python3.9/site-packages/spyder/app/start.py", line 248, in main
from spyder.app import mainwindow
File "/home/<my_name>/spyder-env/lib64/python3.9/site-packages/spyder/app/mainwindow.py", line 41, in <module>
requirements.check_qt()
File "/home/<my_name>/spyder-env/lib64/python3.9/site-packages/spyder/requirements.py", line 54, in check_qt
show_warning("Please check Spyder installation requirements:\n"
File "/home/<my_name>/spyder-env/lib64/python3.9/site-packages/spyder/requirements.py", line 32, in show_warning
raise RuntimeError(message)
RuntimeError: Please check Spyder installation requirements:
PyQt5 5.9+ is required (found None).
Here are a list of packages and versions I have installed, with PyQT5
python3 -m pip list
Package Version
----------------------------- -------------------
absl-py 1.0.0
alabaster 0.7.12
arrow 1.2.2
astroid 2.11.3
asttokens 2.0.5
astunparse 1.6.3
atomicwrites 1.4.0
attrs 21.4.0
autopep8 1.6.0
Babel 2.10.1
backcall 0.2.0
beautifulsoup4 4.11.1
binaryornot 0.4.4
black 22.3.0
bleach 5.0.0
cachetools 5.0.0
certifi 2021.10.8
cffi 1.15.0
chardet 4.0.0
charset-normalizer 2.0.12
click 8.1.3
cloudpickle 2.0.0
cookiecutter 1.7.3
cryptography 37.0.1
cycler 0.11.0
deap 1.3.1
debugpy 1.6.0
decorator 5.1.1
defusedxml 0.7.1
Deprecated 1.2.13
diff-match-patch 20200713
dill 0.3.4
docutils 0.17.1
entrypoints 0.4
executing 0.8.3
fastjsonschema 2.15.3
flake8 4.0.1
flatbuffers 2.0
fonttools 4.33.3
gast 0.5.3
google-auth 2.6.6
google-auth-oauthlib 0.4.6
google-pasta 0.2.0
grpcio 1.44.0
h5py 3.6.0
idna 3.3
imagesize 1.3.0
imbalanced-learn 0.9.0
imblearn 0.0
importlib-metadata 4.11.3
inflection 0.5.1
intervaltree 3.1.0
ipykernel 6.13.0
ipython 7.32.0
ipython-genutils 0.2.0
isort 5.10.1
jedi 0.18.1
jeepney 0.8.0
jellyfish 0.9.0
Jinja2 3.0.3
jinja2-time 0.2.0
joblib 1.1.0
jsonschema 4.4.0
jupyter_client 7.3.5
jupyter-core 4.10.0
jupyterlab-pygments 0.2.2
keras 2.8.0
Keras-Preprocessing 1.1.2
keyring 23.5.0
kiwisolver 1.4.2
lazy-object-proxy 1.7.1
libclang 14.0.1
llvmlite 0.38.1
Markdown 3.3.6
MarkupSafe 2.1.1
matplotlib 3.5.1
matplotlib-inline 0.1.3
mccabe 0.6.1
mistune 0.8.4
mypy-extensions 0.4.3
nbclient 0.6.0
nbconvert 6.5.0
nbformat 5.3.0
nest-asyncio 1.5.5
numba 0.55.2
numpy 1.21.6
numpydoc 1.2.1
oauthlib 3.2.0
opt-einsum 3.3.0
packaging 21.3
pandas 1.4.3
pandocfilters 1.5.0
parso 0.8.3
pathspec 0.9.0
patsy 0.5.2
pexpect 4.8.0
pickleshare 0.7.5
Pillow 9.1.0
pip 22.2.2
platformdirs 2.5.2
pluggy 1.0.0
poyo 0.5.0
prompt-toolkit 3.0.29
protobuf 3.20.1
psutil 5.9.0
ptyprocess 0.7.0
pure-eval 0.2.2
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycodestyle 2.8.0
pycparser 2.21
pydocstyle 6.1.1
pyflakes 2.4.0
Pygments 2.12.0
pylint 2.13.7
pyls-spyder 0.4.0
PyOpenGL 3.1.6
pyparsing 3.0.8
PyQt5 5.12.3
PyQt5-Qt5 5.15.2
PyQt5-sip 12.10.1
PyQtWebEngine 5.12.1
PyQtWebEngine-Qt5 5.15.2
pyrsistent 0.18.1
python-dateutil 2.8.2
python-lsp-black 1.2.1
python-lsp-jsonrpc 1.0.0
python-lsp-server 1.5.0
python-slugify 6.1.2
pytz 2022.1
pyxdg 0.27
pyzmq 24.0.1
QDarkStyle 3.0.3
qstylizer 0.2.1
QtAwesome 1.1.1
qtconsole 5.3.2
QtPy 2.1.0
requests 2.27.1
requests-oauthlib 1.3.1
rope 1.0.0
rsa 4.8
Rtree 1.0.0
scikeras 0.9.0
scikit-learn 1.0.2
scipy 1.8.0
seaborn 0.11.2
SecretStorage 3.3.2
setuptools 50.3.2
six 1.16.0
sklearn 0.0
sktime 0.12.0
snowballstemmer 2.2.0
sortedcontainers 2.4.0
soupsieve 2.3.2.post1
Sphinx 4.5.0
sphinxcontrib-applehelp 1.0.2
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 2.0.0
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.5
spyder 5.3.3
spyder-kernels 2.3.3
statsmodels 0.13.2
stopit 1.1.2
tensorboard 2.8.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.1
tensorflow 2.8.0
tensorflow-io-gcs-filesystem 0.25.0
termcolor 1.1.0
text-unidecode 1.3
textdistance 4.2.2
tf-estimator-nightly 2.8.0.dev2021122109
threadpoolctl 3.1.0
three-merge 0.1.1
tinycss2 1.1.1
toml 0.10.2
tomli 2.0.1
torch 1.11.0
torchaudio 0.11.0
torchvision 0.12.0
tornado 6.2
TPOT 0.11.7
tqdm 4.64.0
traitlets 5.1.1
typing_extensions 4.2.0
ujson 5.2.0
update-checker 0.18.0
urllib3 1.26.9
varname 0.8.3
watchdog 2.1.9
wcwidth 0.2.5
webencodings 0.5.1
Werkzeug 2.1.2
whatthepatch 1.0.2
wheel 0.37.1
wrapt 1.14.0
wurlitzer 3.0.2
xgboost 1.6.0
yapf 0.32.0
zipp 3.8.0
This is on a shared machine, is it possible that someone could have changed something to cause the error? Does anyone have a fix?
Unsetting the library path seemed to resolve the issue. Something local on the machine was going wrong.
unset LD_LIBRARY_PATH
I am trying to import segmentation models and keras and i am getting an attribute error, i am using tensor flow version 2.5.0
import tensorflow as tf
import segmentation_models as sm
import glob
import cv2
import os
import numpy as np
from matplotlib import pyplot as plt
import keras
from keras.utils import normalize
from keras.metrics import MeanIoU
Attribute error :
AttributeError: module 'keras.utils.generic_utils' has no attribute 'populate_dict_with_module_objects'
I tried installing tensorflow 2.1.0 version to solve the issue as recommended in other question, but still the problem persists, any suggestion is greatly appreciated.
As suggested in comments , i am updating output of pip list
pip list :
pip list
Package Version
---------------------------------- -------------------
absl-py 0.12.0
alabaster 0.7.12
anaconda-client 1.8.0
anaconda-navigator 2.0.3
anaconda-project 0.10.0
antlr4-python3-runtime 4.8
anyio 2.2.0
appdirs 1.4.4
argh 0.26.2
argon2-cffi 20.1.0
arrow 0.13.1
asn1crypto 1.4.0
astroid 2.6.0
astropy 4.2.1
astunparse 1.6.3
async-generator 1.10
atomicwrites 1.4.0
attrs 21.2.0
autopep8 1.5.6
Babel 2.9.1
backcall 0.2.0
backports.functools-lru-cache 1.6.4
backports.shutil-get-terminal-size 1.0.0
backports.tempfile 1.0
backports.weakref 1.0.post1
beautifulsoup4 4.9.3
binaryornot 0.4.4
bitarray 2.1.0
bkcharts 0.2
black 21.4b2
bleach 3.3.0
bokeh 2.3.2
boto 2.49.0
Bottleneck 1.3.2
brotlipy 0.7.0
cachetools 4.2.2
certifi 2021.5.30
cffi 1.14.5
chardet 4.0.0
click 8.0.1
cloudpickle 1.6.0
clyent 1.2.2
colorama 0.4.4
conda 4.10.1
conda-build 3.21.4
conda-content-trust 0+unknown
conda-pack 0.6.0
conda-package-handling 1.7.3
conda-repo-cli 1.0.4
conda-token 0.3.0
conda-verify 3.4.2
contextlib2 0.6.0.post1
cookiecutter 1.7.2
cryptography 3.4.7
cycler 0.10.0
Cython 0.29.23
cytoolz 0.11.0
dask 2021.6.2
decorator 4.4.2
defusedxml 0.7.1
detectron2 0.4.1
diff-match-patch 20200713
distributed 2021.6.2
docutils 0.17.1
efficientnet 1.0.0
entrypoints 0.3
et-xmlfile 1.1.0
fast-slic 0.4.0
fastcache 1.1.0
filelock 3.0.12
flake8 3.9.0
Flask 1.1.2
flatbuffers 1.12
fsspec 2021.6.0
future 0.18.2
fvcore 0.1.5.post20210609
gast 0.4.0
gco-wrapper 3.0.7
gevent 21.1.2
glob2 0.7
gmpy2 2.0.8
google-auth 1.31.0
google-auth-oauthlib 0.4.4
google-pasta 0.2.0
greenlet 1.1.0
grpcio 1.34.1
h5py 3.1.0
HeapDict 1.0.1
html5lib 1.1
hydra-core 1.1.0
idna 2.10
image-classifiers 1.0.0
imageio 2.9.0
imagesize 1.2.0
importlib-metadata 3.10.0
importlib-resources 5.1.4
ImSegm 0.1.8
inflection 0.5.1
iniconfig 1.1.1
intervaltree 3.1.0
iopath 0.1.8
ipykernel 5.3.4
ipython 7.22.0
ipython-genutils 0.2.0
ipywidgets 7.6.3
isort 5.9.1
itsdangerous 2.0.1
jdcal 1.4.1
jedi 0.17.2
jeepney 0.6.0
Jinja2 2.11.3
jinja2-time 0.2.0
joblib 1.0.1
json5 0.9.6
jsonschema 3.2.0
jupyter 1.0.0
jupyter-client 6.1.12
jupyter-console 6.4.0
jupyter-core 4.7.1
jupyter-packaging 0.7.12
jupyter-server 1.4.1
jupyterlab 3.0.14
jupyterlab-pygments 0.1.2
jupyterlab-server 2.4.0
jupyterlab-widgets 1.0.0
Keras 2.3.1
Keras-Applications 1.0.8
keras-nightly 2.5.0.dev2021032900
Keras-Preprocessing 1.1.2
keyring 23.0.1
kiwisolver 1.3.1
lazy-object-proxy 1.6.0
libarchive-c 2.9
llvmlite 0.36.0
locket 0.2.1
lxml 4.6.3
Markdown 3.3.4
MarkupSafe 1.1.1
matplotlib 3.4.2
mccabe 0.6.1
mistune 0.8.4
mkl-fft 1.3.0
mkl-random 1.2.1
mkl-service 2.3.0
mock 4.0.3
more-itertools 8.8.0
mpmath 1.2.1
msgpack 1.0.2
multipledispatch 0.6.0
mypy-extensions 0.4.3
navigator-updater 0.2.1
nbclassic 0.2.6
nbclient 0.5.3
nbconvert 6.1.0
nbformat 5.1.3
nest-asyncio 1.5.1
networkx 2.5.1
nibabel 3.2.1
nltk 3.6.2
nose 1.3.7
notebook 6.4.0
np-utils 0.5.12.1
numba 0.53.1
numexpr 2.7.3
numpy 1.19.5
numpydoc 1.1.0
oauthlib 3.1.1
olefile 0.46
omegaconf 2.1.0
opencv-python 4.4.0.46
openpyxl 3.0.7
opt-einsum 3.3.0
packaging 20.9
pandas 1.1.4
pandocfilters 1.4.3
parso 0.7.0
partd 1.2.0
patchify 0.2.3
path 16.0.0
pathlib2 2.3.5
pathspec 0.8.1
pathtools 0.1.2
patsy 0.5.1
pbr 5.6.0
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
Pillow 8.2.0
pip 21.1.2
pkginfo 1.7.0
planar 0.4
pluggy 0.13.1
ply 3.11
portalocker 2.3.0
poyo 0.5.0
prometheus-client 0.11.0
prompt-toolkit 3.0.17
protobuf 3.17.3
psutil 5.8.0
ptyprocess 0.7.0
py 1.10.0
pyasn1 0.4.8
pyasn1-modules 0.2.8
pycocotools 2.0.2
pycodestyle 2.6.0
pycosat 0.6.3
pycparser 2.20
pycurl 7.43.0.6
pydocstyle 6.1.1
pydot 1.4.2
pyerfa 2.0.0
pyflakes 2.2.0
Pygments 2.9.0
pylint 2.8.3
pyls-black 0.4.6
pyls-spyder 0.3.2
pyodbc 4.0.0-unsupported
pyOpenSSL 20.0.1
pyparsing 2.4.7
pyrsistent 0.17.3
PySocks 1.7.1
pytest 6.2.4
python-dateutil 2.8.1
python-jsonrpc-server 0.4.0
python-language-server 0.36.2
python-slugify 5.0.2
pytz 2021.1
PyWavelets 1.1.1
pyxdg 0.27
PyYAML 5.4.1
pyzmq 20.0.0
QDarkStyle 3.0.2
qstylizer 0.1.10
QtAwesome 1.0.2
qtconsole 5.1.0
QtPy 1.9.0
regex 2021.4.4
requests 2.25.1
requests-oauthlib 1.3.0
rope 0.19.0
rsa 4.7.2
Rtree 0.9.7
ruamel-yaml-conda 0.15.100
scikit-image 0.18.1
scikit-learn 0.24.2
scipy 1.5.4
seaborn 0.11.1
SecretStorage 3.3.1
segmentation-models 1.0.1
Send2Trash 1.5.0
setuptools 57.0.0
simplegeneric 0.8.1
singledispatch 0.0.0
sip 4.19.13
six 1.15.0
sniffio 1.2.0
snowballstemmer 2.1.0
sortedcollections 2.1.0
sortedcontainers 2.4.0
soupsieve 2.2.1
Sphinx 4.0.2
sphinxcontrib-applehelp 1.0.2
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 2.0.0
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.5
sphinxcontrib-websupport 1.2.4
spyder 5.0.3
spyder-kernels 2.0.3
SQLAlchemy 1.4.19
statsmodels 0.12.2
sympy 1.8
tables 3.6.1
tabulate 0.8.9
tblib 1.7.0
tensorboard 2.5.0
tensorboard-data-server 0.6.1
tensorboard-plugin-wit 1.8.0
tensorflow 2.5.0
tensorflow-estimator 2.5.0
tensorflow-gpu 2.5.0
termcolor 1.1.0
terminado 0.9.4
testpath 0.5.0
testresources 2.0.1
text-unidecode 1.3
textdistance 4.2.1
threadpoolctl 2.1.0
three-merge 0.1.1
tifffile 2021.6.6
tinycss 0.4
toml 0.10.2
toolz 0.11.1
torch 1.6.0+cu101
torchvision 0.7.0+cu101
tornado 6.1
tqdm 4.51.0
traitlets 5.0.5
typed-ast 1.4.2
typing-extensions 3.7.4.3
ujson 4.0.2
unicodecsv 0.14.1
Unidecode 1.2.0
urllib3 1.26.5
watchdog 1.0.2
wcwidth 0.2.5
webencodings 0.5.1
Werkzeug 2.0.1
wheel 0.36.2
whichcraft 0.6.1
widgetsnbextension 3.5.1
wrapt 1.12.1
wurlitzer 2.1.0
xlrd 2.0.1
XlsxWriter 1.3.8
xlwt 1.3.0
xmltodict 0.12.0
yacs 0.1.8
yapf 0.31.0
zict 2.0.0
zipp 3.4.1
zope.event 4.5.0
zope.interface 5.3.0
Note: you may need to restart the kernel to use updated packages.
I have solved my issue by adding tf.compat.v1.enable_eager_execution() to import and it works fine
import tensorflow as tf
from tensorflow import keras
tf.compat.v1.enable_eager_execution()
import segmentation_models as sm
import glob
import cv2
import os
import numpy as np
from matplotlib import pyplot as plt
#import keras
from tensorflow.keras.utils import normalize
from tensorflow.keras.metrics import MeanIoU
For getting the list of installed libraries, I run the following command in Jupyter Notebook:
!pip list
and I get the following as output:
Package Version
---------------------------------- ---------
alabaster 0.7.12
altair 4.1.0
anaconda-client 1.7.2
anaconda-navigator 1.9.7
anaconda-project 0.8.3
asn1crypto 0.24.0
astroid 2.2.5
astropy 3.2.1
atomicwrites 1.3.0
attrs 20.3.0
alabaster 0.7.12
altair 4.1.0
anaconda-client 1.7.2
anaconda-navigator 1.9.7
anaconda-project 0.8.3
asn1crypto 0.24.0
astroid 2.2.5
astropy 3.2.1
atomicwrites 1.3.0
attrs 20.3.0
Automat 20.2.0
azureml 0.2.7
Babel 2.7.0
backcall 0.1.0
backports.functools-lru-cache 1.5
backports.os 0.1.1
backports.shutil-get-terminal-size 1.0.0
backports.tempfile 1.0
backports.weakref 1.0.post1
beautifulsoup4 4.7.1
bitarray 0.9.3
bkcharts 0.2
bleach 3.1.0
bokeh 1.2.0
boto 2.49.0
boto3 1.14.61
botocore 1.17.61
Bottleneck 1.2.1
branca 0.4.1
category-encoders 2.2.2
certifi 2019.6.16
cffi 1.12.3
chardet 3.0.4
Click 7.0
click-spinner 0.1.10
cloudpickle 1.2.1
clyent 1.2.2
colorama 0.4.1
colorlog 4.2.1
comtypes 1.1.7
conda 4.7.10
conda-build 3.18.8
conda-package-handling 1.3.11
conda-verify 3.4.2
configparser 5.0.1
constantly 15.1.0
contextlib2 0.5.5
coverage 5.3
coveralls 2.1.2
cryptography 2.7
cycler 0.10.0
Cython 0.29.14
cytoolz 0.10.0
dacite 1.5.1
dask 2.1.0
decorator 4.4.0
defusedxml 0.6.0
distributed 2.1.0
docopt 0.6.2
docutils 0.14
entrypoints 0.3
et-xmlfile 1.0.1
fastcache 1.1.0
feature-engine 0.6.1
filelock 3.0.12
Flask 1.1.1
flit-core 2.3.0
folium 0.11.0
furl 2.1.0
future 0.17.1
gensim 3.8.3
genson 1.2.2
gevent 1.4.0
glob2 0.7
greenlet 0.4.15
h5py 2.9.0
heapdict 1.0.0
html5lib 1.0.1
hyperlink 20.0.1
hypothesis 5.41.2
idna 2.8
imageio 2.5.0
imagesize 1.1.0
imbalanced-learn 0.7.0
importlib-metadata 0.17
incremental 17.5.0
ipykernel 5.1.1
ipython 7.6.1
ipython-genutils 0.2.0
ipywidgets 7.5.0
isort 4.3.21
itsdangerous 1.1.0
jdcal 1.4.1
jedi 0.13.3
Jinja2 2.11.2
jmespath 0.10.0
joblib 0.13.2
json5 0.8.4
jsonschema 3.2.0
jupyter 1.0.0
jupyter-client 5.3.1
jupyter-console 6.0.0
jupyter-core 4.5.0
jupyterlab 1.0.2
jupyterlab-server 1.0.0
keyring 18.0.0
kiwisolver 1.1.0
lazy-object-proxy 1.4.1
libarchive-c 2.8
llvmlite 0.29.0
locket 0.2.0
lxml 4.5.2
MarkupSafe 1.1.1
matplotlib 3.1.0
mccabe 0.6.1
menuinst 1.4.16
mistune 0.8.4
mkl-fft 1.0.12
mkl-random 1.0.2
mkl-service 2.0.2
mock 3.0.5
more-itertools 7.0.0
mpmath 1.1.0
msgpack 0.6.1
multipledispatch 0.6.0
munch 2.5.0
navigator-updater 0.2.1
nbconvert 5.6.1
nbformat 4.4.0
networkx 2.3
nibabel 3.1.1
nltk 3.4.4
nose 1.3.7
notebook 6.0.0
numba 0.44.1
numexpr 2.6.9
numpy 1.19.2
numpydoc 0.9.1
olefile 0.46
openpyxl 2.6.2
orderedmultidict 1.0.1
packaging 20.4
pandas 1.1.3
pandocfilters 1.4.2
parso 0.5.0
partd 1.0.0
path.py 12.0.1
pathlib2 2.3.4
patsy 0.5.1
pep517 0.8.2
pep8 1.7.1
pickleshare 0.7.5
Pillow 6.1.0
pip 20.2.4
pkginfo 1.5.0.1
plotly 4.9.0
pluggy 0.12.0
ply 3.11
pmdarima 1.7.1
prometheus-client 0.7.1
prompt-toolkit 2.0.9
psutil 5.6.3
psycopg2 2.8.6
py 1.8.0
pycodestyle 2.5.0
pycosat 0.6.3
pycparser 2.19
pycrypto 2.6.1
pycurl 7.43.0.3
pyflakes 2.1.1
Pygments 2.4.2
PyHamcrest 2.0.2
pylint 2.3.1
pyodbc 4.0.26
pyOpenSSL 19.0.0
pyparsing 2.4.0
pyreadline 2.1
pyrsistent 0.14.11
PySocks 1.7.0
pytest 5.0.1
pytest-arraydiff 0.3
pytest-astropy 0.5.0
pytest-cov 2.10.1
pytest-doctestplus 0.3.0
pytest-openfiles 0.3.2
pytest-remotedata 0.3.1
python-dateutil 2.8.0
pytoml 0.1.21
pytz 2019.1
PyWavelets 1.0.3
pywin32 223
pywinpty 0.5.5
PyYAML 5.3.1
pyzmq 18.0.0
QtAwesome 0.5.7
qtconsole 4.5.1
QtPy 1.8.0
requests 2.22.0
requests-toolbelt 0.9.1
retrying 1.3.3
rope 0.14.0
ruamel-yaml 0.15.46
ruamel.yaml 0.16.12
ruamel.yaml.clib 0.2.2
s3transfer 0.3.3
scikit-image 0.15.0
scikit-learn 0.23.2
scipy 1.5.3
seaborn 0.10.1
Send2Trash 1.5.0
setuptools 41.0.1
simplegeneric 0.8.1
simplejson 3.17.2
singledispatch 3.4.0.3
six 1.12.0
sklearn 0.0
smart-open 2.1.1
snowballstemmer 1.9.0
sortedcollections 1.1.2
sortedcontainers 2.1.0
soupsieve 1.8
Sphinx 2.1.2
sphinxcontrib-applehelp 1.0.1
sphinxcontrib-devhelp 1.0.1
sphinxcontrib-htmlhelp 1.0.2
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.2
sphinxcontrib-serializinghtml 1.1.3
sphinxcontrib-websupport 1.1.2
spyder 3.3.6
spyder-kernels 0.5.1
SQLAlchemy 1.3.5
statsmodels 0.11.1
stumpy 1.5.0
sympy 1.4
tables 3.5.2
tabpy 2.3.1
tabulate 0.8.7
tblib 1.4.0
terminado 0.8.2
testpath 0.4.2
textblob 0.15.3
threadpoolctl 2.1.0
toml 0.10.1
toolz 0.10.0
tornado 6.0.3
tqdm 4.32.1
traitlets 4.3.2
Twisted 20.3.0
unicodecsv 0.14.1
urllib3 1.24.2
validators 0.16.0
wcwidth 0.1.7
webencodings 0.5.1
Werkzeug 0.15.4
wheel 0.33.4
widgetsnbextension 3.5.0
win-inet-pton 1.1.0
win-unicode-console 0.5
wincertstore 0.2
wrapt 1.11.2
xlrd 1.2.0
XlsxWriter 1.1.8
xlwings 0.15.8
xlwt 1.3.0
zict 1.0.0
zipp 0.5.1
zope.interface 5.2.0
How to store this result into a Pandas Dataframe? Just copying the data and pasting in two lists would do the job, but is there any code-based alternative to achieve this? In short, how to store the result of pip command into a Pandas Dataframe?
P.S: I referred here but was not of any help.
We can use os module to create the pip list, then we use pandas.read_csv with \s+ as seperator to read the pip list into a dataframe:
import os
import pandas as pd
# create pip list txt
os.system('pip list > pip_list.txt')
# read content into pandas df
df = pd.read_csv('pip_list.txt', sep=r'\s+', skiprows=[1])
# clean up
os.remove('pip_list.txt')
Package Version
0 appnope 0.1.0
1 argon2-cffi 20.1.0
2 astroid 2.4.2
3 async-generator 1.10
4 attrs 20.2.0
.. ... ...
100 urllib3 1.25.10
101 wcwidth 0.2.5
102 webencodings 0.5.1
103 wrapt 1.12.1
104 xlrd 1.2.0
[105 rows x 2 columns]
You can use subprocess to get the result in memory instead of creating a new file.
import subprocess
from io import StringIO
command = "pip list"
process = subprocess.Popen(command.split(), stdout=subprocess.PIPE)
output, error = process.communicate()
pd.read_csv(StringIO(output.decode("utf-8")), sep=r"\s*", skiprows=[1])
I wanted to get Outlook calendar data but the module is not recognized, constantly giving the following error:
ModuleNotFoundError: No module named 'O365'
Right from the first line (from O365 import Account) I can't get through.
After that, I've tried other packages but Visual Code Studio doesn't recognize any of them.
I installed all the packages and modules (after py -m pip list):
Package Version
---------------------------------- -------------------
alabaster 0.7.12
anaconda-client 1.7.2
anaconda-navigator 1.9.12
anaconda-project 0.8.3
argh 0.26.2
asn1crypto 1.3.0
astroid 2.4.2
astropy 4.0.1.post1
atomicwrites 1.4.0
attrs 19.3.0
autopep8 1.5.3
Babel 2.8.0
backcall 0.2.0
backports.functools-lru-cache 1.6.1
backports.shutil-get-terminal-size 1.0.0
backports.tempfile 1.0
backports.weakref 1.0.post1
bcrypt 3.1.7
beautifulsoup4 4.9.1
bitarray 1.4.0
bkcharts 0.2
bleach 3.1.5
bokeh 2.1.1
boto 2.49.0
Bottleneck 1.3.2
brotlipy 0.7.0
certifi 2020.6.20
cffi 1.14.0
chardet 3.0.4
click 7.1.2
cloudpickle 1.5.0
clyent 1.2.2
colorama 0.4.3
comtypes 1.1.7
conda 4.8.3
conda-build 3.18.11
conda-package-handling 1.7.0
conda-verify 3.4.2
contextlib2 0.6.0.post1
cryptography 2.9.2
cycler 0.10.0
Cython 0.29.21
cytoolz 0.10.1
dask 2.20.0
decorator 4.4.2
defusedxml 0.6.0
diff-match-patch 20200713
distributed 2.20.0
docutils 0.16
entrypoints 0.3
et-xmlfile 1.0.1
fastcache 1.1.0
filelock 3.0.12
flake8 3.8.3
Flask 1.1.2
fsspec 0.7.4
future 0.18.2
gevent 20.6.2
glob2 0.7
gmpy2 2.0.8
greenlet 0.4.16
h5py 2.10.0
HeapDict 1.0.1
html5lib 1.1
idna 2.10
imageio 2.9.0
imagesize 1.2.0
importlib-metadata 1.7.0
intervaltree 3.0.2
ipykernel 5.3.2
ipython 7.16.1
ipython-genutils 0.2.0
ipywidgets 7.5.1
isort 5.5.2
itsdangerous 1.1.0
jdcal 1.4.1
jedi 0.17.1
Jinja2 2.11.2
joblib 0.16.0
json5 0.9.5
jsonschema 3.2.0
jupyter 1.0.0
jupyter-client 6.1.6
jupyter-console 6.1.0
jupyter-core 4.6.3
jupyterlab 2.1.5
jupyterlab-server 1.2.0
keyring 21.2.1
kiwisolver 1.2.0
lazy-object-proxy 1.4.3
libarchive-c 2.9
llvmlite 0.33.0+1.g022ab0f
locket 0.2.0
lxml 4.5.2
MarkupSafe 1.1.1
matplotlib 3.2.2
mccabe 0.6.1
menuinst 1.4.16
mistune 0.8.4
mkl-fft 1.1.0
mkl-random 1.1.1
mkl-service 2.3.0
mock 4.0.2
more-itertools 8.4.0
mpmath 1.1.0
msgpack 1.0.0
multipledispatch 0.6.0
navigator-updater 0.2.1
nbconvert 5.6.1
nbformat 5.0.7
networkx 2.4
nltk 3.5
nose 1.3.7
notebook 6.0.3
numba 0.50.1
numexpr 2.7.1
numpy 1.18.5
numpydoc 1.1.0
O365 2.0.11
oauthlib 3.1.0
olefile 0.46
openpyxl 3.0.4
packaging 20.4
pandas 1.0.5
pandocfilters 1.4.2
paramiko 2.7.1
parso 0.7.0
partd 1.1.0
path 13.1.0
pathlib2 2.3.5
pathtools 0.1.2
patsy 0.5.1
pep8 1.7.1
pexpect 4.8.0
pickleshare 0.7.5
Pillow 7.2.0
pip 20.1.1
pkginfo 1.5.0.1
pluggy 0.13.1
ply 3.11
prometheus-client 0.8.0
prompt-toolkit 3.0.5
psutil 5.7.0
py 1.9.0
pycodestyle 2.6.0
pycosat 0.6.3
pycparser 2.20
pycurl 7.43.0.5
pydocstyle 5.0.2
pyflakes 2.2.0
Pygments 2.6.1
pylint 2.6.0
PyNaCl 1.4.0
pyodbc 4.0.0-unsupported
pyOpenSSL 19.1.0
pyparsing 2.4.7
pyreadline 2.1
pyrsistent 0.16.0
PySocks 1.7.1
pytest 5.4.3
python-dateutil 2.8.1
python-jsonrpc-server 0.3.4
python-language-server 0.34.1
pytz 2020.1
PyWavelets 1.1.1
pywin32 227
pywin32-ctypes 0.2.0
pywinpty 0.5.7
PyYAML 5.3.1
pyzmq 19.0.1
QDarkStyle 2.8.1
QtAwesome 0.7.2
qtconsole 4.7.5
QtPy 1.9.0
regex 2020.6.8
requests 2.24.0
requests-oauthlib 1.3.0
rope 0.17.0
Rtree 0.9.4
ruamel-yaml 0.15.87
scikit-image 0.16.2
scikit-learn 0.23.1
scipy 1.5.0
seaborn 0.10.1
Send2Trash 1.5.0
setuptools 49.2.0.post20200714
simplegeneric 0.8.1
singledispatch 3.4.0.3
sip 4.19.13
six 1.15.0
snowballstemmer 2.0.0
sortedcollections 1.2.1
sortedcontainers 2.2.2
soupsieve 2.0.1
Sphinx 3.1.2
sphinxcontrib-applehelp 1.0.2
sphinxcontrib-devhelp 1.0.2
sphinxcontrib-htmlhelp 1.0.3
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-qthelp 1.0.3
sphinxcontrib-serializinghtml 1.1.4
sphinxcontrib-websupport 1.2.3
spyder 4.1.4
spyder-kernels 1.9.2
SQLAlchemy 1.3.18
statsmodels 0.11.1
stringcase 1.2.0
sympy 1.6.1
tables 3.6.1
tblib 1.6.0
terminado 0.8.3
testpath 0.4.4
threadpoolctl 2.1.0
toml 0.10.1
toolz 0.10.0
tornado 6.0.4
tqdm 4.47.0
traitlets 4.3.3
typing-extensions 3.7.4.2
tzlocal 2.1
ujson 1.35
unicodecsv 0.14.1
urllib3 1.25.9
watchdog 0.10.3
wcwidth 0.2.5
webencodings 0.5.1
Werkzeug 1.0.1
wheel 0.34.2
widgetsnbextension 3.5.1
win-inet-pton 1.1.0
win-unicode-console 0.5
wincertstore 0.2
wrapt 1.12.1
xlrd 1.2.0
XlsxWriter 1.2.9
xlwings 0.19.5
xlwt 1.3.0
xmltodict 0.12.0
yapf 0.30.0
zict 2.0.0
zipp 3.1.0
zope.event 4.4
zope.interface 4.7.1
As seen above, the O365 module is also there.
UPDATE:
After changing interpreter, the problem above is solved but now we encountered another one:
ImportError: cannot import name 'Account' from partially initialized module 'O365' (most likely due to a circular import)
I'd appreciate any help, thanks!
You might want to check if the version of Python Visual Studio Code uses is the version on which you have installed O365
You can change your python interpreter by opening the command palate f1 and type Python: Select Interpreter
Answer to the updated question:
It says you have most likely a circular import.
O365 depends on the following packages:
requests
requests-oauthlib
beatifulsoup4
stringcase
python-dateutil
tzlocal
pytz
If you have any import statements using one of the packages above, deleting the import statement might fix your error.