Develop Reference

How to install h5py (needed for Keras) on MacOS with M1?

I have an M1 MacBook. I have installed python 3.9.1 using pyenv, and have pip3 version 21.0.1.
I have installed homebrew and hdf5 1.12.0_1 via brew install hdf5.
When I type
pip3 install h5py
I get the error:
Requirement already satisfied: numpy>=1.19.3 in /Users/.../.pyenv/versions/3.9.1/lib/python3.9/site-packages (from h5py) (1.20.0)
Building wheels for collected packages: h5py
Building wheel for h5py (PEP 517) ... error
Loading library to get build settings and version: libhdf5.dylib
error: Unable to load dependency HDF5, make sure HDF5 is installed properly
error: dlopen(libhdf5.dylib, 6): image not found
----------------------------------------
ERROR: Failed building wheel for h5py
I saw that libhdf5.dylib is present in /opt/homebrew/opt/hdf5/lib, so I tried export LDFLAGS="-L/opt/homebrew/opt/hdf5/lib" and export CPPFLAGS="-L/opt/homebrew/opt/hdf5/include" beforehand but they don't help.
How can I install h5py?
I am actually installing h5py as a requirement to install Keras.
Thanks!

This works for me:
$ brew install hdf5
$ export HDF5_DIR="$(brew --prefix hdf5)"
$ pip install --no-binary=h5py h5py

Try to install h5py using conda. Works for me.
conda install h5py

downgrading pip package in virtualenv

I set up a virtualenv and am trying to install a package where I get the error:
error: chardet 4.0.0 is installed but chardet<4.0,>=2.0 is required by {'aiohttp'}
Thus I tried to downgrade:
$ pip3 install --upgrade chardet==3.0.0
Collecting chardet==3.0.0
Using cached chardet-3.0.0-py2.py3-none-any.whl (133 kB)
Installing collected packages: chardet
Attempting uninstall: chardet
Found existing installation: chardet 4.0.0
Uninstalling chardet-4.0.0:
Successfully uninstalled chardet-4.0.0
Successfully installed chardet-3.0.0
Still when I try to install my package I get:
error: chardet 4.0.0 is installed but chardet<4.0,>=2.0 is required by {'aiohttp'}
I also tried to first uninstall the existing version:
pip3 uninstall chardet
But I still receive the error:
error: chardet 4.0.0 is installed but chardet<4.0,>=2.0 is required by {'aiohttp'}
Executing these steps I would expect chardet to downgrade to version 3.0.0 and my package to install. Is there a different way to do this without touching my packages outside of the venv?
Pipdeptree output:
$ pipdeptree
pipdeptree==2.0.0
- pip [required: >=6.0.0, installed: 21.0.1]
pkg-resources==0.0.0
setuptools==53.0.0
wheel==0.36.2
Edit:
downgrading indeed worked as expected. I got the error because the package I tried to install required sudo rights and thus by executing it as sudo I left the virtual environment. Downgrading the package globally let me install the package although I wanted to avoid this.

Try using pipdeptree, it displays installed packages as a dependency tree, there you can find a bug in chardet with different versions specified.

How to deal with ERROR while using pip to install tensorflow

I am trying to install tensorflow in python using pip command as
pip install --upgrade --ignore-installed tensorflow
and received the error message as
ERROR: spyder 3.3.6 requires pyqt5<5.13; python_version >= "3", which is not installed.
ERROR: spyder 3.3.6 requires pyqtwebengine<5.13; python_version >= "3", which is not installed.
ERROR: astroid 2.3.1 requires typed-ast<1.5,>=1.4.0; implementation_name == "cpython" and python_version < "3.8", which is not installed.
ERROR: astroid 2.3.1 has requirement six==1.12, but you'll have six 1.15.0 which is incompatible.
ERROR: astroid 2.3.1 has requirement wrapt==1.11.*, but you'll have wrapt 1.12.1 which is incompatible.
So how can I manage to install them?

do you already have a version of tensorflow installed? Assuming that you´re using the --ignore-installed option here....
This obviously keeps tensorflow from installing the required dependencies. Try without --ignore-installed (it will overwrite existing installations and hopefully update all requirements)

dependency conflict, featexp 0.0.5 has requirement numpy==1.15.4, pydeck 0.3.0b2 has requirement numpy>=1.16.4

pip version: pip 20.0.2
Python version: Python 3.6.5 Anaconda
OS: Mac OS X 10.14.5
$ pip check
featexp 0.0.5 has requirement numpy==1.15.4, but you have numpy 1.18.2.
Then, I change the version of numpy:
$ pip install numpy==1.15.4
Collecting numpy==1.15.4
Using cached numpy-1.15.4-cp36-cp36m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl (24.5 MB)
ERROR: pydeck 0.3.0b2 has requirement numpy>=1.16.4, but you'll have numpy 1.15.4 which is incompatible.
Installing collected packages: numpy
Attempting uninstall: numpy
Found existing installation: numpy 1.18.2
Uninstalling numpy-1.18.2:
Successfully uninstalled numpy-1.18.2
Successfully installed numpy-1.15.4
But, pydeck 0.3.0b2 has requirement numpy>=1.16.4.
I'm stuck.

Getting below error while executing "pip install -r requirements.txt" command

I am a beginner and working on a Chatbot project using RASA framework. When I try to install RASA using "pip install rasa" commands or dependencies inside requirement.txt [snap attached] using "pip install -r requirements.txt",I'm getting below error.
In order to resolve the issue I changed concern dependencies version in Requirement.txt but even that couldn't help me out.
For instance in below case, per logs there is requirement of "fbmessenger~=6.0" instead of Version 5.0.0 (existing one).
ERROR: rasa 1.3.9 has requirement fbmessenger~=6.0, but you'll have fbmessenger 5.0.0 which is incompatible.
If I change the version 5.0 to 6.0 in requirement.txt file and run command then it will again throw error with now requirement of 5.0 version. like
ERROR: rasa 1.2 has requirement fbmessenger~=5.0, but you'll have fbmessenger 6.0.0 which is incompatible.
Error Trace :--
ERROR: tensorflow 1.14.0 has requirement wrapt>=1.11.1, but you'll have wrapt 1.10.0 which is incompatible.
ERROR: rasa 1.3.9 has requirement fbmessenger~=6.0, but you'll have fbmessenger 5.0.0 which is incompatible.
ERROR: rasa 1.3.9 has requirement matplotlib~=3.0, but you'll have matplotlib 2.0.0 which is incompatible.
ERROR: rasa 1.3.9 has requirement packaging~=19.0, but you'll have packaging 18.0 which is incompatible.
ERROR: rasa 1.3.9 has requirement pika~=1.0.0, but you'll have pika 0.12.0 which is incompatible.
ERROR: rasa 1.3.9 has requirement python-socketio>=4.3.1, but you'll have python-socketio 3.0.0 which is incompatible.
ERROR: rasa 1.3.9 has requirement pytz~=2019.1, but you'll have pytz 2018.9 which is incompatible.
ERROR: rasa 1.3.9 has requirement redis~=3.3.5, but you'll have redis 2.0.0 which is incompatible.
ERROR: rasa-x 0.21.4 has requirement pika~=1.0.0, but you'll have pika 0.12.0 which is incompatible.
ERROR: rasa-x 0.21.4 has requirement requests~=2.22, but you'll have requests 2.21.0 which is incompatible.
ERROR: rasa-sdk 1.3.3 has requirement ConfigArgParse~=0.14, but you'll have configargparse 0.13.0 which is incompatible.
ERROR: rasa-core 0.13.8 has requirement tensorflow~=1.12.0, but you'll have tensorflow 1.14.0 which is incompatible.
ERROR: gym 0.15.3 has requirement cloudpickle~=1.2.0, but you'll have cloudpickle 0.6.1 which is incompatible.
Requirement.txt Content :-
gspread==3.0.0
beautifulsoup4~=4.6.3
requests~=2.21.0
geopy~=1.18.1
pandas~=0.24.1
rasa==1.3.9
future==0.17.1
fakeredis==0.10.1
keras-applications==1.0.6
keras-preprocessing==1.0.5
dill==0.2.9
tensorflow==1.14.0
wrapt==1.10.0
fbmessenger==5.0
matplotlib==2.0
packaging==18.0
pika==0.12.0
pyhton-socketio==3.0
pytz==2018.9
redis==2.0
ConfigArgParse==0.13
cloudpickle==0.6.1
mailchimp3==3.0.2
oauth2client==4.1.2
Other Details :--
OS-Window 10
Python - 3.6.0
pip -19.3
VS Code - 1.39

This occurs when you try to install a older version which is incompatible with new ones. Rather than having all the document i suggest that you can install the latest version of those packages manually.
However most of those packages comes with rasa. You can just install them with:
pip install rasa
If you have some libaries other than those coming with rasa just install them with "pip install (package_name)"

I feel you are trying to install rasa-x in an already existing virtual environment(venv).
Please create a new venv folder and then fire the below command and everything will work fine.
pip install rasa-x --extra-index-url https://pypi.rasa.com/simple
Earlier someone must have installed rasa-x. The earlier version had different versions of dependencies and in between rasa-x got upgraded along with its dependency versions. Now when you are trying to reinstall it, you are facing conflicts.
If you have a specific version of rasa-x, say 0.21.4, in your mind then you can install it in a new venv as follows:
pip install rasa-x==0.21.4 --extra-index-url https://pypi.rasa.com/simple
I have just appended the version number to the package name.