In general I've transitioned to using anaconda (instead of macports) for managing my python packages -- this has been working great. There are a couple of packages that I want to build directly from source, however (in particular scipy). Are there any special considerations / procedures to take into account so that they'll play nicely together? Do I need to uninstall the anaconda scipy first?
The best would be to build your own conda package. It is pretty simple:
conda install conda-build
conda skeleton pypi mypackage assuming there is a package mypackage on pypi
conda build mypackage
conda install --use-local mypackage
Now, you will get all the benefits of conda.
Related
I started to write my own python package and want to install this in my virtual conda environment. Now, I'm a little bit confused about the possibilities to do this.
In general, during my search I found these two commands to install my package:
pip install -e <my_package>
conda-develop .
Using the first method leads to the desired result and my package is listed, if conda list has been called (although the package is still not visible in the anaconda navigator, but anyway).
In contrast to this the second method only returned "completed operation for: <path_to_my_package>", but didn't install the packe in my environment.
Does anyone know what this could be or what I am doing wrong? As far as I know, there is also the possibility to create packages directly in conda. Is there any advantage for, if it's only a private package for me?
Thank's a lot in advance.
I think here is the case. When you have a conda environment set up. The packages in the conda will be considered as global package. So, if a package is installed in your conda environment and you choose the conda interpreter in your vent environment, that package will be available. And based on your question, what you want is to be able to install a package that is only available in this vent environment. In this case, you can use terminal to go to your project path. And then use the normal pip install , in this way that package will be in the vent environment only.
Issues may arise when using pip and conda together. When combining
conda and pip, it is best to use an isolated conda environment. Only
after conda has been used to install as many packages as possible
should pip be used to install any remaining software. If modifications
are needed to the environment, it is best to create a new environment
rather than running conda after pip. When appropriate, conda and pip
requirements should be stored in text files.
Use pip only after conda Install as many requirements as possible with
conda then use pip.
Pip should be run with --upgrade-strategy only-if-needed (the
default).
Do not use pip with the --user argument, avoid all users installs.
And here is the official guild about using conda with pip.
I am trying to use Python to do some forecasting on 1 year wind speed, one of the method is fbprophet. After sometime browsing I found out that I need to istall it with Conda Forge.
I am completely new in this, but it seems by changing channel I need to instal some packages(panda, numpy) again using Conda forge.
One of the missing pakcage is tbats, unfortunately I could not find a way to install it with COnda-forge, only the usual pip install tbats
Is there a way I could use both tbats and fbprophet at python together?
Yes you can use both packages, conda environment can install packages using either conda install or pip install. In this case, after you install prophet just install TBATS using pip install tbats
The general recommendation is to use the same package manager (pip or conda) for all the packages. But in cases where the package is unavailable on conda, you can use pip to install the specific package alone.
Further, it is advisable to do all this within virtual envs so that even if any inconsistencies arise, it stays within the virtual env. More info on creating envs using conda can be found here.
I've been developing my project with pip (django, drm etc). Now I need to use faiss, which only has unofficial package on pip (official - in conda). What should I do in this situation?
Can I combine them somehow? Or should I migrate to conda?
If you're using a non-conda environment, then you're limited to using pip only. That is, pip does not know how to install conda packages.
But if you switch to using conda, then you can use either. The general recommendation is to install everything with conda if possible, but use pip when you have no other choice.
I recommend installing Miniconda, then creating a new environment for all of your dependencies. If necessary, add pip-only dependencies (if you have any).
conda create --name alex python=3.8 pip django requests bla-bla-bla
conda activate alex
pip install drm foo bar yada-yada
If you need uncommon or bleeding-edge packages, you might also consider obtaining your conda packages from the conda-forge channel, rather than the defaults channel. See here for instructions.
The environment I'm in requires anaconda, but I need some PyPI packages, so I'm trying to use anaconda's conda skeleton pypi functionality to make anaconda recipes and install them automatically. However, this seems to fail whenever the PyPI package name contains a capital letter, e.g., Logbook and Represent. Is there a way to make anaconda handle this gracefully, without manually creating recipes for each offending package?
once you are in your conda environment you can use pip to install PyPi packages, using:
pip install package
you may need to conda install pip first.
So, for Represent it is pip install represent
I want to use the wolframclient Python package in Mathematica. The docs suggest using pip install wolframclient.
However, my main Python installation is within conda, so I do not want to use pip, but instead a standard conda install wolframclient. (The problem with using pip is that the added package's dependencies may interfere with what conda has already installed and knows about.)
The wolframclient package is at https://pypi.org/project/wolframclient/. But by default conda does not know about pypi.org. I tried the command conda config --add channels pipy, but conda install wolframclient says the channel is "not accessible or is invalid".
I think the problem is that the files at https://pypi.org/project/wolframclient/ are not already in the form of a conda package.
How might one proceed?
I think the problem is that the files at https://pypi.org/project/wolframclient/ are not already in the form of a conda package.
Yes, very precisely noted. Conda packages contain information about how to built in different format than pypi packages, which are made for pip.
In the case you describe, you ahve several options:
Create a seperate environment for wolframclient and use pip install wolframclient in there. Yes, pip and conda do not always get along, but by creating a virtual environment you have no risk of breaking other stuff and pip will be happy installing wolframclient for you
Check the wolframclient package on pypi and install the dependencies using conda before installing wolframclient with pip which might minimize the risk of having to many packages downloaded by pip
Download the source code of wolframclient and built it into a local conda package using conda build and this guide and then use conda install to install the locally built package
I have created a conda build of wolframclient (current version: 1.1.4).