Installing 3rd party python libraries for QGIS on Windows

Numpy is installed by default in QGIS (Standalone version, OSGeo4W version). For rasterio, there are many problems. I know that rasterio is powerful and easy to use (I use it) but why rasterio in a QGIS plugin while you have all the functions of PyQGIS ? (it was designed for the Python shell or for scripts, not to be used with QGIS/PyQGIS, as Fiona for the shapefiles)

In Linux or Mac OS X (Unix systems), QGIS uses the standard Python installation (independent of QGIS) and if is easy to install or upgrade a Python module (there are also many compilers installed by default)

In Windows, Python is not installed by default, and QGIS installs his own version. To install pure Python modules (without C, C++ libraries) you have solutions (QGIS Standalone and the Python Modules, Installing Python setuptools into OSGeo4W Python or Installing PySAL for OSGeo4W)

But for modules that needs to be compiled (no compiler by default), it is not easy. You can try to copy/paste your installed module in the QGIS Python site_folder but there are problems.

Rasterio need to be compiled against an installed GDAL library and if you install it from Christoph Gohlke Unofficial Windows Binaries for Python Extension Packages, for example, I am not sure that the version of GDAL used by QGIS is the same (for the references to the dll libraries)

If you use exclusively numpy and rasterio, why not an independent script ?

From within the Qgis 2.18.28 's python 2.7.14 console, this works for me. It avoids having to use prompts with absolute python paths.

import subprocess
subprocess.check_call(['python', '-m', 'pip', 'install', 'openpyxl'])

According to pip developers, pip.main or pip._internal.main are not supported. https://pip.pypa.io/en/stable/user_guide/#using-pip-from-your-program I modified the recommended sys.executable to 'python', because in Qgis it is qgis itself.

You can put 3rd party lib into your plugin folder and then add it to the path with the following script in plugin_name__init__.py:

import sys, os
sys.path.insert(0, str(os.path.join(os.path.dirname(os.path.realpath(__file__)), ''))+'lib_dir')

The simple way I found to install libraries for Python in QGIS is

1. Open OSGeo4W Shell as an administrator

2. Type py3_env in the console (This should print paths of your QGIS Python installation)

3. Type python -m pip install {your library}

and its done.

The most efficient way to do this is with conda. This will work for both Windows and MacOS.

First install Miniconda/Anaconda if you do not already have conda installed in your system.

Then create a new environment, by typing the following in Anaconda Prompt for Windows machines or terminal in Mac:

$conda create -n <your_env>

then install QGIS with:

$conda install -c conda-forge qgis

Then to run QGIS:

$conda activate <your_env>
$qgis

To install third party packages, first quit QGIS and type the following in the activated env:

$conda install -c conda-forge rasterio 
$conda install -c anaconda numpy

Remember to activate your environment before installing your packages. after activation pip install should also work.