Extra Packages¶

Here’s the list of all the extra dependencies of AIFlow.

Database Extras¶

Those are extras that are needed when using specific database as backend.

extra	install command	description
mysql	pip install ‘ai-flow-nightly[mysql]’	MySQL as metadata backend
mongo	pip install ‘ai-flow-nightly[mongo]’	MongoDB as metadata backend

Those are extras that are needed when using specific blob managers.

extra	install command	description
hdfs	pip install ‘ai-flow-nightly[hdfs]’	HDFS as blob manager
oss	pip install ‘ai-flow-nightly[oss]’	OSS as blob manager
s3	pip install ‘ai-flow-nightly[s3]’	S3 as blob manager

Those are extras that add dependencies needed for integration with specific job plugins.

extra	install command	description
flink	pip install ‘ai-flow-nightly[flink]’	Flink job plugin

Those are extras for scheduler(only apache-airflow for now).

extra	install command	description
celery	pip install ‘ai-flow-nightly[celery]’	Celery as the executor of apache-airflow

Those are extras that install one ore more extras as a bundle.

extra	install command	description
example_requires	pip install ‘ai-flow-nightly[example_requires]’	Should be installed when running provided AIFlow examples
devel	pip install ‘ai-flow-nightly[devel]’	Minimum development dependencies, including flake8, pytest, coverage, etc.
test	pip install ‘ai-flow-nightly[test]’	Should be installed when you are running unittests of AIFlow
docker	pip install ‘ai-flow-nightly[docker]’	Dependencies for docker compose