磚運行時5.5 Conda(β)
請注意
這個版本是不再可用。如果你想使用Conda來管理Python庫和環境,使用支持版本機器學習的磚運行時。
我們很高興能引進磚運行時5.5 Conda(β),它允許您利用Conda管理Python庫和環境。這個運行時提供了兩根Conda環境選擇在創建集群:
磚的標準環境包括許多流行的Python包的更新版本。這個環境是作為現有筆記本電腦上運行的替代數據磚運行時。這是默認磚Conda-based運行時環境。
磚最小環境包含所需的最低數量的包PySpark和磚Python筆記本的功能。這個環境是理想的,如果你想自定義運行時各種Python包。
包括支持數據磚庫工具(dbutils.library)。
請注意
Scala、Java和R在磚5.5運行時庫Conda磚運行時的5.5是相同的。詳情,請參閱磚運行時5.5 LTS(不支持)發行說明。信息如何使用磚和Conda運行時,看到的磚與Conda運行時。
新功能
提供了一個新的notebook-scoped庫API支持更新筆記本Conda環境與YAML規範Conda文檔)。
dbutils。圖書館。updateCondaEnv(“envYmlContent”)
例如,更新numpy 1.16.4庫,調用如下:
dbutils。圖書館。updateCondaEnv(”““渠道:違約依賴關係:- numpy = 1.16.4”“”)
請注意
你可以得到詳細信息updateCondaEnv使用dbutils.library.help (“updateCondaEnv”)。
改進
包裝標準和最小的環境更新到新版本。看到庫包版本的完整列表。這裏有一些關鍵包更新:
從3.7.0 Python 3.7.3,更新
從6.5.0 IPython 7.4.0,更新
從10.0.1 pip 19.0.3,更新
改善環境隔離筆記本,處理隔離和啟用ADLS透傳。
允許你使用安裝包
conda安裝而不需要通過容易被忘記可能是國旗,always_yes現在Conda配置選項設置真正的在.condarc。
庫
以下是出口environment.yml文件默認根與Conda磚5.5運行時的環境。
磚的標準
的名字:databricks-standard渠道:- - - - - -違約依賴關係:- - - - - -asn1crypto = 0.24.0 = py37_0- - - - - -backcall = 0.1.0 = py37_0- - - - - -布拉斯特區= 1.0 = openblas- - - - - -寶途= 2.49.0 = py37_0- - - - - -boto3 = 1.9.162 = py_0- - - - - -botocore = 1.12.163 = py_0- - - - - -ca證書= 2019.1.23 = 0- - - - - -certifi = 2019.3.9 = py37_0- - - - - -cffi = 1.12.2 = py37h2e261b9_1- - - - - -chardet = 3.0.4 = py37_1- - - - - -密碼= 2.6.1 = py37h1ba5d50_0- - - - - -cython = 0.29.6 = py37he6710b0_0- - - - - -decorator = 4.4.0 = py37_1- - - - - -docutils = 0.14 = py37_0- - - - - -idna = 2.8 = py37_0- - - - - -ipython = 7.4.0 = py37h39e3cac_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -絕地= 0.13.3 = py37_0- - - - - -jmespath = 0.9.4 = py_0- - - - - -krb5 = 1.16.1 = h173b8e3_7- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 8.2.0 = hdf63c60_1- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libopenblas = 0.3.6 = h5a2b251_0- - - - - -libpq = 11.2 = h20c2e04_0- - - - - -libstdcxx-ng = 8.2.0 = hdf63c60_1- - - - - -ncurses = 6.1 = he6710b0_1- - - - - -nomkl = 3.0 = 0- - - - - -numpy = 1.16.2 = py37h99e49ec_0- - - - - -numpy-base = 1.16.2 = py37h2f8d375_0- - - - - -openssl = 1.1.1b = h7b6447c_1- - - - - -熊貓= 0.24.2 = py37he6710b0_0- - - - - -parso = 0.3.4 = py37_0- - - - - -容易受騙的人= 0.5.1 = py37_0- - - - - -pexpect = 4.6.0 = py37_0- - - - - -pickleshare = 0.7.5 = py37_0- - - - - -皮普= 19.0.3 = py37_0- - - - - -prompt_toolkit = 2.0.9 = py37_0- - - - - -psycopg2 = 2.7.6.1 = py37h1ba5d50_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -pycparser = 2.19 = py37_0- - - - - -pygments = 2.3.1 = py37_0- - - - - -pyopenssl = 19.0.0 = py37_0- - - - - -pysocks = 1.6.8 = py37_0- - - - - -python = 3.7.3 = h0371630_0- - - - - -python-dateutil = 2.8.0 = py37_0- - - - - -pytz = 2018.9 = py37_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -= 2.21.0 = py37_0請求- - - - - -s3transfer = 0.2.0 = py37_0- - - - - -scikit-learn = 0.20.3 = py37h22eb022_0- - - - - -scipy = 1.2.1 = py37he2b7bc3_0- - - - - -setuptools = 40.8.0 = py37_0- - - - - -6 = 1.12.0 = py37_0- - - - - -sqlite = 3.27.2 = h7b6447c_0- - - - - -statsmodels = 0.9.0 = py37h035aef0_0- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -traitlets = 4.3.2 = py37_0- - - - - -urllib3 = 1.24.1 = py37_0- - - - - -wcwidth = 0.1.7 = py37_0- - - - - -輪= 0.33.1 = py37_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -皮普:- - - - - -周期計= = 0.10.0- - - - - -kiwisolver = = 1.1.0- - - - - -matplotlib = = 3.0.3- - - - - -pyarrow = = 0.12.0- - - - - -pyparsing = =測試盒框- - - - - -seaborn = = 0.9.0前綴:/磚/ conda / env / databricks-standard
磚最小
的名字:databricks-minimal渠道:- - - - - -違約依賴關係:- - - - - -backcall = 0.1.0 = py37_0- - - - - -布拉斯特區= 1.0 = openblas- - - - - -ca證書= 2019.1.23 = 0- - - - - -certifi = 2019.3.9 = py37_0- - - - - -decorator = 4.4.0 = py37_1- - - - - -ipython = 7.4.0 = py37h39e3cac_0- - - - - -ipython_genutils = 0.2.0 = py37_0- - - - - -絕地= 0.13.3 = py37_0- - - - - -libedit = 3.1.20181209 = hc058e9b_0- - - - - -libffi = 3.2.1 = hd88cf55_4- - - - - -libgcc-ng = 8.2.0 = hdf63c60_1- - - - - -libgfortran-ng = 7.3.0 = hdf63c60_0- - - - - -libopenblas = 0.3.6 = h5a2b251_0- - - - - -libstdcxx-ng = 8.2.0 = hdf63c60_1- - - - - -ncurses = 6.1 = he6710b0_1- - - - - -nomkl = 3.0 = 0- - - - - -numpy = 1.16.2 = py37h99e49ec_0- - - - - -numpy-base = 1.16.2 = py37h2f8d375_0- - - - - -openssl = 1.1.1b = h7b6447c_1- - - - - -熊貓= 0.24.2 = py37he6710b0_0- - - - - -parso = 0.3.4 = py37_0- - - - - -pexpect = 4.6.0 = py37_0- - - - - -pickleshare = 0.7.5 = py37_0- - - - - -皮普= 19.0.3 = py37_0- - - - - -prompt_toolkit = 2.0.9 = py37_0- - - - - -ptyprocess = 0.6.0 = py37_0- - - - - -pygments = 2.3.1 = py37_0- - - - - -python = 3.7.3 = h0371630_0- - - - - -python-dateutil = 2.8.0 = py37_0- - - - - -pytz = 2018.9 = py37_0- - - - - -readline = 7.0 = h7b6447c_5- - - - - -setuptools = 40.8.0 = py37_0- - - - - -6 = 1.12.0 = py37_0- - - - - -sqlite = 3.27.2 = h7b6447c_0- - - - - -tk = 8.6.8 = hbc83047_0- - - - - -traitlets = 4.3.2 = py37_0- - - - - -wcwidth = 0.1.7 = py37_0- - - - - -輪= 0.33.1 = py37_0- - - - - -xz = 5.2.4 = h14c3975_4- - - - - -zlib = 1.2.11 = h7b6447c_3- - - - - -皮普:- - - - - -pyarrow = = 0.12.0前綴:/磚/ conda / env / databricks-minimal