Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Staging to master to get latest changes #1245

Merged
merged 46 commits into from
Nov 27, 2020
Merged

Staging to master to get latest changes #1245

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
64bf01d
refactor test_mind code; add demo sizes to tests
Nov 1, 2020
df8fa3c
added test_mind_urls to test headers without downloading
Nov 2, 2020
6f66040
removing untracked files
Nov 2, 2020
020d382
rerun
miguelgfierro Nov 7, 2020
7a8bd71
clean
miguelgfierro Nov 7, 2020
f5ae256
Merge branch 'staging' into miguel/clean
miguelgfierro Nov 7, 2020
df55c97
test mind update
Nov 8, 2020
97d77de
allow growth on demand
miguelgfierro Nov 8, 2020
4a24cff
Merge branch 'miguel/clean' of github.com:Microsoft/Recommenders into…
miguelgfierro Nov 8, 2020
3318863
wip
miguelgfierro Nov 8, 2020
5824c02
rerun
miguelgfierro Nov 8, 2020
1d7da1b
naml
miguelgfierro Nov 8, 2020
c9d46d9
nrms
miguelgfierro Nov 8, 2020
3b8c3e0
:doc:
miguelgfierro Nov 8, 2020
9adcfcd
updated test_mind
Nov 8, 2020
ddc474b
added demo size test for test_extract_mind
Nov 8, 2020
c0301cb
timer
miguelgfierro Nov 8, 2020
c8511f8
mark smoke for two mind tests; updated pytest.ini
Nov 8, 2020
f76ee3c
update mind.py
Nov 8, 2020
8f3706c
wip
miguelgfierro Nov 8, 2020
011a08a
wip
miguelgfierro Nov 8, 2020
ad8fde7
wip
miguelgfierro Nov 8, 2020
5b4172e
wip
miguelgfierro Nov 8, 2020
82be3aa
Merge pull request #1236 from microsoft/wutao/testdemo
miguelgfierro Nov 9, 2020
2f26854
Merge pull request #1235 from microsoft/miguel/clean
miguelgfierro Nov 10, 2020
4516dcc
Change typos in Standard VAE and Multinomial VAE
EvgeniaChroni Nov 10, 2020
749b939
Change typos in Multinomial VAE notebook
EvgeniaChroni Nov 10, 2020
21a3eb6
Change typos in Standard VAE notebook
EvgeniaChroni Nov 10, 2020
bf77707
Change typos in Standard VAE notebook
EvgeniaChroni Nov 10, 2020
dbf2134
Change typos in Multinomial VAE notebook
EvgeniaChroni Nov 10, 2020
eb9bc61
Change typos in multinomial log-likelihood formula
EvgeniaChroni Nov 10, 2020
986714f
Correct typos
EvgeniaChroni Nov 11, 2020
1f388f5
Correct typos
EvgeniaChroni Nov 11, 2020
76b1319
restrict daily integration tests in master
miguelgfierro Nov 12, 2020
57f8e2c
Merge pull request #1239 from EvgeniaChroni/EvgeniaChroni/vae
miguelgfierro Nov 12, 2020
a58c14f
comment
miguelgfierro Nov 13, 2020
ac74a66
badges
miguelgfierro Nov 13, 2020
110648c
:bug:
miguelgfierro Nov 13, 2020
ea0588c
:bug:
miguelgfierro Nov 13, 2020
516b42d
Merge pull request #1242 from microsoft/miguel/badges
miguelgfierro Nov 13, 2020
5fb4255
Merge pull request #1243 from microsoft/bug/affinity_matrix
miguelgfierro Nov 13, 2020
a931a6a
Merge pull request #1244 from microsoft/bug/spark_integration_tests
miguelgfierro Nov 13, 2020
245ef66
Merge branch 'master' into staging
miguelgfierro Nov 13, 2020
095a423
Update test_notebooks_gpu.py
wutaomsft Nov 26, 2020
9d0da27
Merge pull request #1252 from microsoft/wutaomsft-patch-2
miguelgfierro Nov 27, 2020
26c0cb4
small change in setup
miguelgfierro Nov 27, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 5 additions & 3 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -138,12 +138,14 @@ The following tests run on a Windows and Linux DSVM daily. These machines run 24

| Build Type | Branch | Status | | Branch | Status |
| --- | --- | --- | --- | --- | --- |
| **Linux CPU** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_cpu?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=67&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_cpu?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=67&branchName=staging) |
| **Linux GPU** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_gpu?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=85&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_gpu?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=85&branchName=staging) |
| **Linux Spark** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_pyspark?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=86&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_pyspark?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=86&branchName=staging) |
| **Linux CPU** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_cpu?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=162&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_cpu?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=162&branchName=staging) |
| **Linux GPU** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_gpu?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=163&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_gpu?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=163&branchName=staging) |
| **Linux Spark** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_pyspark?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=164&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/linux-tests/dsvm_nightly_linux_pyspark?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=164&branchName=staging) |
<!--
| **Windows CPU** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/windows-tests/dsvm_nightly_win_cpu?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=101&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/windows-tests/dsvm_nightly_win_cpu?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=101&branchName=staging) |
| **Windows GPU** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/windows-tests/dsvm_nightly_win_gpu?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=102&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/windows-tests/dsvm_nightly_win_gpu?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=102&branchName=staging) |
| **Windows Spark** | master | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/windows-tests/dsvm_nightly_win_pyspark?branchName=master)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=103&branchName=master) | | staging | [![Build Status](https://dev.azure.com/best-practices/recommenders/_apis/build/status/windows-tests/dsvm_nightly_win_pyspark?branchName=staging)](https://dev.azure.com/best-practices/recommenders/_build/latest?definitionId=103&branchName=staging) |
-->

## Related projects

Expand Down
4 changes: 2 additions & 2 deletions SETUP.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -224,14 +224,14 @@ sudo rm -rf Azure_mmlspark-0.12.jar com.microsoft.cntk_cntk-2.4.jar com.microsof

## Setup guide for Azure Databricks

### Requirements of Azure Databricks
### Requirements

* Databricks Runtime version >= 4.3 (Apache Spark 2.3.1, Scala 2.11) and <= 5.5 (Apache Spark 2.4.3, Scala 2.11)
* Python 3

An example of how to create an Azure Databricks workspace and an Apache Spark cluster within the workspace can be found from [here](https://docs.microsoft.com/en-us/azure/azure-databricks/quickstart-create-databricks-workspace-portal). To utilize deep learning models and GPUs, you may setup GPU-enabled cluster. For more details about this topic, please see [Azure Databricks deep learning guide](https://docs.azuredatabricks.net/applications/deep-learning/index.html).

### Repository installation
### Dependencies setup

You can setup the repository as a library on Databricks either manually or by running an [installation script](tools/databricks_install.py). Both options assume you have access to a provisioned Databricks workspace and cluster and that you have appropriate permissions to install libraries.

Expand Down
Loading