jprdonnelly/MachineLearningNotebooks
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

added introduction.

Browse Source
This commit is contained in:
Parashar Shah
2018-11-29 23:18:30 -08:00
committed by GitHub
parent b0ff1e1a5d
commit d4281967a2
1 changed files with 14 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

17
databricks/automl_adb_readme.md
View File

@@ -1,3 +1,14 @@
**PREVIEW capability**
Automated ML now supports Azure Databricks as a local compute to perform training (**public preview**). Azure Databricks is a managed Spark offering on Azure and customers already use it for advanced analytics. It provides a collaborative Notebook based environment with CPU or GPU based compute cluster.
- Customers who use Azure Databricks for advanced analytics can now use the same cluster to run automated machine learning experiments.
- You can keep the data within the same cluster.
- You can leverage the local worker nodes with autoscale and auto termination capabilities.
- You can use multiple cores of your Azure Databricks cluster to perform simultenous training.
- You can further tune the model generated by automated machine learning if you chose to.
- Every run (including the best run) is available as a pipeline.
- The model from the pipeline can be registered in Azure ML SDK workspace and then deployed to Azure managed compute (ACI or AKS) using the Azure Machine learning SDK.
**Create Azure Databricks Cluster:**
Select New Cluster and fill in following detail:
@@ -27,7 +38,7 @@ concurrent runs X 3 X 5 cross validations X 3 = 90 GB
It will take few minutes to create the cluster. Please ensure that the cluster state is running before proceeding further.
**Install Azure ML with Automated ML SDK**
**Install Azure ML with Automated ML SDK on your Azure Databricks cluster**
- Select Import library
@@ -41,10 +52,10 @@ It will take few minutes to create the cluster. Please ensure that the cluster s
- Select the check box _Attach_ next to your cluster name
(More details on attach and detach are here - [https://docs.databricks.com/user-guide/libraries.html#attach-a-library-to-a-cluster](https://docs.databricks.com/user-guide/libraries.html#attach-a-library-to-a-cluster) )
(More details on how to attach and detach libs are here - [https://docs.databricks.com/user-guide/libraries.html#attach-a-library-to-a-cluster](https://docs.databricks.com/user-guide/libraries.html#attach-a-library-to-a-cluster) )
- Ensure that there are no errors until Status changes to _Attached_. It may take a couple of minutes.
**Note** - If you have the old build the please deselect it from cluster’s installed libs > move to trash. Install the new build and restart the cluster. And if still there is an issue then detach and reattach your cluster.
**Now you are run the Automated ML sample notebook on your Azure Databricks cluster.**
**Now you can run the Automated ML sample notebook on your Azure Databricks cluster. Please let us know your feedback.**