-
Notifications
You must be signed in to change notification settings - Fork 2.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Java sample for doing online prediction in Cloud Machine Learning Engine. #868
Changes from all commits
11f70b0
41591d8
468255e
4614206
e98c820
1d1a129
970cc5b
50d004b
2b5c7e4
a936efa
fd619ff
a92e099
2b8d9a5
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,18 @@ | ||
# Cloud Machine Learning Engine - Online Prediction with Java | ||
|
||
## Setup | ||
This sample demonstrates how to send online prediction requests to your deployed | ||
model on CMLE. | ||
Follow the [tutorial](https://cloud.google.com/ml-engine/docs/how-tos/deploying-models) | ||
to deploy your model first. | ||
|
||
This sample is using the [Application Default Credential](https://developers.google.com/identity/protocols/application-default-credentials). You can install the Google Cloud SDK and run: | ||
<pre>gcloud auth application-default login</pre> | ||
|
||
## Run | ||
Modify the OnlinePredictionSample.java with your project/model/version information. | ||
|
||
Compile the sample code using Maven by running the following command: | ||
<pre>mvn compile</pre> | ||
Execute the sample code using Maven by running the following command: | ||
<pre>mvn -q exec:java</pre> |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
{"instances": ["YOUR_INPUT_INSTANCE1", "YOUR_INPUT_INSTANCE2"]} |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,62 @@ | ||
<!-- | ||
Copyright 2017 Google Inc. | ||
Licensed under the Apache License, Version 2.0 (the "License"); | ||
you may not use this file except in compliance with the License. | ||
You may obtain a copy of the License at | ||
http://www.apache.org/licenses/LICENSE-2.0 | ||
Unless required by applicable law or agreed to in writing, software | ||
distributed under the License is distributed on an "AS IS" BASIS, | ||
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
See the License for the specific language governing permissions and | ||
limitations under the License. | ||
--> | ||
|
||
<project> | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. License needed here There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Done. |
||
<modelVersion>4.0.0</modelVersion> | ||
<groupId>com.google.cloud.samples</groupId> | ||
<artifactId>mlengine-online-prediction</artifactId> | ||
<version>1</version> | ||
|
||
<build> | ||
<plugins> | ||
<plugin> | ||
<groupId>org.codehaus.mojo</groupId> | ||
<artifactId>exec-maven-plugin</artifactId> | ||
<version>1.4.0</version> | ||
<executions> | ||
<execution> | ||
<goals> | ||
<goal>java</goal> | ||
</goals> | ||
</execution> | ||
</executions> | ||
<configuration> | ||
<mainClass>OnlinePredictionSample</mainClass> | ||
<systemProperties> | ||
<systemProperty> | ||
<key>java.util.logging.config.file</key> | ||
<value>logging.properties</value> | ||
</systemProperty> | ||
</systemProperties> | ||
</configuration> | ||
</plugin> | ||
</plugins> | ||
</build> | ||
<dependencies> | ||
<dependency> | ||
<groupId>joda-time</groupId> | ||
<artifactId>joda-time</artifactId> | ||
<version>2.2</version> | ||
</dependency> | ||
<dependency> | ||
<groupId>com.google.api-client</groupId> | ||
<artifactId>google-api-client</artifactId> | ||
<version>1.22.0</version> | ||
</dependency> | ||
<dependency> | ||
<groupId>com.google.apis</groupId> | ||
<artifactId>google-api-services-discovery</artifactId> | ||
<version>v1-rev58-1.22.0</version> | ||
</dependency> | ||
</dependencies> | ||
</project> |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,73 @@ | ||
/* | ||
* Copyright 2017 Google Inc. | ||
* | ||
* Licensed under the Apache License, Version 2.0 (the "License"); | ||
* you may not use this file except in compliance with the License. | ||
* You may obtain a copy of the License at | ||
* | ||
* http://www.apache.org/licenses/LICENSE-2.0 | ||
* | ||
* Unless required by applicable law or agreed to in writing, software | ||
* distributed under the License is distributed on an "AS IS" BASIS, | ||
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | ||
* See the License for the specific language governing permissions and | ||
* limitations under the License. | ||
*/ | ||
|
||
import com.google.api.client.googleapis.auth.oauth2.GoogleCredential; | ||
import com.google.api.client.googleapis.javanet.GoogleNetHttpTransport; | ||
import com.google.api.client.http.FileContent; | ||
import com.google.api.client.http.GenericUrl; | ||
import com.google.api.client.http.HttpContent; | ||
import com.google.api.client.http.HttpRequest; | ||
import com.google.api.client.http.HttpRequestFactory; | ||
import com.google.api.client.http.HttpTransport; | ||
import com.google.api.client.http.UriTemplate; | ||
import com.google.api.client.json.JsonFactory; | ||
import com.google.api.client.json.jackson2.JacksonFactory; | ||
import com.google.api.services.discovery.Discovery; | ||
import com.google.api.services.discovery.model.JsonSchema; | ||
import com.google.api.services.discovery.model.RestDescription; | ||
import com.google.api.services.discovery.model.RestMethod; | ||
import java.io.File; | ||
|
||
/* | ||
* Sample code for doing Cloud Machine Learning Engine online prediction in Java. | ||
*/ | ||
|
||
public class OnlinePredictionSample { | ||
public static void main(String[] args) throws Exception { | ||
HttpTransport httpTransport = GoogleNetHttpTransport.newTrustedTransport(); | ||
JsonFactory jsonFactory = JacksonFactory.getDefaultInstance(); | ||
Discovery discovery = new Discovery.Builder(httpTransport, jsonFactory, null).build(); | ||
|
||
RestDescription api = discovery.apis().getRest("ml", "v1").execute(); | ||
RestMethod method = api.getResources().get("projects").getMethods().get("predict"); | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Some kind of comment how you are inspecting the discovery document and getting the Prediction API. |
||
|
||
JsonSchema param = new JsonSchema(); | ||
String projectId = "YOUR_PROJECT_ID"; | ||
// You should have already deployed a model and a version. | ||
// For reference, see https://cloud.google.com/ml-engine/docs/how-tos/deploying-models. | ||
String modelId = "YOUR_MODEL_ID"; | ||
String versionId = "YOUR_VERSION_ID"; | ||
param.set( | ||
"name", String.format("projects/%s/models/%s/versions/%s", projectId, modelId, versionId)); | ||
|
||
GenericUrl url = | ||
new GenericUrl(UriTemplate.expand(api.getBaseUrl() + method.getPath(), param, true)); | ||
System.out.println(url); | ||
|
||
String contentType = "application/json"; | ||
File requestBodyFile = new File("input.txt"); | ||
HttpContent content = new FileContent(contentType, requestBodyFile); | ||
System.out.println(content.getLength()); | ||
|
||
GoogleCredential credential = GoogleCredential.getApplicationDefault(); | ||
HttpRequestFactory requestFactory = httpTransport.createRequestFactory(credential); | ||
HttpRequest request = requestFactory.buildRequest(method.getHttpMethod(), url, content); | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. A comment about this. Why aren't you actually generating an APIary client so don't need to do it this way? Seems simple enough, but there are some named things when you create it from the proto usually. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. There isn't particular reason for choosing discovery over direct API. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. In this case, I'm happy with just using discovery. As you will need to generate a One Platform API for GA. (I'd rather see a 1P now, but can live w/ this) |
||
|
||
String response = request.execute().parseAsString(); | ||
System.out.println(response); | ||
} | ||
} | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you look at our other README's and add content about auth.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added, PTAL