Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Scalding to 0.12.0 and CDH 5.3.0 #22

Merged
merged 3 commits into from
Jan 26, 2015

Conversation

mattweyant
Copy link

This may address #20.

@galarragas galarragas self-assigned this Jan 26, 2015
galarragas added a commit that referenced this pull request Jan 26, 2015
Update Scalding to 0.12.0 and CDH 5.3.0
@galarragas galarragas merged commit 4c1f607 into ParallelAI:master Jan 26, 2015
@galarragas
Copy link
Contributor

Thanks @mattweyant

@mattweyant mattweyant deleted the cdh5 branch January 26, 2015 17:10
@mattweyant
Copy link
Author

No problem!

@xgdgsc
Copy link

xgdgsc commented Jan 29, 2015

So I should use the master if I use CDH 5.3.0? Can you make a release at http://conjars.org/repo/parallelai/parallelai.spyglass/ to make installation easier?

@xgdgsc
Copy link

xgdgsc commented Jan 29, 2015

When I try $ mvn clean install -U with master error occurs:

[ERROR] Failed to execute goal on project parallelai.spyglass: Could not resolve dependencies for project parallelai:parallelai.spyglass:jar:2.10_0.12.0_5.3.0: Could not find artifact org.apache.hbase:hbase:jar:0.98.6-cdh5.3.0 in scala-tools.org (https://oss.sonatype.org/content/repositories/snapshots/) -> [Help 1]

@mattweyant
Copy link
Author

Not sure why it's attempting to pull CDH dependencies from Sonatype. They are available from Cloudera directly, and the Cloudera repo is included in the POM.

@Antwnis
Copy link
Contributor

Antwnis commented Jan 29, 2015

The reason that it's not picking up the JAR is that it no longer exists !!

HBase has now being split in hbase-client / hbase-server etc etc

I attempted a quick fix here dcd247b and deployed a new version on Conjars. Try

<dependency>
    <groupId>parallelai</groupId>
    <artifactId>parallelai.spyglass</artifactId>
    <version>2.10_0.12.0_5.3.0_beta</version>
</dependency>`

The possibility of this working is not huge, so please test and provide feedback - to make a proper release if things are up and working

@mattweyant
Copy link
Author

Ah, yes! Thanks, @Antwnis. I was hasty in pushing the change. We found the same issue later in the day yesterday during testing.

@mattweyant
Copy link
Author

@Antwnis I tested 2.10_0.12.0_5.3.0_beta locally and it appears to work just fine.

@mattweyant
Copy link
Author

Another particularly unsettling problem is now with CDH5.3.0 itself: http://community.cloudera.com/t5/Batch-Processing-and-Workflow/CDH-5-3-CLASSPATH-Issue/td-p/23188

@xgdgsc
Copy link

xgdgsc commented Feb 2, 2015

@Antwnis Thanks. Your fix is fine but the deployed pom: http://conjars.org/repo/parallelai/parallelai.spyglass/2.10_0.12.0_5.3.0_beta/parallelai.spyglass-2.10_0.12.0_5.3.0_beta.pom is still the old version and gives the same error. I had to comment it out manually.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants