Skip to content

Crazybean-lwb/deeplearning-pyspark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

Index

machine learning and deep learning job with pyspark > 3.0.

how to use gpu

running jobs in container have advantages as follows:

  • a seperate runtime and evrionment
  • easy to copy cuda environment to all executores

running spark on k8s make it possible to use gpu clusters.

submit ml job

It's easy to create job CR to run job with spark operator

About

pyspark for deep learning base on spark > 3.0

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published