Domů Procházet Nápověda
Registrovat se Přihlásit se
apache
/
hadoop
zrcadlo https://github.com/apache/hadoop.git
2
0
Rozštěpit 1
Soubory Úkoly 0 Wiki
Větev: ozone-0.4
Větve Značky
hadoop
/
hadoop-submarine
/
hadoop-submarine-core
Sunil G 9057aa9fc5 SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan. před 6 roky
..
src 9057aa9fc5 SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan. před 6 roky
README.md 9057aa9fc5 SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan. před 6 roky
pom.xml 9057aa9fc5 SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan. před 6 roky

README.md

Overview

              _                              _
             | |                            (_)
  ___  _   _ | |__   _ __ ___    __ _  _ __  _  _ __    ___
 / __|| | | || '_ \ | '_ ` _ \  / _` || '__|| || '_ \  / _ \
 \__ \| |_| || |_) || | | | | || (_| || |   | || | | ||  __/
 |___/ \__,_||_.__/ |_| |_| |_| \__,_||_|   |_||_| |_| \___|

                             ?
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~|^"~~~~~~~~~~~~~~~~~~~~~~~~~o~~~~~~~~~~~
        o                   |                  o      __o
         o                  |                 o     |X__>
       ___o                 |                __o
     (X___>--             __|__            |X__>     o
                         |     \                   __o
                         |      \                |X__>
  _______________________|_______\________________
 <                                                \____________   _
  \                                                            \ (_)
   \    O       O       O                                       >=)
    \__________________________________________________________/ (_)

Submarine is a project which allows infra engineer / data scientist to run unmodified Tensorflow programs on YARN.

Goals of Submarine:

  • It allows jobs easy access data/models in HDFS and other storages.
  • Can launch services to serve Tensorflow/MXNet models.
  • Support run distributed Tensorflow jobs with simple configs.
  • Support run user-specified Docker images.
  • Support specify GPU and other resources.
  • Support launch tensorboard for training jobs if user specified.
  • Support customized DNS name for roles (like tensorboard.$user.$domain:6006)

Please jump to QuickStart guide to quickly understand how to use this framework.

Please jump to Examples to try other examples like running Distributed Tensorflow Training for CIFAR 10.

If you're a developer, please find Developer guide for more details.