generate protostr files with current config files #363

wen-bo-yang · 2016-11-05T10:22:21Z

Protostr directory added that path is "Paddle/python/paddle/trainer_config_helpers/tests/configs/protostr".
The directory save protostr files that genterate with current config files.
I modified check.md5 file and generate_protostr.sh files in order to check value of md5 between xxx.protostr and xxx.protostr.unitest and save new protostr files in protostr directory.

the name of dataprovider is "dataprovider_bow" in quick_start , but neme of dataprovider is "dataprovider_pow" below the "Define Python Data Provider in Configuration files"

if not export "LC_ALL=C", there are some warning that do not block the preprocess.sh, but maybe confused for some fresh man. e.g: perl: warning: Falling back to the standard locale ("C"). perl: warning: Setting locale failed. perl: warning: Please check that your locale settings: LANGUAGE = (unset), LC_ALL = (unset), LANG = "zh_CN.UTF-8"

合并作者更新代码

…_protostr.sh

coveralls · 2016-11-05T10:39:58Z

Coverage remained the same at 62.35% when pulling f5fe91b on wen-bo-yang:develop into 93e4d0c on baidu:develop.

luotao1 · 2016-11-05T11:41:16Z

python/paddle/trainer_config_helpers/tests/configs/check.md5

-f586a548ef4350ba1ed47a81859a64cb  unused_layers.protostr
-8122477f4f65244580cec09edc590041  util_layers.protostr
-dcd76bebb5f9c755f481c26192917818  math_ops.protostr
+86c0815275a9d5eb902e23c6a592f58a ./protostr/img_layers.protostr.unitest


我理解的是这里不要放类似86c0815275a9d5eb902e23c6a592f58的一串数字了。应该直接比较./protostr/img_layers.protostr和./protostr/img_layers.protostr.unitest的md5值。因为这串数字也是之前我们对./protostr/img_layers.protostr用md5sum -c命令计算获得的，所以可以修改下trainer_config_helpers/tests/configs/run_tests.sh脚本，直接比较两个protostr的md5值。

@luotao1 了解，后续会修改为直接比对生成文件新文件和版本库中的protostr文件的的MD5值。

@luotao1 图片中是修改之后的代码，但是感觉没有原来的简洁。
烦请预先check下，如果没问题我在提交pull request
感谢

这个脚本的意思是：check.md5中可以只放img_layers.protostr（也不需要./protostr目录），然后脚本中自动寻找img_layers.protostr.unitest么？这样我觉得挺好的，check.md5会比较简洁，脚本看着也很容易懂。脚本的第14行是判断语句，那如果new_protostr不存在，是否要报错或者怎么样？

如果按图片中进行修改的话，就不需要check.md5文件。建立protostr目录是为了存放xxx.protostr和xxx.protostr.unitest文件(当前xxx.protostr文件个数23个)，目的是为了隔离生成的文件和configs中的文件分开，便于管理。
第5行指定对比文件目录
第6行查找版本库中生成好的xxx.protostr文件，由于可能存在多次运行run_tests.sh产生xxx.protostr.unitest文件，所以过滤了该文件，只将xxx.protostr文件作为对比文件。
10到23行为遍历对比文件和生成后的xxx.protostr.unitest文件的MD5值。相同为OK，反之为FAILED
脚本中第14行判断如果new_protostr不存在是会走eles分支，会输出新生成的文件可能不存在的警告，图片中没有贴出来。已经添加到我的代码里了。
我一会提一个pull request

coveralls · 2016-11-05T16:47:37Z

Coverage remained the same at 62.35% when pulling 5afa062 on wen-bo-yang:develop into 93e4d0c on baidu:develop.

emailweixu · 2016-11-05T18:49:53Z

Suggest not to use md5 for comparison. Using diff will be more helpful because it can show what goes wrong.

wen-bo-yang · 2016-11-06T04:03:11Z

OK, no problem. I will modify script and pull request.

coveralls · 2016-11-06T05:45:07Z

Coverage remained the same at 62.35% when pulling bbc3f07 on wen-bo-yang:develop into 93e4d0c on baidu:develop.

wen-bo-yang

删除 set -e
原因，当使用diff进行文件比对时，如果出现文件差异，则diff返回1非零，但set -e判断脚本中任何一个返回值非零是就结束，可能导致比对后续文件中断。如：如果有23对文件（46个），在对比第2对文件时，出现差异，脚本退出，不在继续比对后续文件。

coveralls · 2016-11-06T07:12:17Z

Coverage increased (+0.03%) to 62.377% when pulling 85a5f44 on wen-bo-yang:develop into 93e4d0c on baidu:develop.

reyoung · 2016-11-07T02:41:16Z

python/paddle/trainer_config_helpers/tests/configs/run_tests.sh

-            echo $new_protostr: FAILED!
-        else
+        diff $base_protostr $new_protostr -u
+        if [ $? -eq 0 ];then
            echo $new_protostr: OK!
        fi


其实这里直接就退出也无所谓。因为单测一个错了其他的也可以不执行了。
所以set -e是ok的。同时，后面的echo OK!也是不必要的了。而且，if [ -f ] 也是不必要的。出错就出错，直接返回一个错误值就好了。

diff不要是 -u，直接返回diff的是什么就好了。这样也给运行单测的人一些错误提示。

reyoung · 2016-11-07T02:43:00Z

python/paddle/trainer_config_helpers/tests/configs/check.md5

+9c038249ec8ff719753a746cdb04c026 ./protostr/layer_activations.protostr.unitest
+5913f87b39cee3b2701fa158270aca26 ./protostr/projections.protostr.unitest
+7334ba0a4544f0623231330fc51d390d ./protostr/shared_fc.protostr.unitest
+8b8b6bb128a7dfcc937be86145f53e2f ./protostr/shared_lstm.protostr.unitest


另外，既然用diff了。这个md5文件就没有啥用了，删了吧。

luotao1 · 2016-11-07T03:13:27Z

python/paddle/trainer_config_helpers/tests/configs/run_tests.sh

-        echo WARNING $new_protostr: NOT EXIST!
-    fi
+    diff $base_protostr $new_protostr
+    mv $new_protostr $protostr/$file.unitest.bak


为什么需要17行

在每次跑单侧是留下一个备份文件以.bak命名。

想让第二次比对的结果不一第一次跑出的结果直接对比。如第一次生成xxx.protostr.unitest文件后，在第二次用户没有删除该文件时，可能会存在新生成的xxx.protostr.unitest文件失败，但是第一次的结果又没有清空，此时对比可能是对比的前一次，为了避免该情况发生，每次都diff结束后，重新命名该文件为.bak

不需要留下备份文件吧 @reyoung

在第二次用户没有删除该文件时,可能会存在新生成的xxx.protostr.unitest文件失败：生成的时候，把原文件覆盖了就行了吧

coveralls · 2016-11-07T03:32:56Z

Coverage increased (+0.005%) to 62.354% when pulling defdce7 on wen-bo-yang:develop into 93e4d0c on baidu:develop.

coveralls · 2016-11-07T04:40:01Z

Coverage increased (+0.03%) to 62.377% when pulling cf0e5c4 on wen-bo-yang:develop into 93e4d0c on baidu:develop.

luotao1 · 2016-11-07T04:50:42Z

python/paddle/trainer_config_helpers/tests/configs/run_tests.sh

@@ -1,5 +1,17 @@
 #!/bin/bash
 cd `dirname $0`
+


空白的line 3和7可以删掉

* refine sparse momentum api and unittest (PaddlePaddle#126) * refine sparse momentum api and unittest * fix unittests bug * Remove main function in some unittest. * Update Mac OS X port * follow comments to fix bugs * Revise some word in build doc * Add automatic check AVX in CMake (PaddlePaddle#145) * Add automatic check AVX in CMake * Revise table format and some words in build docs * Fix cmake/FindAVX.cmake * Update build docs (PaddlePaddle#148) * Add automatic check AVX in CMake * Add indent in FindAVX.cmake * Revise table format and some words in build docs * Update build docs * Fix bug when only support AVX 2 (PaddlePaddle#150) In some situation, for instance, in the virtual machine, it could happen. * add scripts to build ubuntu install package. (PaddlePaddle#132) * also refine install docs, too * some bug fix for sparse matrix (PaddlePaddle#133) * some bug fix for sparse matrix * a minor bug fix * Update build docs (PaddlePaddle#149) * Add automatic check AVX in CMake * Add indent in FindAVX.cmake * Revise table format and some words in build docs * Update build docs * Update build docs * [DOC CHANGE] Rerange Build docs & emphasize them in README.md (PaddlePaddle#151) * Rerange Build docs & emphasize them in README.md * Rerange Build docs & emphasize them in README.md * Update Readme (PaddlePaddle#153) * Update Readme * Update readme * Update readme * Fix CUDA_VERSION Comparsion (PaddlePaddle#165) * Update readme (PaddlePaddle#155) * Update readme * Apache 2.0 * add interface and test of RecurrentGradientMachine (PaddlePaddle#156) * add interface and unittest of RecurrentGradientMachine for the function of multiple Subsequence inlinks with unequal token length * bug fix for dataprovider for quick start inference (PaddlePaddle#168) * Support MAC OS Sierra (PaddlePaddle#169) * typo in image classification demo (PaddlePaddle#167) * support rectangle padding, stride, window and input for PoolProjection (PaddlePaddle#115) * support rectangle padding, stride, window and input for PoolProjection * Follow comments. 1. Remove start 2. refine img_pool_a/b.conf for test_NetworkCompare 3. Split unit test * Modify the test in img_layers.py * Use C++ 11 atomic_flag in MacOS as spin lock (PaddlePaddle#175) * Use C++ 11 atomic_flag in MacOS as spin lock * Add unittest for it. * Read git sha1 when building Paddle, and add it to PADDLE_VERSION macro * save the model file including git sha1 * add weight for cost layer interface (PaddlePaddle#177) * Should not compile the two files if -DWITH_AVX=OFF. (PaddlePaddle#163) * If cmake -DWITH_AVX=OFF during configuration, should not compile the file src/hl_math.cc and src/hl_avx_functions.cc. * Add travis for osx (PaddlePaddle#189) * set MKL search path with intel64 (PaddlePaddle#188) * Mnist demo (PaddlePaddle#162) * added mnist demo * modified .gitignore for .project files * normalize pixel in mnist_provider.py and set use_gpu=0 * add interface and unittest for nce layer (PaddlePaddle#180) * add interface and unittest for nce layer * follow comments * Merge internal changes (PaddlePaddle#198) * fix DataProvider create function args bug Change-Id: I9e3a1c535c805bf30204a14aea8d5143ff534784 * remove PserverForPython.h which is not used Change-Id: I2b27f1f3c11a42766a92fc689f0f5f1f73ee1d70 * add internal document script Change-Id: Ia0fec79456caea0b271f9903cc13e8a3d32e0774 * hierarchical rnn document, add new config example (PaddlePaddle#106) * hierarchical rnn document, add new config example * update inputs_type of label * add check for unsupported config * refine hierarchical document * refine doc title * update docs, fix paddle to PaddlePaddle * follow comments * remove some copyfrom in AgentLayer and ExpandLayer, fix warning in seq2seq config (PaddlePaddle#183) * remove redundant HPPL_TYPE_DOUBLE (PaddlePaddle#200) * add cost_type constraint to weighted_cost interface (PaddlePaddle#206) * remove unmerged internal documents (PaddlePaddle#205) * Add FAQ (PaddlePaddle#128) * Init commit for doing FAQ * Add speed up training * Add graphviz to ci * Add shared paramter * Tiny refine * Fix bug in yield dictionary in DataProvider. (PaddlePaddle#197) * Fix bug in yield dictionary in DataProvider. * Also make virtualenv work in Paddle. * Update docker_instll.rst docker image name (PaddlePaddle#210) * Fix sparse training for trainer_count=1 (PaddlePaddle#204) * Fix sparse training for trainer_count=1 For trainer_count=1, the gradient machine is NeuralNetwork, which does not create parameter buf for PARAMETER_GRADIENT for sparse update in Parameter::enableType. But gradient parameter buf is still used in SgdThreadUpdater. * Minor update to comment * Supplement doc for RNN (PaddlePaddle#214) * Speed up PyDP2, support numpy.float array (PaddlePaddle#207) * fix bug in some different python environment (PaddlePaddle#220) * Fix install_docker.rst and data_sources file open mode * Follow PaddlePaddle#223 * Fix PaddlePaddle#222 * add base class for seqlastin/max/average layer (PaddlePaddle#187) * Added Bidi-LSTM and DB-LSTM to quick_start demo (PaddlePaddle#226) * add missing layer_attr (PaddlePaddle#234) * fix build bug in gcc46 (PaddlePaddle#236) * error in doc of quick_start (PaddlePaddle#228) * fix error in doc of quick_start * There are some warning when execute preprocess.sh * add maxout layer, including interface and unittest (PaddlePaddle#229) * add maxout layer, including interface and unittest * follow maxout comments * auto setting channels * fix unittest bug in test_RecurrentGradientMachine * remove deprecated start input in img_pool_layer (PaddlePaddle#237) * Fix dataprovider converter for sparse data * FIx check type unmatch in MaxOutLayer (PaddlePaddle#242) Compiled failed on gcc 4.6 * Sequence tagging demo (PaddlePaddle#225) * Update contribute_to_paddle.md (PaddlePaddle#248) * add input sparse data check for sparse layer at runtime (PaddlePaddle#247) * add input sparse data check for sparse layer at runtime, to avoid invalid data access at pserver end while doing prefetch * remote sparse design support binary sparse and float saprse both * Python trainer api (PaddlePaddle#193) * Python trainer API and demo * Adding missing PaddleAPIPrivate.h * Adding api_train.sh * More comments * Bump up patch version to 0b3 * Change contribute to paddle to fit new branching model (PaddlePaddle#275) * Change contribute to paddle to fit new branching model * set test_period default value to 0 (PaddlePaddle#279) * Make Paddle --save_dir support a directory name (PaddlePaddle#277) * Also fix PaddlePaddle#243 * fix interface bug of block_expand_layer and add unittest (PaddlePaddle#265) * fix interface bug of block_expand_layer and add unittest * auto compute num_channels * default value of num_channels is None * adjust input order of block_expand * Support empty Param Block in ParameterSever (PaddlePaddle#244) * Because in cluster maybe use a lot machine to train a model, and some parameter size could be too small for ParameterServer. Then some of pservers could not have any ParamBlock. * Also, because ports_num or ports_num_for_sparse is too large, then give a warning in runtime. * Add bilinear interpolation layer * fix type unmatch on gcc * Adding an introduction doc for Paddle to implement simplest linear regression. * Add default cuda system path (PaddlePaddle#192) * DYLD_LIBRARY_PATH is disable after Mac OS X 10.11 * fix clang + gpu compile error on Mac OS * fix some words and errors in build docs * Add glog header path to include (PaddlePaddle#295) * add SpatialPyramidPoolLayer c++ support * Add job=time in trainer, refine cudnn_conv to reduce gpu memory and speed up training. (PaddlePaddle#218) * Add benchmark for PaddlePaddle, tensorflow and caffe * ConvProjection to reduce memory for goolenet * Add unit test for ConvProjection. 1. unit test in test_LayerGrad. 2. compare the ConvPorjection and CudnnConvLayer, also compare the concat_layer+img_conv_layer and concat_layer_conv_projection. * Reduce cudnn_conv memory and add benchmark document. 1. Use TmpMatrix as the workspace in cudnn_conv to reduce gpu memory. It reduce lots of memory. 2. Add benchmark document. 3. fix smallnet_mnist_cifar.py in paddle. * Add job=time and refine cudnn_conv to reduce gpu memroy and speed up * Refine cudnn_conv and shared biases operation in concat_layer and mixed_layer. * follow comments * follow comments * Use unique_ptr to prevent memory leaks in CudnnConvLayer. * Add some concepts documents to guide user for using paddle (PaddlePaddle#249) * reuse code of PoolProjection in PoolProjectionLayer * Add How to build docs (PaddlePaddle#312) * Bug fix in CudnnConvLayer, which will lead to destruction error. (PaddlePaddle#317) * Fix a bug in testOnePeriod. (PaddlePaddle#322) * Forget to finishTestPeriod in testOnePeriod. * Fix PaddlePaddle#318 * add user_arg to LayerConfig (PaddlePaddle#315) * install the right python package version (PaddlePaddle#326) For multiple installation of paddle, there might be multiple versions of python package at opt/paddle/share/wheels/. We should install the right version. Ideally, we should remove the wrong versions when install. But it's not easy to do this with cmake. Change-Id: Ida8a8d60643ad9e42cf1c85776de9122d5ba1392 * Add matrix inverse (PaddlePaddle#240) * Add matrix inverse * report error when use parallel_nn to train recurrent_nn model (PaddlePaddle#335) * install the right python package version (PaddlePaddle#340) For multiple installation of paddle, there might be multiple versions of python package at opt/paddle/share/wheels/. We should install the right version. Ideally, we should remove the wrong versions when install. But it's not easy to do this with cmake. Change-Id: Ida8a8d60643ad9e42cf1c85776de9122d5ba1392 * Fix minor errors in instructions of building Paddle on Mac OS X (PaddlePaddle#347) * Fix bug and redundant code in hl_dso_loader.cc (PaddlePaddle#306) * Fix glog check type unmatch in Util.cpp (PaddlePaddle#353) * Fix glog check type unmatch in Util.cpp PaddlePaddle#352 * Add code coverage and coveralls (PaddlePaddle#296) * Add Issue template to guide user submit good issue (PaddlePaddle#354) * Add issue template * Update ISSUE_TEMPLATE.md * Update ISSUE_TEMPLATE.md * Rename * Rename * Typo * Typo * Typo * Typo * Follow comments * Follow comments * Add elementwise math operations (PaddlePaddle#343) * Add elementwise math operations This allows use to use expressions like: y=log(1+exp(x)) Also added unittests for ActivationFunction * Enforce keyword arguments for non-positional arguments * Add LogActivation to doc * include mkl_lapacke.h (PaddlePaddle#359) * Update ISSUE_TEMPLATE.md (PaddlePaddle#357) * add rdma cmake support (PaddlePaddle#284) * add rdma cmake support * move rdma related code to rdma.cmake * using find_package for swig (PaddlePaddle#334) * Use diff to compare config unittest (PaddlePaddle#363) Fix PaddlePaddle#342 * Fix SRL hang when exit. (PaddlePaddle#291) * Fix SRL hang when exit. * Error occurred when enable Async Load in TestDataProvider. * It because DataProvider is calling getNextBatchInternal in one thread, and destructing DataProvider in other thread. * Add wait routine in DataProvider destructing. * Also fix another bug, when destructing TestDataProvider and do not read any test data. Fix PaddlePaddle#286 * Follow comments, Use mutex is cool! * Follow comments * Add img_size for unit test * Fix bilinear interp bug * revert flags.cmake * Replace outputH to batchSize * Follow comments * Revise one word in ISSUE_TEMPLATE.md (PaddlePaddle#371) * abstract outputSize function in CNN-related layers (PaddlePaddle#314) * Add define for double getrf, getri (PaddlePaddle#381) * Add SumCost This allows user to implement any type of cost by summing over the output of non-cost layers. Change-Id: Ic55aaabbf0c1299e70b8e48a0effcc91f8f5bd29 * Add sum_cost to document And rebase Change-Id: I7ea234b3aa8fc70675af15d91db08242c43fb5ff * Remove Mac OS X build docs (PaddlePaddle#386) Currently, Paddle on Mac OS X is not deliberate testing through the different versions of Mac OS X and Clang. When all these things that we've done, we will reopen Mac build docs. * add python wrap for sppLayer * Cancelling Travis build with docs updates only. (PaddlePaddle#372) * fix deadlink in Chinese quick start doc. (PaddlePaddle#389) * add python-related unittest problem in faq document (PaddlePaddle#377) * Fix macOS quick start preprocess script. (PaddlePaddle#390) * Use `gshuf` instead of `shuf` in macOS * Fix PaddlePaddle#388 * fix floating-point overflow problem of tanh (PaddlePaddle#355) * py_paddle link zlib(PaddlePaddle#393) * enable swig unittest in travis-ci (PaddlePaddle#394) * Init * Add numpy deps * Refine * fix some nvcc compile options (PaddlePaddle#392) * Follow comments * modify the format of diff information in protostr (PaddlePaddle#398) * Fix minior bug * add patch does not trigger travis ci * follow comments * Fix Travis Ci does not build when push patches (PaddlePaddle#399) * add getSize method for PoolProjection * Make matrix well-conditioned when unittest inverse * Implement setDiag() with BaseMatrix::assign() * Follow comments * follow comments * Update FindAVX.cmake (PaddlePaddle#404) * make AVX_FOUND is default value to WITH AVX * let AVX_FLAG always keep -mavx flag since compiler can build binary with -mavx even CPU does not support avx. * some tiny fixs (PaddlePaddle#406) * some tiny fixs * use VLOG(3) * [Work in Progress] Update cluster_train.md (PaddlePaddle#391) Update cluster_train.md for easier understanding * Fix memory leak in image classification demo, which is caused by dataprovider (PaddlePaddle#323) * the memory leak is inside one pass. * Update * Delelte old protostr * Follow comments * add some code comments for SppLayer * Update * Fix a bug * initial take on deconv layers * added convTrans test and python components * added more test on convTrans layer and comments * Refactor ExpandConvTransLayer to share codes with ExpandConvLayer * refactored ExpandConvLayer and ExpandConvTransLayer with ConvBaseLayerCpu * fixed a bug in refactoring ExpandConv/TransLayer * add another small test in test_LayerGrad for convTransLayer * Revised deconv implementations according to luotao1 * rebase deconv implementation with develop branch and resolve conflicts with pull#218 commit 45c81a4 * deconv layer implementation modification following luotao1 comments * fix a small bug in ConvTransLayerBase in config_parser.py * deconv implementation mionr changes in ConvBaseLayer.cpp and config_parser.py * minor changes on deconv per luotao1 comments * Refactored imageSize in ConvBaseLayer to MathUtil * minor change to convTransLayer test in test_LayerGrad * minor changes on deconv implementation and add protostr test for deconv layer * fixed a bug in parse_conv in config_parser.py * Generate bilinear protostr via Linux * set mixedlayer output size according to input operator (PaddlePaddle#414) * set mixedlayer output size according to input operator * change from num_channel to num_channels for conv_operator (the old one is really misleading because all the others are num_channels) * also changed the arg name in projections.py * change the act.name for LinearActivation() to "linear" so that it won't fail in hl_activetype; also fix the hasinputsset in submodel * Revise code * use yapf to format python code, add style config file * Add checkout name for Dockerfile * Because in dockerhub, we cannot set the `docker build `running directory, we could only use `git clone` command to get the latest code if we put `Dockerfile` in subdirectory * But the `git clone` will checkout the default branch only, so here we add a `ENV` in Dockerfile to checkout special branch or tag in git repo. We could change it to `V0.9.0` tag when it release. * '*' operator overload for LayerOutput Making '*' support the multiplication between a scalar and LayerOutput Also changing '+' to support adding between a vector and a scalar. Change-Id: I7daf35590dc2b2f855a29d9ef43ac57979442e0f * change hlactivetype instead of act.name * fix bug in sum_cost * fix test_layerHelpers unittest error * change python code style to pep8 * Fix bug in multple objects in define_py_sources * Add unittest for split datasource * Fix PaddlePaddle#436 * multi_binary_cross_entropy when ids vector is provided * copy the data when createSparseMatrix * format python code in demo, doc, doc_cn and paddle directories * format python code in python directory * modifications according to comments * Add pre-commit config file. * Add yapf hook to format python code. * Add Remove CRLF * Update pre-commit-config * Check all files by pre commit hooks * Bug fix in testing mode. * Refine clang-format for Paddle style * fix url of sub-pages * added resnet lstm architecture from GNMT * modify document directory structure in model config helpers * Revert "fix url of sub-pages" * Add ScalingProjection out = w * input where w is a parameter of size 1 Change-Id: Ife682d62323ceb1a20cbbf6269421b20a862d888 * Fix unittest Change-Id: Ic80845c892c96c37a0df0ddc433fe1aeaa5a9d1c * Fix forwardTest for ids in python swig. * unittest need to be added. But fix the bugs first. * Bumping up version number to v0.9.0a0 * Fix some problems in Debian build scripts. * Mount local Paddle instead of git clone from remote. * Use official chinese ubuntu source instead of 163 mirror. * Update dockerfile tags * Add version check for paddle * Refine ver2num function, add comments * Fix Debian package name in ubuntu install docs. * Fix PaddlePaddle#486 * Change demo datafile location by using CDN in baidu. * merge bugfix PaddlePaddle#593 and # 597 from develop branch * Bumping up version number * Add Release notes * Refine documentation in RELEASE.md * fix dead link for quick start * update * Fix Travis-CI build for release * Remove typo in documentation. * fix typo

Put the keys / secrets in for PaddlePaddle.org scripts to use

* fix peoples daily * revert msra

- PaddlePaddle/PaddleNLP#7648 (comment)

wen-bo-yang and others added 5 commits October 20, 2016 17:11

fix error in doc of quick_start

56f5a23

the name of dataprovider is "dataprovider_bow" in quick_start , but neme of dataprovider is "dataprovider_pow" below the "Define Python Data Provider in Configuration files"

Merge pull request #1 from baidu/develop

d08c877

合并作者更新代码

add protostr file for unitest and modify check.md and modify generate…

2b4ff3a

…_protostr.sh

add directory protostr

f5fe91b

wen-bo-yang mentioned this pull request Nov 5, 2016

Use original protostr for unittest of trainer_config_helper #342

Closed

luotao1 reviewed Nov 5, 2016

View reviewed changes

luotao1 assigned reyoung and luotao1 Nov 5, 2016

modify run_tests.sh do not use check.md5 file

5afa062

test

bbc3f07

wen-bo-yang added 2 commits November 6, 2016 05:54

modify run_test.sh use diff command, and deleted check_protostr_diff.sh

8989322

modiry run_test.sh use diff command

85a5f44

wen-bo-yang commented Nov 6, 2016

View reviewed changes

reyoung requested changes Nov 7, 2016

View reviewed changes

modify run_tests.sh file and delete check.md5 file

defdce7

luotao1 reviewed Nov 7, 2016

View reviewed changes

modify run_test.sh delete mv command

cf0e5c4

luotao1 reviewed Nov 7, 2016

View reviewed changes

luotao1 approved these changes Nov 7, 2016

View reviewed changes

reyoung approved these changes Nov 7, 2016

View reviewed changes

reyoung added the enhancement label Nov 7, 2016

reyoung added this to the 0.9.0 milestone Nov 7, 2016

reyoung merged commit c64cd6f into PaddlePaddle:develop Nov 7, 2016

luotao1 mentioned this pull request Nov 9, 2016

Python unit test is using md5sum, a command doesn't come with Mac OS X #344

Closed

reyoung mentioned this pull request Nov 9, 2016

Update contribute_to_paddle.md #403

Closed

zhhsplendid pushed a commit to zhhsplendid/Paddle that referenced this pull request Sep 25, 2019

Merge pull request PaddlePaddle#363 from PaddlePaddle/deploy-indexes-s3

d3914ae

Put the keys / secrets in for PaddlePaddle.org scripts to use

thisjiang pushed a commit to thisjiang/Paddle that referenced this pull request Oct 28, 2021

add mkldnn support (PaddlePaddle#363)

de98a1c

wangxicoding pushed a commit to wangxicoding/Paddle that referenced this pull request Dec 9, 2021

Fix peoples daily dataset (PaddlePaddle#363)

81e7286

* fix peoples daily * revert msra

AnnaTrainingG pushed a commit to AnnaTrainingG/Paddle that referenced this pull request Sep 19, 2022

modify lapstyle doc (PaddlePaddle#363)

f66de7f

AnnaTrainingG pushed a commit to AnnaTrainingG/Paddle that referenced this pull request Dec 6, 2023

Allow rotary embeddings for Bert (PaddlePaddle#363)

684196b

WAYKEN-TSE pushed a commit to WAYKEN-TSE/Paddle that referenced this pull request Dec 6, 2024

fix blip2 dtype (PaddlePaddle#363)

5ce01bb

- PaddlePaddle/PaddleNLP#7648 (comment)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

generate protostr files with current config files #363

generate protostr files with current config files #363

wen-bo-yang commented Nov 5, 2016

coveralls commented Nov 5, 2016

luotao1 Nov 5, 2016

wen-bo-yang Nov 5, 2016

wen-bo-yang Nov 5, 2016

luotao1 Nov 5, 2016

wen-bo-yang Nov 5, 2016

coveralls commented Nov 5, 2016

emailweixu commented Nov 5, 2016

wen-bo-yang commented Nov 6, 2016

coveralls commented Nov 6, 2016

wen-bo-yang left a comment

coveralls commented Nov 6, 2016

reyoung Nov 7, 2016

reyoung Nov 7, 2016

luotao1 Nov 7, 2016

wen-bo-yang Nov 7, 2016

luotao1 Nov 7, 2016

wen-bo-yang Nov 7, 2016

coveralls commented Nov 7, 2016

coveralls commented Nov 7, 2016

luotao1 Nov 7, 2016

generate protostr files with current config files #363

generate protostr files with current config files #363

Conversation

wen-bo-yang commented Nov 5, 2016

coveralls commented Nov 5, 2016

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

coveralls commented Nov 5, 2016

emailweixu commented Nov 5, 2016

wen-bo-yang commented Nov 6, 2016

coveralls commented Nov 6, 2016

wen-bo-yang left a comment

Choose a reason for hiding this comment

coveralls commented Nov 6, 2016

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

coveralls commented Nov 7, 2016

coveralls commented Nov 7, 2016

Choose a reason for hiding this comment