• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

deeplearning4j-examples: Deeplearning4j Examples (DL4J, DL4J Spark, DataVec)

原作者: [db:作者] 来自: 网络 收藏 邀请

开源软件名称:

deeplearning4j-examples

开源软件地址:

https://gitee.com/mirrors/deeplearning4j-examples

开源软件介绍:

                                ########  ##       ##              ##                                ##     ## ##       ##    ##        ##                                ##     ## ##       ##    ##        ##                       **$**    ##     ## ##       ##    ##        ##    **$**                                ##     ## ##       ######### ##    ##                                ##     ## ##             ##  ##    ##                                ########  ########       ##   ######              .   :::: :   :    :   :     : ::::  :     ::::    :::::  :::: ::::  :::::   .              .   :    :   :   : :  ::   :: :   : :     :       :   :  :    :   : :   :   .              .   :     : :   :   : : : : : :   : :     :       :   :  :    :   : :   :   .              .   :::    :    :   : :  :  : ::::  :     :::     :::::  :::  ::::  :   :   .              .   :     : :   ::::: :     : :     :     :       :  :   :    :     :   :   .              .   :    :   :  :   : :     : :     :     :       :   :  :    :     :   :   .              .   :::: :   :  :   : :     : :     ::::: ::::    :    : :::: :     :::::   .

For support, please go over to:https://community.konduit.ai

We do not monitor the github issues of this repository very often.

Introduction

The Eclipse Deeplearning4J (DL4J) ecosystem is a set of projects intended to support all the needs of a JVM based deep learning application. This means starting with the raw data, loading and preprocessing it from wherever and whatever format it is in to building and tuning a wide variety of simple and complex deep learning networks.

The DL4J stack comprises of:

  • DL4J: High level API to build MultiLayerNetworks and ComputationGraphs with a variety of layers, including custom ones. Supports importing Keras models from h5, including tf.keras models (as of 1.0.0-M2) and also supports distributed training on Apache Spark
  • ND4J: General purpose linear algebra library with over 500 mathematical, linear algebra and deep learning operations. ND4J is based on the highly-optimized C++ codebase LibND4J that provides CPU (AVX2/512) and GPU (CUDA) support and acceleration by libraries such as OpenBLAS, OneDNN (MKL-DNN), cuDNN, cuBLAS, etc
  • SameDiff : Part of the ND4J library, SameDiff is our automatic differentiation / deep learning framework. SameDiff uses a graph-based (define then run) approach, similar to TensorFlow graph mode. Eager graph (TensorFlow 2.x eager/PyTorch) graph execution is planned. SameDiff supports importing TensorFlow frozen model format .pb (protobuf) models. Import for ONNX, TensorFlow SavedModel and Keras models are planned. Deeplearning4j also has full SameDiff support for easily writing custom layers and loss functions.
  • DataVec: ETL for machine learning data in a wide variety of formats and files (HDFS, Spark, Images, Video, Audio, CSV, Excel etc)
  • Arbiter: Library for hyperparameter search
  • LibND4J : C++ library that underpins everything. For more information on how the JVM accesses native arrays and operations refer to JavaCPP

All projects in the DL4J ecosystem support Windows, Linux and macOS. Hardware support includes CUDA GPUs (10.0, 10.1, 10.2 except OSX), x86 CPU (x86_64, avx2, avx512), ARM CPU (arm, arm64, armhf) and PowerPC (ppc64le).

Prerequisites

This example repo consists of several separate Maven Java projects, each with their own pom files. Maven is a popular build automation tool for Java Projects. The contents of a "pom.xml" file dictate the configurations. Read more about how to configure Maven here.

Users can also refer to the simple sample project provided to get started with a clean project from scratch.

Build tools are considered standard software engineering best practice. Besides this the complexities posed by the projects in the DL4J ecosystem make dependencies too difficult to manage manually. All the projects in the DL4J ecosystem can be used with other build tools like Gradle, SBT etc. More information on that can be found here.

Support

For help with the examples, please go to our support forum

Note for users of 1.0.0-beta7 and prior, some examples and modules have been removed to reflectchanges in the framework's direction. Please see and comment on our post here

If you would like a workaround for something you may be missing,please feel free to post on the forums, and we will do what we can to help you.

Example Content

Projects are based on what functionality the included examples demonstrate to the user and not necessarily which library in the DL4J stack the functionality lives in.

Examples in a project are in general separated into "quickstart" and "advanced".

Each project README also lists all the examples it contains, with a recommended order to explore them in.

  • dl4j-examplesThis project contains a set of examples that demonstrate use of the high level DL4J API to build a variety of neural networks.Some of these examples are end to end, in the sense they start with raw data, process it and then build and train neural networks on it.

  • tensorflow-keras-import-examplesThis project contains a set of examples that demonstrate how to import Keras h5 models and TensorFlow frozen pb models into the DL4J ecosystem. Once imported into DL4J these models can be treated like any other DL4J model - meaning you can continue to run training on them or modify them with the transfer learning API or simply run inference on them.

  • dl4j-distributed-training-examplesThis project contains a set of examples that demonstrate how to do distributed training, inference and evaluation in DL4J on Apache Spark. DL4J distributed training employs a "hybrid" asynchronous SGD approach - further details can be found in the distributed deep learning documentation here

  • cuda-specific-examplesThis project contains a set of examples that demonstrate how to leverage multiple GPUs for data-parallel training of neural networks for increased performance.

  • samediff-examplesThis project contains a set of examples that demonstrate the SameDiff API. SameDiff (which is part of the ND4J library) can be used to build lower level auto-differentiating computation graphs. An analogue to the SameDiff API vs the DL4J API is the low level TensorFlow API vs the higher level of abstraction Keras API.

  • data-pipeline-examplesThis project contains a set of examples that demonstrate how raw data in various formats can be loaded, split and preprocessed to build serializable (and hence reproducible) ETL pipelines.

  • nd4j-ndarray-examplesThis project contains a set of examples that demonstrate how to manipulate NDArrays. The functionality of ND4J demonstrated here can be likened to NumPy.

  • rl4j-examplesThis project contains examples of using RL4J, the reinforcement learning library in DL4J.

  • android-examplesThis project contains an Android example project, that shows DL4J being used in an Android application.

Feedback & Contributions

While these set of examples don't cover all the features available in DL4J the intent is to cover functionality required for most users - beginners and advanced. File an issue here if you have feedback or feature requests that are not covered here. We are also available via our community forum for questions.We welcome contributions from the community. More information can be found hereWe love hearing from you. Cheers!


鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
上一篇:
MSC: A Dataset for Macro-Management in StarCraft II.发布时间:2022-03-24
下一篇:
Ohos-Goldfinger: 简化身份人脸验证实现发布时间:2022-03-24
热门推荐
热门话题
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap