scratchy-grad

2.1.3 • Public • Published

ScratchyGrad

(Because it's from scratch)

Description

This project, inspired by Andrej Karpathy's micrograd and YouTube series, features an autograd implementation in plain Typescript with no dependencies.

TODO

  • [x] Refactor the model API towards pytorch's (explicitly passing in layers, optimizer object...)
  • [x] Export autograd + MLP wrapper as a package
  • Determine fix for adding more than one layer - currently multiple layers result in exploding gradients
    • [x] Implement Batch Normalization
    • [ ] Ensure gradients are healthy looking
  • [ ] Add Embedding layer

/scratchy-grad/

    Package Sidebar

    Install

    npm i scratchy-grad

    Weekly Downloads

    0

    Version

    2.1.3

    License

    ISC

    Unpacked Size

    42.3 kB

    Total Files

    17

    Last publish

    Collaborators

    • nossonh