scratchy-grad

2.1.3 • Public • Published

ScratchyGrad

(Because it's from scratch)

Description

This project, inspired by Andrej Karpathy's micrograd and YouTube series, features an autograd implementation in plain Typescript with no dependencies.

TODO

  • [x] Refactor the model API towards pytorch's (explicitly passing in layers, optimizer object...)
  • [x] Export autograd + MLP wrapper as a package
  • Determine fix for adding more than one layer - currently multiple layers result in exploding gradients
    • [x] Implement Batch Normalization
    • [ ] Ensure gradients are healthy looking
  • [ ] Add Embedding layer

Readme

Keywords

none

Package Sidebar

Install

npm i scratchy-grad

Weekly Downloads

0

Version

2.1.3

License

ISC

Unpacked Size

42.3 kB

Total Files

17

Last publish

Collaborators

  • nossonh