luz 0.3.1
- Re-submission to fix vignette rendering.
luz 0.3.0
Breaking changes
lr_finder()
now by default divides the range between
start_lr
and end_lr
into log-spaced intervals,
following the fast.ai implementation. Cf. Sylvain Gugger’s post:
https://sgugger.github.io/how-do-you-find-a-good-learning-rate.html. The
previous behavior can be achieved passing
log_spaced_intervals=FALSE
to the function. (#82, @skeydan)
plot.lr_records()
now in addition plots an
exponentially weighted moving average of the loss (again, see Sylvain
Gugger’s post), with a weighting coefficient of 0.9
(which
seems a reasonable value for the default setting of 100
learning-rate-incrementing intervals). (#82, @skeydan)
Documentation
- Many wording improvements in the getting started guides (#81 #94,
@jonthegeek).
New features
- Added MixUp callback and helper loss function and functional logic.
(#82, @skeydan).
- Added a
luz_callback_gradient_clip
inspired by FastAI’s
implementation. (#90)
- Added a
backward
argument to setup
allowing one to customize how backward
is called for the
loss scalar value. (#93)
- Added the
luz_callback_keep_best_model()
to reload the
weights from the best model after training is finished. (#95)
luz 0.2.0
New features
- Allow users to provide the minimum and maximum number of epochs when
calling
fit.luz_module_generator()
. Removed
ctx$epochs
from context object and replaced it with
ctx$min_epochs
and ctx$max_epochs
(#53, @mattwarkentin).
- Early stopping will now only occur if the minimum number of training
epochs has been met (#53, @mattwarkentin).
- Added
cuda_index
argument to accelerator
to allow selecting an specific GPU when multiple are present (#58, @cmcmaster1).
- Implemented
lr_finder
(#59, @cmcmaster1).
- We now handle different kinds of data arguments passed to
fit
using the as_dataloader()
method
(#66).
valid_data
can now be scalar value indicating the
proportion of data
that will be used for fitting. This only
works if data
is a torch dataset or a list. (#69)
- You can now supply
dataloader_options
to
fit
to pass additional information to
as_dataloader()
. (#71)
- Implemented the
evaluate
function allowing users to get
metrics from a model in a new dataset. (#73)
Bug fixes
- Fixed bug in CSV logger callback that was saving the logs as a space
delimited file (#52, @mattwarkentin).
- Fixed bug in the length of the progress bar for the validation
dataset (#52, @mattwarkentin).
- Fixed bugs in early stopping callback related to them not working
properly when
patience = 1
and when they are specified
before other logging callbacks. (#76)
Internal changes
ctx$data
now refers to the current in use
data
instead of always refering to
ctx$train_data
. (#54)
- Refactored the
ctx
object to make it safer and avoid
returing it in the output. (#73)
luz 0.1.0
- Added a
NEWS.md
file to track changes to the
package.