This repository was archived by the owner on Jan 21, 2025. It is now read-only.

This repository was archived by the owner on Jan 21, 2025. It is now read-only.

How to freeze embedding layers #364

Open

lintangsutawika

opened

Hi,

I'm wondering how I might freeze token embedding layers in Unitransformer implementations. All references online seem to point to keras and not implementations with mesh.

mesh/mesh_tensorflow/transformer/transformer.py

Line 697 in 52a2332

class Unitransformer(object):

Thank you

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests