Skip to content

Add quantization library #719

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

atvasilopoulos
Copy link
Collaborator

Description

Integrated a quantization library (based on this repo) in AIHWKit to extend its functionality for mixed-precision analog-digital hardware-aware training and simulations.

Details

New functionality includes:

  • New tiles and arrays that support quantized periphery and quantized outputs
  • An infrastructure to convert any model to a quantized counterpart with configurable activation/weight precision.
  • Mixed-precision training with analog layers being trained in the conventional AIHWKit manner and quantized modules with conventional QAT methods
  • Post-training quantization methods for any quantized module or tile, to avoid the necessity of retraining when possible

An example notebook is included that demonstrates the new functionality as well as docstring-based documentation of thew new methods and data structures.

NOTE: To adhere to black requirements, some edits were made to files independent of the current PR (merged by previous PRs)

@PabloCarmona
Copy link
Collaborator

Seems like the pipeline is stuck, can you update with master and try rerun the pipeline @atvasilopoulos ? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants