File:Optimal ratio of training tokens to model parameters for Chinchilla scaling law.png
Size of this preview: 800 × 500 pixels. Other resolutions: 320 × 200 pixels | 640 × 400 pixels | 1,024 × 640 pixels | 1,280 × 800 pixels | 2,400 × 1,500 pixels.
Original file (2,400 × 1,500 pixels, file size: 156 KB, MIME type: image/png)
 | This is a file from the Wikimedia Commons. Information from its description page there is shown below. Commons is a freely licensed media file repository. You can help. |
Summary
| Description |
English: https://epochai.org/blog/chinchilla-scaling-a-replication-attempt
Original caption: Figure 1: Optimal ratio of training tokens to model parameters using our estimates. Shaded regions represent 80% confidence intervals. While our estimates are consistent with the scaling policy used for Chinchilla, their estimates of their parametric model are not. |
| Date | Apr 17, 2024 |
| Source | https://epochai.org/blog |
| Author | Epoch AI |
Licensing
This file is licensed under the Creative Commons Attribution 4.0 International license.
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 23:10, 24 September 2024 | | 2,400 × 1,500 (156 KB) | Cosmia Nebula | Uploaded a work by Epoch AI from https://epochai.org/blog with UploadWizard |
File usage
The following page uses this file:
