This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | Next revision Both sides next revision | ||
how_to_start_up_a_startup [2020/04/27 08:52] admin [Example: Neuracore.ai] |
how_to_start_up_a_startup [2020/05/17 07:32] admin [Example: Neuracore.ai] |
||
---|---|---|---|
Line 161: | Line 161: | ||
=== Rejected and company closed === | === Rejected and company closed === | ||
- | After considering many designs, including analog and ternary weights, I ended up with 4 bit weights and activations. This achieves the goals albeit uncomfortably similar to the TPU. The scale of work needed to make the trainsition from fp32/fp16 to 4bit is too great - the first prototype would be noticed by the giants and the company would be overtaken and left worthless. | + | After considering many designs, including analog and ternary weights, I ended up with 4 bit weights and activations. This achieves the goals albeit uncomfortably similar to the TPU. The scale of work needed to make the trainsition from fp32/fp16 to 4bit is too great - the first prototype would be noticed by the giants and the company would be overtaken (defending IP is very expensive). This could well lead to a forced sale which isn't great for anyone (expecially founders/Ordinary share holders). |
Start October 2018, end February 2019, minimal external costs. | Start October 2018, end February 2019, minimal external costs. | ||