Difference between revisions of "ALPHA-One"

From PINE64
Jump to navigation Jump to search
(Created page with "400px|thumb|right|The ALPHA-One The '''StarPro64''' is a RISC-V based Single Board Computer powered by ESWIN EIC7700X Quad-Core SiFive P550 1.8GHz 64-Bit CPU, Imagination Technology AXM-8-256 GPU, 20TOPS NPU, and supports up to 32GB 64bit 6400MHz LPDDR5 memory. It provides an eMMC module socket, MicroSD Card slot, PCI-e, Pi-2 Bus, USB 3.0, and many other peripheral interfaces for makers to integrate with sensors and other devices. File:RISC-V.p...")
 
 
(11 intermediate revisions by the same user not shown)
Line 1: Line 1:
[[File:Alpha-One.jpg|400px|thumb|right|The ALPHA-One]]
[[File:Alpha-One.jpg|400px|thumb|right|The ALPHA-One]]


The '''StarPro64''' is a RISC-V based Single Board Computer powered by ESWIN EIC7700X Quad-Core SiFive P550 1.8GHz 64-Bit CPU, Imagination Technology AXM-8-256 GPU, 20TOPS NPU, and supports up to 32GB 64bit 6400MHz LPDDR5 memory. It provides an eMMC module socket, MicroSD Card slot, PCI-e, Pi-2 Bus, USB 3.0, and many other peripheral interfaces for makers to integrate with sensors and other devices.
The '''ALPHA-One''' is a Generative 7b LLM AI Agent based on StarPro64 board  RISC-V based Single Board Computer with 20TOPS(int 8) NPU capability, and preinstalled 64G eMMC module contains 7b Deepseek/Owen LLM build in docker form.


[[File:RISC-V.png|600px|]]


== Software releases ==
== Software releases ==


The releases are still in '''alpha''' state and are only fit for development and testing purposes.
This is the production release build 20250627


* The current StarPro64 Linux build actively maintained by PLCT. More information on this image SDK can be found at: https://github.com/rockos-riscv
DD image for 64GB eMMC module
* This build contains 7b QWen2 LLM
* Web ui access link http://alpha-one.local:8000/
* [https://files.pine64.org/os/StarPro64/Alpha-ONE%20image-20250627.img.gz Direct download from PINE64 file server]
** MD5 (GZip file): d62eeb1645c7b496a0815c4590f798c7
** File Size: 18.10GB


* The last image build can be found at: https://fast-mirror.isrc.ac.cn/rockos/images/generic/latest/
{| class="wikitable"
!colspan="2" style="background: #a7d7f9;"| Default credentials
|-
! Super user
| <code>eswin/eswin</code>
|}
 
 
This is the early test build that contains both 7b Deepseek and QWen2 LLM build, OS based on ROCKOS.
 
DD image for 32GB eMMC module and above
* for larger than 32GB eMMC, please use gpart to extend the file partition.
* [https://files.pine64.org/SDK/StarPro64/Alpha-ONE_OS_build_32GB-20250420.img.gz Direct download from PINE64 file server]
** MD5 (GZip file): 6669a436104e97e2ad90679e06f62d78
** File Size: 18.21GB
 
{| class="wikitable"
!colspan="2" style="background: #a7d7f9;"| Default credentials
|-
! Super user
| <code>eswin/eswin</code>
|}
 
To explore LLM, use terminal program and execute below command lines:
 
deepseek 7bLLM command line：
sudo /opt/eswin/sample-code/npu_sample/qwen_sample/bin/es_qwen2 /opt/eswin/sample-code/npu_sample/qwen_sample/src/deepseek_r1_distill_qwen_7b/config.json
 
qwen2 7bLLM command line：
sudo /opt/eswin/sample-code/npu_sample/qwen_sample/bin/es_qwen2 /opt/eswin/sample-code/npu_sample/qwen_sample/src/qwen2_7b/config.json
qwen2 0.5bLLM command line：
sudo /opt/eswin/sample-code/npu_sample/qwen_sample/bin/es_qwen2 /opt/eswin/sample-code/npu_sample/qwen_sample/src/qwen2_0_5b/config.json


== SDK releases ==
== SDK releases ==


* SDK document (some in Chinese): https://files.pine64.org/SDK/StarPro64/docs.7z
* SDK document (some in Chinese): https://files.pine64.org/SDK/StarPro64/docs.7z
** MD5 (7Zip file): 8ee9b660c336d9979191d212e9826226
** File Size: 34MB
* SDK Release:
* SDK Release:
** 20250228: https://files.pine64.org/SDK/StarPro64/EIC7x_AI_Release_20250228.7z
** 20250228: https://files.pine64.org/SDK/StarPro64/EIC7x_AI_Release_20250228.7z
** MD5 (7Zip file): f9171ec8b30e5d4d8eda1185f72af5e4
** File Size: 1.932GB
** 20250330: https://files.pine64.org/SDK/StarPro64/EIC7x_AI_Release_20250330.7z
** MD5 (7Zip file): 8ddc861755ed26785e67674aad8db87c
** File Size: 1.946GB
* LLM and tools release:
* LLM and tools release:
** LLM 20250228: https://files.pine64.org/SDK/StarPro64/deepseek&qwen-v0228.7z
** LLM 20250228: https://files.pine64.org/SDK/StarPro64/deepseek&qwen-v0228.7z
** MD5 (7Zip file): b8ee72ee6a8912afefac3fa43a18be87
** File Size: 722MB
** Tools 20250228: https://files.pine64.org/SDK/StarPro64/EIC7x_nn-tools_Release_20250228.7z
** Tools 20250228: https://files.pine64.org/SDK/StarPro64/EIC7x_nn-tools_Release_20250228.7z
** MD5 (7Zip file): 868434b274412e173c3e264118dcb336
** File Size: 6.625GB




== SoC and Memory Specification ==
== Main Board and SoC Specification ==
* Based on [https://www.eswincomputing.com/en/products/index/36/10.html ESWIN EIC7700X]
* Based on [https://wiki.pine64.org/wiki/STARPro64 StarPro64 Single Board Computer wiki page]
* Based on [https://www.eswincomputing.com/en/products/index/36/10.html ESWIN EIC7700X SoC]


[[File:eswin_uk_logo.jpg|right]]
[[File:eswin_uk_logo.jpg|right]]
[[File:EIC7700X_Block_Diagram.png|800px]]
[[File:EIC7700X_Block_Diagram.png|800px]]


=== CPU Architecture ===
* [https://www.sifive.com/cores/performance-p500 Quad-core P550 up to 1.8GHz CPU]
[[File:SiFive.jpg|right|200px]]
* Fully compliant with the RISC-V RV64GBC ISA specification
* 64-bit RISC-V Application Core
* Features 13-stage, triple-issue, out-of-order pipeline
* 32KB L1 I-cache with ECC
* 32KB L1 D-cache with ECC
* Private 256KB L2 Cache
* Shared 4MB L3 Cache


=== GPU Architecture ===
* [https://www.imaginationtech.com/product/img-axm-8-256/ Imagination Technology AXM-8-256 up to 600Mhz GPU]
[[File:imgtech.png|right|200px]]
* Support OpenCL 3.0
* Support OpenGL ES 3.x
* Support Vulkan 1.3
* 128-wide arithmetic logic unit (ALU) design
* Visually Lossless image compression – frame buffer compression and decompression (FBCDC) algorithm
* Lossless data compression – geometry compression, which is performed in the Geometry Processing phase of the 3D graphics workload
* Performance: 256 FP32 FLOPs/Clock, 1024 AI  INT8/Clock


=== NPU Architecture ===
== Features ==
* 19.95 TOPS(INT8), 9.975TOPS(FP16 or INT16)


=== System Memory ===
=== System Memory ===
* 32GB 64bits LPDDR5@6400MHz RAM Memory.
* 32GB 64bits LPDDR5@6400MHz RAM Memory.
* 64GB eMMC preintsalled with 7b Deepseek/Qwen LLM


== Board Features ==
=== Case ===
 
* CNC from single Aluminum block
=== Video ===
* Passive cooling, built-in heat pipe that directly contact with SoC
* Digital Video output up to 4K@60Hz
* H.264/AVC Base/Main/High/High10 profile @ level 5.1; up to 4K&times;2K @ 60fps
* H.265/HEVC Main/Main10 profile @ level 5.1 High-tier; up to 4K&times;2K @ 60fps
 
=== Audio ===
* 3.5mm audio Jack


=== Network ===
=== Network ===
* Dual 10/100/1000Mbps Ethernet  
* Dual 10/100/1000Mbps Ethernet  
* 2.4GHz/5Ghz MIMO WiFi 802.11 b/g/n/ac/ax with Bluetooth 5.3
* 2.4GHz/5GHz MIMO WiFi 802.11 b/g/n/ac/ax with Bluetooth 5.3


=== Storage ===
=== Expansion Ports ===
* on-board 128Mbit (16MByte) XSPI NOR flash memory - bootable
* microSD - bootable, supports SDHC and SDXC and storage up to 256GB
* eMMC - bootable (optional eMMC Module)
* 2&times; USB3.0 Dedicated Host port
* 2&times; USB3.0 Dedicated Host port
* 2&times; USB2.0 Shared Host port
* 2&times; USB2.0 Shared Host port
* Digital Video output up to 4K@60Hz
* 3.5mm audio Jack with mic in


=== Expansion Ports ===
* PCIe Gen3 &times;4 lane
* 2&times;20 pins "Pi2" GPIO Header
* 4 lane MiPi DSI port for LCD panel
* 4 lane MiPi CSI port for camera module
== Board Information, Schematics and Certifications ==
Model "A" Baseboard Dimensions: 133mm&times;80mm&times;19mm


Input Power: DC 12V @ 3-5A 5.5mmOD/2.1mmID center-positive Barrel DC Jack connector
== Certifications ==
 
Schematic:
* [https://files.pine64.org/doc/starpro64/StarPro64_schematic_v2.0-20250310.pdf StarPro64 Schematic 20250310 v2.0 (Production Released version)]
* [https://files.pine64.org/doc/starpro64/StarPro64_v2.0_Component_Placement_Top-20250310.pdf StarPro64 Component Reference location v2.0 (top layer)]
* [https://files.pine64.org/doc/starpro64/StarPro64_v2.0_Component_Placement_Bottom-20250310.pdf StarPro64 Component Reference location v2.0 (bottom layer)]
 
 
Certifications:
* Disclaimer: Please note that PINE64 SBC is not a "final" product and in general certification is not necessary. However, PINE64 still submits the SBC for FCC, CE, and ROHS certifications and obtain the certificates to prove that the SBC board can pass the testing. Please note, a final commercial product needs to perform its own testing and obtain its own certificate.
* Not yet available
* Not yet available




== Datasheets for Components and Peripherals ==
== Potential Improvement ==
 
* Current 7bLLM throughput is around 3.5 tokens/second using docker form, potential improve upto 10 tokens/second  when operates LLM in native mode.
ESWIN EIC7700X SoC information:
* Potential increase LLM capability from 7b to 15b with system software optimization
* [https://www.eswincomputing.com/en/bocupload/2024/06/19/17187920991529ene8q.pdf ESWIN EIC7700X SoC Product Brief]
* If ALPHA-One proven its potential, consider release ALPHA-Two which can host up to 30b LLM
* [https://www.sifive.com/document-file/eic7700x-datasheet ESWIN EIC7700X SoC Datasheet]
 
LPDDR5 (315 Balls) SDRAM:
* [https://files.pine64.org/doc/datasheet/starpro64/RS4G32LO5D8FDB-31BT.V1.0.pdf Rayson LPDDR5 Datasheet]
 
eMMC information:
* [https://files.pine64.org/doc/rock64/PINE64_eMMC_Module_20170719.pdf PINE64 eMMC module schematic]
* [https://files.pine64.org/doc/rock64/usb%20emmc%20module%20adapter%20v2.pdf PINE64 USB adapter for eMMC module V2 schematic]
* [https://files.pine64.org/doc/rock64/USB%20adapter%20for%20eMMC%20module%20PCB.tar PINE64 USB adapter for eMMC module PCB in JPEG]
* [https://files.pine64.org/doc/datasheet/pine64/E-00517%20FORESEE_eMMC_NCEMAM8B-16G%20SPEC.pdf 16GB Foresee eMMC Datasheet]
* [https://files.pine64.org/doc/datasheet/pine64/SDINADF4-16-128GB-H%20data%20sheet%20v1.13.pdf 32GB/64GB/128GB SanDisk eMMC Datasheet]
 
SPI NOR Flash information:
* [https://files.pine64.org/doc/datasheet/star64/gd25lq128e_rev1.0_20210513.pdf GigaDevice 128Mb XSPI-Flash Datasheet]
 
Ethernet related info:
* TBA
 
WiFi/BT module info:
* [https://files.pine64.org/doc/datasheet/starpro64/AIC8800D80_DataSheet_v0.1.pdf AIC AIC8800D80 11AX Dual Band WiFi + Bluetooth5.3 Datasheet]
 
== Bringup Notes ==
* [https://lupyuen.org/articles/starpro64.html Lup Yuen's StarPro64 bring up article section 1-7]








[[Category:STARPRO64]] [[Category:ESWIN EIC7700X]]
[[Category:ALPHA-One]]

Latest revision as of 21:07, 29 June 2025

The ALPHA-One

The ALPHA-One is a Generative 7b LLM AI Agent based on StarPro64 board RISC-V based Single Board Computer with 20TOPS(int 8) NPU capability, and preinstalled 64G eMMC module contains 7b Deepseek/Owen LLM build in docker form.


Software releases

This is the production release build 20250627

DD image for 64GB eMMC module

Default credentials
Super user eswin/eswin


This is the early test build that contains both 7b Deepseek and QWen2 LLM build, OS based on ROCKOS.

DD image for 32GB eMMC module and above

Default credentials
Super user eswin/eswin

To explore LLM, use terminal program and execute below command lines:

deepseek 7bLLM command line： sudo /opt/eswin/sample-code/npu_sample/qwen_sample/bin/es_qwen2 /opt/eswin/sample-code/npu_sample/qwen_sample/src/deepseek_r1_distill_qwen_7b/config.json

qwen2 7bLLM command line： sudo /opt/eswin/sample-code/npu_sample/qwen_sample/bin/es_qwen2 /opt/eswin/sample-code/npu_sample/qwen_sample/src/qwen2_7b/config.json

qwen2 0.5bLLM command line： sudo /opt/eswin/sample-code/npu_sample/qwen_sample/bin/es_qwen2 /opt/eswin/sample-code/npu_sample/qwen_sample/src/qwen2_0_5b/config.json

SDK releases



Main Board and SoC Specification

Eswin uk logo.jpg

EIC7700X Block Diagram.png


Features

System Memory

  • 32GB 64bits LPDDR5@6400MHz RAM Memory.
  • 64GB eMMC preintsalled with 7b Deepseek/Qwen LLM

Case

  • CNC from single Aluminum block
  • Passive cooling, built-in heat pipe that directly contact with SoC

Network

  • Dual 10/100/1000Mbps Ethernet
  • 2.4GHz/5GHz MIMO WiFi 802.11 b/g/n/ac/ax with Bluetooth 5.3

Expansion Ports

  • 2× USB3.0 Dedicated Host port
  • 2× USB2.0 Shared Host port
  • Digital Video output up to 4K@60Hz
  • 3.5mm audio Jack with mic in


Certifications

  • Not yet available


Potential Improvement

  • Current 7bLLM throughput is around 3.5 tokens/second using docker form, potential improve upto 10 tokens/second when operates LLM in native mode.
  • Potential increase LLM capability from 7b to 15b with system software optimization
  • If ALPHA-One proven its potential, consider release ALPHA-Two which can host up to 30b LLM
Retrieved from "https://wiki.pine64.org/index.php?title=ALPHA-One&oldid=21829"