Hello,
I'm experiencing a persistent JNI crash in my Android app when trying to load ggml-small.bin and ggml-small-q8_0.bin models using a recent version of whisper.cpp and ggml (latest from GitHub master).
Key Issues:
Crash Point: The app crashes consistently inside whisper_init_from_file_with_params, specifically at ggml_backend_dev_backend_reg (offset +12 in the function, or +288 from Java_com_undefault_alma_data_remote_WhisperBridge_transcribe).
system_info Output: The whisper_print_system_info() in Android Logcat only shows WHISPER : COREML = 0 | OPENVINO = 0 |. It does not show NEON = 1, even though I'm targeting aarch64-none-linux-android29 and have tried enabling NEON in CMakeLists.txt with:
set(CMAKE_C_FLAGS "${CMAKE_C_FLAGS} -march=armv8-a+simd")
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -march=armv8-a+simd")
target_compile_definitions(whisper_jni PRIVATE GGML_NEON=1)
Build: The native library (libwhisper_jni.so) is confirmed to be recompiling (BuildId changes after clean rebuilds).
Environment:
Android NDK: 27.0.12077973
Target ABI: aarch64-none-linux-android29 (tested on Galaxy S24 Ultra)
Model used: ggml-small.bin (non-quantized) and ggml-small-q8_0.bin
Logcat Snippet (Crash & System Info):
I/WhisperBridge: 🔍 v1.1 Memuat model dari: /data/user/0/com.package.name/files/ggml-small.bin
I/WhisperBridge: ℹ️ Informasi Sistem Whisper:
WHISPER : COREML = 0 | OPENVINO = 0 |
I/WhisperBridge: 🧠 Inisialisasi context dengan backend CPU...
A/DEBUG: #00 pc 0000000000xxxxxx /data/app/.../libwhisper_jni.so (offset 0xyyyyyyyy) (ggml_backend_dev_backend_reg+12) (BuildId: new_build_id)
A/DEBUG: #6 pc 0000000000zzzzzz /data/app/.../libwhisper_jni.so (offset 0xyyyyyyyy) (Java_com_package_name_WhisperBridge_transcribe+288) (BuildId: new_build_id)
(Please replace com.package.name, xxxxxx, yyyyyyyy, zzzzzz, and new_build_id with your actual values from Logcat)
Is this a known issue with recent ggml versions when using .bin models on Android, or is there a specific configuration/compilation flag I might be missing to correctly initialize the CPU backend and enable NEON detection/reporting?
Any guidance would be greatly appreciated. Thank you!
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4