Local Ollama Performance

Testing with two images:

  • Image 1 - Clydesdale A

Running this model:

admin@titan:~$ ollama show qwen3.8
  Model
    architecture        qwen35     
    parameters          27.3B      
    context length      262144     
    embedding length    5120       
    quantization        Q4_K_M     
    requires            0.32.12    

  Capabilities
    completion    
    vision        
    tools         
    thinking      

  Projector
    architecture        clip       
    parameters          460.73M    
    embedding length    1152       
    dimensions          5120       

  Parameters
    draft_num_predict    4       
    min_p                0       
    presence_penalty     0       
    repeat_penalty       1       
    temperature          1       
    top_k                20      
    top_p                0.95    

  License
    Apache License               
    Version 2.0, January 2004    
    ...

On this hardware:

CPU:
  Info: 8-core model: AMD Ryzen 7 5800H with Radeon Graphics bits: 64
    type: MT MCP arch: Zen 3 rev: 0 cache: L1: 512 KiB L2: 4 MiB L3: 16 MiB
  Speed (MHz): avg: 1103 min/max: 403/4465 boost: enabled cores: 1: 1103
    2: 1103 3: 1103 4: 1103 5: 1103 6: 1103 7: 1103 8: 1103 9: 1103 10: 1103
    11: 1103 12: 1103 13: 1103 14: 1103 15: 1103 16: 1103 bogomips: 102206
  Flags-basic: avx avx2 ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a
    ssse3 svm

Graphics:
  Device-1: Advanced Micro Devices [AMD/ATI] Cezanne [Radeon Vega Series /
    Radeon Mobile Series] driver: amdgpu v: kernel arch: GCN-5 bus-ID: 04:00.0
    temp: 41.0 C
  Device-2: Logitech QuickCam Pro 9000 driver: snd-usb-audio,uvcvideo
    type: USB bus-ID: 1-3.1.1:5
  Display: wayland server: X.Org v: 24.1.13 with: Xwayland v: 24.1.13
    compositor: gnome-shell driver: X: loaded: modesetting dri: radeonsi
    gpu: amdgpu resolution: 1: 3440x1440~60Hz 2: 3440x1440~60Hz
    3: 1720x1440~60Hz
  API: EGL v: 1.5 drivers: radeonsi,swrast platforms:
    active: gbm,wayland,x11,surfaceless,device inactive: N/A
  API: OpenGL v: 4.6 vendor: amd mesa v: 26.1.6 glx-v: 1.4
    direct-render: yes renderer: AMD Radeon Graphics (radeonsi renoir ACO DRM
    3.64 7.1.8-200.fc44.x86_64)
  API: Vulkan v: 1.4.341 drivers: radv,llvmpipe surfaces: N/A devices: 2
  Info: Tools: api: clinfo, eglinfo, glxinfo, vulkaninfo
    de: kscreen-console,kscreen-doctor wl: swaymsg,wayland-info x11: xdriinfo,
    xdpyinfo, xprop, xrandr

Info:
  Memory: total: 28 GiB note: est. available: 28.3 GiB used: 5.54 GiB (19.6%)
  Processes: 475 Uptime: 10h 47m Init: systemd
  Packages: 29 note: see --rpm Compilers: gcc: 16.1.1 Shell: Bash v: 5.3.9
    inxi: 3.3.41

admin@titan:~$ date ; time ollama run qwen3.8 "What is in this image? /tmp/image2.jpg" ; date
Sun Aug 16 12:02:19 PM CDT 2026
Added image '/tmp/image2.jpg'
Thinking...
The user wants a description of the image. Let me look carefully at what's present.

Central subject: a horse, standing in profile facing right. It's brown (bay) with a dark mane and tail, and notably white markings on its legs (the hind legs especially look 
feathered/white) and a white blaze on its face. It appears to be a draft-type horse given the feathering on the lower legs. It has a halter/bridle on, light colored.

Setting: grassy field/field with green grass in foreground. Behind the horse is a row of coniferous trees—looks like a plantation of Norfolk pines or similar conifers, evenly 
spaced, young-to-medium trees. Sky is overcast, grayish with clouds.

There's a watermark "gettyimages" and credit "Yvonne Van der Horst" and an image number 1135884110 in the corner.

I should describe concisely and completely. The question is simple: "What is in this image?" So a straightforward description.

I'll mention the horse, its coloring, the halter, the field, the conifer trees, the cloudy sky, and the watermark/credit.

Keep it natural, no need for headers. Final answer in English.
...done thinking.

The image shows a single horse standing in profile (facing right) in a grassy field. The horse is a bay/brown color with a dark mane and tail, white markings on its face (a 
blaze), and white, feathered lower legs—features typical of a draft-type breed. It is wearing a light-colored halter.

Behind the horse is a line of evenly spaced young coniferous trees (a pine/conifer plantation), and 
above is an overcast, gray, cloudy sky. The foreground is green grass.

There is also a stock-photo watermark across the center reading "gettyimages / Credit: Yvonne Van der 
Horst," and an ID number (1135884110) in the bottom-left corner.


real    3m8.783s
user    0m0.088s
sys 0m0.128s
Sun Aug 16 12:05:28 PM CDT 2026