You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 12:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot3s.osadl.org (updated Sat Mar 14, 2026 00:45:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
239420199901,4cyclictest150-21pr/ttyS219:45:030
2394201998629,40cyclictest2463204-21ssh23:30:060
2394201998629,40cyclictest2463204-21ssh23:30:060
2394201998529,51cyclictest2406611-21ssh21:23:440
2394201998529,51cyclictest2406611-21ssh21:23:430
239420199842,5cyclictest2451778-21munin-run23:05:010
239420199832,75cyclictest2431611-21ssh22:20:010
239420199812,42cyclictest2422736-21ssh22:00:000
2394201998018,33cyclictest2439262-21ssh22:36:420
239420199801,74cyclictest48-21kcompactd022:05:140
239420199801,49cyclictest2494089-21rm00:39:320
239420199782,46cyclictest2424944-21munin-run22:05:010
239420199782,46cyclictest2424944-21munin-run22:05:010
2394201997822,51cyclictest2484907-21ssh00:19:050
239420199751,4cyclictest2448326-21sshd22:57:020
2394201997420,44cyclictest16850irq/134-800000022:26:070
239420199731,7cyclictest2489884-21cut00:30:000
2394207997228,39cyclictest2450382-21sh23:01:351
239420199711,6cyclictest2427481-21ssh22:10:150
2394207997011,56cyclictest2400376-21diskmemload21:40:011
2394201997028,25cyclictest2486242-21ssh00:21:390
239420199702,39cyclictest2478612-21munin-run00:05:000
239420199702,39cyclictest2460061-21sshd23:23:230
239420199701,51cyclictest2419239-21ssh21:51:580
239420199701,51cyclictest2419239-21ssh21:51:570
2394201997012,53cyclictest16850irq/134-800000021:18:200
239420199701,16cyclictest2437275-21ssh22:32:210
239421599695,28cyclictest2422524-21ssh21:59:333
239420199691,64cyclictest2461735-21ssh23:26:590
239420199691,36cyclictest2432134-21ssh22:20:390
239420199691,2cyclictest0-21swapper/000:10:020
2394211996812,35cyclictest311-21rs:main2
2394201996843,21cyclictest16850irq/134-800000023:40:560
2394201996820,43cyclictest16850irq/134-800000021:48:290
2394201996819,44cyclictest2412579-21ssh21:37:050
2394207996728,35cyclictest2467387-21/usr/sbin/munin23:40:001
2394201996729,34cyclictest2400915-21ssh21:10:430
239420199672,60cyclictest2481201-21ssh00:10:240
239420199671,61cyclictest2458512-21latency_hist23:20:020
239420199671,5cyclictest2446589-21ssh22:53:200
239420199671,5cyclictest0-21swapper/023:45:390
239420199671,2cyclictest0-21swapper/021:45:020
239420199671,16cyclictest2476148-21sh23:59:300
2394201996627,23cyclictest2441156-21ssh22:40:530
2394201996610,48cyclictest2394658-21cron19:19:590
2394201996531,30cyclictest2411743-21grep21:35:020
239420199652,58cyclictest2397273-21munin-run20:10:010
2394201996519,41cyclictest2395696-21latency_hist19:40:010
2394211996454,6cyclictest2458506-21kworker/2:100:15:012
239420799644,20cyclictest2397012-21modprobe20:05:011
2394207996422,37cyclictest2483029-21sh00:14:531
2394207996422,36cyclictest1-21systemd19:25:001
2394201996437,24cyclictest16950irq/224-800000020:00:010
239420199643,55cyclictest2400342-21sshd21:06:230
2394201996421,39cyclictest2407997-21ssh21:26:350
2394215996314,10cyclictest37-21ksoftirqd/321:25:013
2394215996314,10cyclictest37-21ksoftirqd/321:25:003
239420199632,56cyclictest2399340-21munin-run20:49:590
239420199632,56cyclictest2397009-21munin-run20:05:010
239420199631,5cyclictest0-21swapper/020:35:450
2394207996221,36cyclictest2416803-21rm21:46:271
2394207996216,41cyclictest2420255-1kworker/u9:122:51:481
239420199621,51cyclictest16850irq/134-800000023:35:350
239420199621,2cyclictest0-21swapper/000:32:010
239421199612,46cyclictest2463168-21ssh23:30:022
239421199612,46cyclictest2463168-21ssh23:30:012
2394201996127,30cyclictest2398214-21sed20:25:010
239420199612,54cyclictest16850irq/134-800000023:05:240
239420199611,6cyclictest2472275-21sshd23:50:240
239420199611,3cyclictest0-21swapper/023:10:240
239420799606,47cyclictest2420460-21munin-plugin-st21:55:011
239420799606,47cyclictest2420460-21munin-plugin-st21:55:001
239420799604,47cyclictest2489976-21wc00:30:021
2394207996030,26cyclictest2408982-21sh21:29:051
2394207996013,40cyclictest23-21ksoftirqd/122:50:001
2394201996042,13cyclictest16950irq/224-800000020:20:010
2394211995949,6cyclictest2458506-21kworker/2:100:35:022
2394211995947,6cyclictest2397537-21kworker/2:021:16:572
2394207995928,27cyclictest1-21systemd00:40:011
2394207995921,33cyclictest309-21in:imuxsock20:45:031
2394207995916,38cyclictest0-21swapper/121:05:011
239420199592,53cyclictest48-21kcompactd022:47:000
239420199592,52cyclictest2394938-21munin-run19:25:010
239420199591,15cyclictest2398385-21cat20:30:020
2394215995838,15cyclictest3467602-21systemd-journal00:00:003
2394211995846,7cyclictest2458506-21kworker/2:100:35:362
2394211995846,6cyclictest2429736-21kworker/2:122:31:002
239420799586,8cyclictest2394389-21modprobe19:15:001
2394207995814,40cyclictest2432311-1kworker/u9:022:31:381
239420799581,12cyclictest2432316-21ssh22:21:051
239420799581,11cyclictest2404271-21ssh21:18:261
239420199582,51cyclictest2398569-21munin-run20:35:010
2394215995712,10cyclictest37-21ksoftirqd/322:41:533
2394211995748,6cyclictest2436153-21kworker/2:322:55:012
2394211995747,7cyclictest2451773-21kworker/2:223:37:422
239420799572,7cyclictest2460717-21munin-run23:25:021
239420799572,17cyclictest2468973-21sshd23:43:231
239420799572,16cyclictest2479747-21ssh00:07:211
2394207995712,39cyclictest275-21dbus-daemon23:15:011
239420199572,50cyclictest2399853-21munin-run21:00:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional