You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 14:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Wed Nov 19, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2482749911111,1106cyclictest515677-21sleep22:20:003
248274993831,379cyclictest364219-21turbostat20:44:563
248274993700,367cyclictest395680-21turbostat21:09:553
248274992219,1cyclictest0-21swapper/319:45:003
24827499208,8cyclictest7106112sleep300:20:143
24827499196,10cyclictest613100-21taskset23:20:023
248274991815,1cyclictest0-21swapper/321:59:593
2577912170,6sleep2421rcuc/219:15:192
248274991714,1cyclictest0-21swapper/300:16:443
248274991613,1cyclictest0-21swapper/321:45:013
248274991613,1cyclictest0-21swapper/319:16:353
248274991613,1cyclictest0-21swapper/300:00:013
24827499155,6cyclictest6843242sleep300:00:543
248274991513,1cyclictest0-21swapper/319:54:293
248274991513,1cyclictest0-21swapper/319:49:153
248274991512,1cyclictest0-21swapper/323:45:243
248274991512,1cyclictest0-21swapper/322:35:003
248274991512,1cyclictest0-21swapper/320:03:013
248274991512,1cyclictest0-21swapper/300:30:213
24827499151,11cyclictest499475-21turbostat22:10:003
24827499151,11cyclictest426705-21taskset21:25:013
24827499151,10cyclictest623003-21taskset23:25:183
24827499150,11cyclictest702220-21turbostat00:15:003
24827499145,7cyclictest571506-21taskset22:53:093
24827499145,7cyclictest571506-21taskset22:53:083
24827499144,7cyclictest375892-21taskset20:45:233
248274991412,1cyclictest0-21swapper/322:46:213
248274991412,1cyclictest0-21swapper/321:55:003
248274991412,1cyclictest0-21swapper/320:40:003
248274991412,1cyclictest0-21swapper/320:20:463
248274991412,0cyclictest0-21swapper/321:23:113
248274991411,1cyclictest0-21swapper/323:35:273
248274991411,1cyclictest0-21swapper/322:39:003
248274991411,1cyclictest0-21swapper/322:03:373
248274991411,1cyclictest0-21swapper/320:53:533
248274991411,1cyclictest0-21swapper/319:56:353
248274991411,1cyclictest0-21swapper/300:05:213
24827499141,10cyclictest592549-21chrt23:05:193
24827499141,10cyclictest580703-21taskset23:00:013
24827499141,10cyclictest383686-21taskset20:55:163
24827499141,10cyclictest284383-21taskset19:35:193
24827499140,11cyclictest604910-21taskset23:15:003
7038122130,4sleep2704083-21kthreadcore00:15:202
4896462130,6sleep1489654-21ssh22:01:381
24827499134,6cyclictest7407412sleep300:35:283
24827499131,9cyclictest662008-21taskset23:50:063
24827499131,9cyclictest572634-21taskset22:55:093
24827499131,9cyclictest410278-21taskset21:15:033
24827499131,9cyclictest351916-21chrt20:30:123
24827499131,8cyclictest6458512sleep323:40:153
248274991311,1cyclictest0-21swapper/319:32:553
24827499131,10cyclictest637109-21turbostat23:35:013
24827499131,10cyclictest531359-21taskset22:29:003
24827499131,10cyclictest442611-21turbostat21:35:003
248274991310,1cyclictest0-21swapper/322:10:213
248274991310,1cyclictest0-21swapper/321:45:203
24827499130,10cyclictest275313-21chrt19:27:583
5212672120,1sleep30-21swapper/322:20:243
24827499129,1cyclictest0-21swapper/322:41:083
24827499121,9cyclictest724638-21chrt00:25:343
24827499121,9cyclictest612293-21taskset23:18:463
24827499121,9cyclictest326216-21taskset20:06:163
24827499121,8cyclictest446751-21taskset21:35:193
24827499121,8cyclictest267681-21taskset19:20:213
248274991210,1cyclictest0-21swapper/321:00:143
248274991210,1cyclictest0-21swapper/320:25:383
24827499120,9cyclictest402183-21taskset21:10:073
24827499120,9cyclictest338733-21taskset20:15:503
190898120,3rtkit-daemon254614-21munin-node21:29:080
4921982111,7sleep0493145-21cut22:05:190
4733382110,8sleep2473346-21ssh21:51:342
4501652110,2sleep1171rcu_preempt21:38:471
24827499112,7cyclictest331949-21taskset20:10:243
24827499110,4cyclictest0-21swapper/319:10:023
190898110,6rtkit-daemon475364-21df_inode21:55:140
190898110,4rtkit-daemon515165-21ssh22:18:540
190898110,4rtkit-daemon401896-21diskmemload00:17:401
6617152100,7sleep0661961-21date23:50:010
2472222101,6sleep0247294-21ntp_states19:05:240
190898100,7rtkit-daemon229200-21kworker/u16:3+events_freezable_pwr_efficient19:25:481
190898100,6rtkit-daemon696123-21cut00:10:190
190898100,6rtkit-daemon319-21systemd-udevd20:21:381
190898100,5rtkit-daemon639527-21kthreadcore23:35:200
190898100,5rtkit-daemon438-21wpa_supplicant00:29:302
190898100,4rtkit-daemon254614-21munin-node23:08:570
190898100,3rtkit-daemon254614-21munin-node21:23:040
190898100,1rtkit-daemon0-21swapper/023:59:090
677932291,5sleep2677981-40updatedb.mlocat00:00:012
670144291,4sleep1670181-21apt-get23:55:141
653936291,4sleep1653970-21apt-get23:45:131
651051291,4sleep0651115-21ntp_states23:40:230
635203290,2sleep1635211-21ssh23:30:391
628301290,6sleep2628309-21ssh23:28:182
621213290,7sleep072-21kcompactd023:25:090
546387291,6sleep1546395-21ssh22:36:171
507904291,4sleep2507939-21apt-get22:15:142
491106291,5sleep2491361-21latency_hist22:05:002
465628291,4sleep2465636-21ssh21:47:162
442047290,2sleep20-21swapper/221:33:462
370483291,6sleep01223-21cron20:45:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional