You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 20:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 31, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2900799260,2cyclictest26815-21ssh10:39:471
2900599260,25cyclictest6482-21sh11:47:540
2901599250,24cyclictest8238-21ssh09:25:413
2901599250,24cyclictest1620-21perf09:20:003
2900799250,24cyclictest5369-21cstates12:16:091
2900799250,24cyclictest22371-21diskmemload11:38:511
2900799250,24cyclictest22371-21diskmemload09:15:371
2900799250,24cyclictest0-21swapper/112:23:151
29005992523,1cyclictest6831-21ssh09:52:220
2900599250,24cyclictest23641-21perf11:35:000
2900599250,24cyclictest22371-21diskmemload11:21:220
2900599250,24cyclictest21199-21perf12:30:000
2900599250,1cyclictest7954-21perf08:40:000
29015992422,1cyclictest24424-21perf09:40:013
29015992422,1cyclictest13725-21munin-run11:55:003
29015992422,1cyclictest0-21swapper/312:39:573
2901599240,23cyclictest22371-21diskmemload12:21:143
2901599240,23cyclictest0-21swapper/311:40:333
2901599240,1cyclictest22371-21diskmemload10:12:313
29010992421,3cyclictest0-21swapper/209:10:042
29010992421,2cyclictest21240-21sh11:03:122
29010992419,4cyclictest783-21snmpd09:18:452
2901099240,23cyclictest22219-21rm10:35:552
2901099240,23cyclictest1291-21latency_hist11:15:012
2901099240,23cyclictest1291-21latency_hist11:15:012
2901099240,23cyclictest0-21swapper/210:16:062
2901099240,23cyclictest0-21swapper/210:09:182
2901099240,1cyclictest24784-21apt-get11:36:082
29007992423,0cyclictest23535-21apt-get09:11:061
29007992422,1cyclictest0-21swapper/109:50:251
29007992421,2cyclictest25897-21sh12:33:171
2900799240,3cyclictest28271-21latency_hist11:10:011
2900799240,24cyclictest0-21swapper/109:44:181
2900799240,23cyclictest32216-21sh10:15:471
2900799240,23cyclictest0-21swapper/112:12:041
2900799240,23cyclictest0-21swapper/110:42:081
2900799240,23cyclictest0-21swapper/108:46:061
2900799240,0cyclictest0-21swapper/112:27:591
29005992422,1cyclictest0-21swapper/009:38:500
2900599242,1cyclictest62550irq/127-eno111:02:030
2900599240,23cyclictest29270-21perf11:40:000
2900599240,23cyclictest22371-21diskmemload09:13:340
2900599240,23cyclictest22360-21cron09:10:000
2900599240,23cyclictest13235-21sh12:22:140
29015992323,0cyclictest0-21swapper/310:59:333
29015992321,1cyclictest5671-21apt-get10:21:063
29015992321,1cyclictest0-21swapper/311:22:553
2901599230,23cyclictest22371-21diskmemload10:27:153
2901599230,23cyclictest0-21swapper/312:02:053
2901599230,23cyclictest0-21swapper/311:55:193
2901599230,23cyclictest0-21swapper/309:10:333
2901599230,22cyclictest31368-21sh07:15:013
2901599230,22cyclictest31201-21tr09:46:073
2901599230,22cyclictest2097-21rm10:16:283
2901599230,22cyclictest19067-21apt-get07:56:083
2901599230,22cyclictest16366-21sh10:30:263
2901599230,22cyclictest12235-21ssh09:57:053
2901599230,22cyclictest11524-21perf07:40:003
2901599230,22cyclictest0-21swapper/311:14:293
2901599230,22cyclictest0-21swapper/311:14:293
2901599230,0cyclictest22371-21diskmemload10:45:463
2901599230,0cyclictest0-21swapper/310:06:143
2901599230,0cyclictest0-21swapper/309:41:193
2901599230,0cyclictest0-21swapper/308:16:063
29010992323,0cyclictest0-21swapper/207:41:072
29010992322,1cyclictest22371-21diskmemload09:31:082
29010992321,1cyclictest0-21swapper/209:38:262
29010992320,0cyclictest0-21swapper/211:25:182
2901099230,2cyclictest27925-21ssh12:35:472
2901099230,2cyclictest22371-21diskmemload12:01:072
2901099230,23cyclictest22371-21diskmemload10:41:182
2901099230,23cyclictest22371-21diskmemload09:58:432
2901099230,23cyclictest0-21swapper/211:06:242
2901099230,22cyclictest8006-21rm10:21:592
2901099230,22cyclictest6655-21ssh11:48:072
2901099230,22cyclictest4995-21ssh12:16:052
2901099230,22cyclictest3124-21perf08:30:002
2901099230,22cyclictest2994-21apt-get09:21:062
2901099230,22cyclictest22371-21diskmemload10:25:192
2901099230,1cyclictest313-21systemd-journal07:55:002
2901099230,1cyclictest19100-21sh11:30:592
2901099230,1cyclictest0-21swapper/212:30:172
2901099230,0cyclictest0-21swapper/211:51:102
2901099230,0cyclictest0-21swapper/210:01:442
2901099230,0cyclictest0-21swapper/209:26:092
29007992323,0cyclictest0-21swapper/111:58:131
29007992323,0cyclictest0-21swapper/111:22:481
29007992323,0cyclictest0-21swapper/109:38:041
29007992321,1cyclictest697-21perf08:25:001
29007992321,1cyclictest22371-21diskmemload10:28:031
29007992321,1cyclictest0-21swapper/111:01:131
29007992321,1cyclictest0-21swapper/109:25:121
29007992320,2cyclictest14031-21ssh09:30:541
2900799230,2cyclictest13073-21ssh11:25:181
2900799230,23cyclictest0-21swapper/111:46:301
2900799230,23cyclictest0-21swapper/111:32:001
2900799230,22cyclictest5596-21ssh10:21:031
2900799230,22cyclictest28361-21sh10:11:131
2900799230,22cyclictest20468-21ssh10:05:221
2900799230,22cyclictest0-21swapper/112:35:071
2900799230,22cyclictest0-21swapper/109:46:021
2900799230,22cyclictest0-21swapper/109:22:371
2900799230,0cyclictest0-21swapper/111:41:381
29005992323,0cyclictest22371-21diskmemload11:50:070
29005992323,0cyclictest22371-21diskmemload11:28:140
29005992321,1cyclictest4219-21sh11:16:210
29005992321,1cyclictest0-21swapper/012:31:080
29005992321,1cyclictest0-21swapper/010:50:360
29005992321,1cyclictest0-21swapper/010:25:550
29005992320,2cyclictest32668-21munin-run12:40:000
29005992320,2cyclictest24645-21rm10:36:460
29005992320,2cyclictest13906-21cron07:45:000
2900599230,23cyclictest0-21swapper/010:06:460
2900599230,22cyclictest9165-21sh09:55:170
2900599230,22cyclictest32385-21ssh11:41:330
2900599230,22cyclictest2507-21sh09:20:210
2900599230,22cyclictest20134-21ssh12:00:470
2900599230,22cyclictest19991-21apt09:05:010
2900599230,22cyclictest14284-21sh11:55:310
2900599230,22cyclictest0-21swapper/011:10:280
2900599230,22cyclictest0-21swapper/011:10:280
2900599230,22cyclictest0-21swapper/010:32:470
2900599230,22cyclictest0-21swapper/008:16:060
2900599230,21cyclictest0-21swapper/012:10:410
2900599230,1cyclictest29233-21ssh09:15:530
2900599230,1cyclictest15563-21ptp4l09:31:120
2900599230,0cyclictest32483-21apt-get10:16:060
2900599230,0cyclictest0-21swapper/012:05:170
2900599230,0cyclictest0-21swapper/011:05:480
2900599230,0cyclictest0-21swapper/010:45:430
2900599230,0cyclictest0-21swapper/010:11:450
2900599230,0cyclictest0-21swapper/009:26:150
29015992222,0cyclictest22371-21diskmemload11:05:473
29015992222,0cyclictest0-21swapper/310:37:423
29015992222,0cyclictest0-21swapper/308:06:063
29015992221,1cyclictest7069-21ssh09:52:403
29015992221,1cyclictest22371-21diskmemload09:31:163
29015992220,2cyclictest22727-21ssh11:33:443
29015992220,1cyclictest6583-21munin-run07:30:013
29015992220,1cyclictest24606-21sh11:35:563
2901599220,21cyclictest7056-21cstates10:51:083
2901599220,21cyclictest4228-21sh12:15:073
2901599220,21cyclictest3512-21cron12:15:013
2901599220,21cyclictest0-21swapper/312:25:083
2901599220,21cyclictest0-21swapper/311:46:083
2901599220,21cyclictest0-21swapper/311:25:393
2901599220,21cyclictest0-21swapper/310:41:553
2901599220,21cyclictest0-21swapper/309:20:173
2901599220,1cyclictest28338-21munin-run08:15:013
2901599220,1cyclictest22371-21diskmemload12:06:083
2901599220,1cyclictest0-21swapper/311:01:103
2901599220,1cyclictest0-21swapper/310:00:453
29010992222,0cyclictest0-21swapper/212:14:202
29010992222,0cyclictest0-21swapper/212:08:302
29010992222,0cyclictest0-21swapper/211:40:412
29010992222,0cyclictest0-21swapper/210:11:372
29010992222,0cyclictest0-21swapper/209:43:572
29010992220,1cyclictest14996-21rm10:57:182
29010992220,1cyclictest11535-21basename07:40:002
29010992220,1cyclictest0-21swapper/207:30:012
2901099220,2cyclictest13195-21ssh12:22:112
2901099220,21cyclictest22371-21diskmemload11:56:382
2901099220,21cyclictest18843-21ssh12:26:432
2901099220,21cyclictest1550-21ssh09:47:482
2901099220,21cyclictest0-21swapper/211:15:522
2901099220,21cyclictest0-21swapper/210:31:062
2901099220,1cyclictest0-21swapper/211:20:122
2901099220,1cyclictest0-21swapper/210:52:342
2901099220,1cyclictest0-21swapper/207:35:002
29007992221,1cyclictest8302-21ssh11:50:021
29007992221,1cyclictest0-21swapper/110:00:351
29007992220,2cyclictest29953-21sh12:09:281
29007992220,1cyclictest22371-21diskmemload09:58:171
29007992220,1cyclictest0-21swapper/108:15:011
2900799220,22cyclictest0-21swapper/111:15:171
2900799220,21cyclictest16318-21dump-pmu-power07:50:001
2900799220,21cyclictest0-21swapper/111:10:501
2900799220,21cyclictest0-21swapper/111:10:501
2900799220,21cyclictest0-21swapper/110:30:031
2900799220,21cyclictest0-21swapper/109:01:061
2900799220,21cyclictest0-21swapper/108:16:061
2900799220,21cyclictest0-21swapper/107:56:071
2900799220,1cyclictest0-21swapper/110:55:141
2900799220,0cyclictest0-21swapper/112:00:211
29005992221,1cyclictest29320-21apt-get07:11:070
2900599220,22cyclictest22371-21diskmemload10:41:420
2900599220,21cyclictest22371-21diskmemload09:45:430
2900599220,21cyclictest0-21swapper/010:21:450
2900599220,21cyclictest0-21swapper/008:51:070
2900599220,21cyclictest0-21swapper/007:21:070
2900599220,1cyclictest4551-21ssh12:15:310
2900599220,1cyclictest14858-21ssh10:00:200
29015992120,1cyclictest5548-21munin-run08:35:003
29015992120,1cyclictest0-21swapper/311:15:443
29015992119,1cyclictest16337-21grep07:50:003
2901599210,21cyclictest0-21swapper/312:30:273
29010992120,1cyclictest17942-21apt-get09:01:062
2901099210,20cyclictest0-21swapper/208:50:002
2901099210,1cyclictest0-21swapper/209:50:552
29007992121,0cyclictest6914-21apt-get07:31:071
2900599210,0cyclictest22371-21diskmemload10:57:100
2900599210,0cyclictest0-21swapper/008:01:070
2900599210,0cyclictest0-21swapper/007:26:060
2900599210,0cyclictest0-21swapper/007:16:050
29015992020,0cyclictest0-21swapper/309:06:073
29015992018,1cyclictest8288-21apt-get08:41:063
2901599200,20cyclictest0-21swapper/307:51:073
2901599200,0cyclictest0-21swapper/308:36:073
2901599200,0cyclictest0-21swapper/308:21:073
29010992020,0cyclictest0-21swapper/207:21:062
29010992019,1cyclictest28662-21apt-get08:16:062
2901099200,0cyclictest0-21swapper/208:56:072
29007992020,0cyclictest0-21swapper/108:31:061
29007992019,1cyclictest23875-21apt-get08:06:061
29005992020,0cyclictest0-21swapper/008:41:060
29015991919,0cyclictest0-21swapper/308:51:073
29015991919,0cyclictest0-21swapper/308:26:073
29015991919,0cyclictest0-21swapper/307:41:073
29015991919,0cyclictest0-21swapper/307:16:063
29015991917,1cyclictest2121-21apt-get07:21:063
29010991919,0cyclictest0-21swapper/208:51:072
29010991919,0cyclictest0-21swapper/208:35:002
29010991918,0cyclictest20338-21apt-get09:06:072
29010991918,0cyclictest0-21swapper/207:15:022
29010991917,1cyclictest28317-21sh08:15:012
29007991919,0cyclictest0-21swapper/109:06:071
29007991919,0cyclictest0-21swapper/107:11:071
2900799190,18cyclictest1-21systemd08:55:011
29005991919,0cyclictest0-21swapper/008:31:060
29015991817,1cyclictest21481-21apt-get08:01:073
29015991816,1cyclictest10705-21/usr/sbin/munin08:46:073
29010991818,0cyclictest0-21swapper/207:56:072
29010991816,1cyclictest712-21munin-plugin-st08:25:002
29007991816,1cyclictest5872-21apt-get08:36:071
29010991717,0cyclictest0-21swapper/208:41:062
29010991717,0cyclictest0-21swapper/208:36:072
29007991717,0cyclictest0-21swapper/107:36:071
29007991717,0cyclictest0-21swapper/107:26:061
29005991717,0cyclictest0-21swapper/007:51:070
29005991717,0cyclictest0-21swapper/007:36:070
29005991715,1cyclictest9028-21munin-run07:35:000
29005991715,1cyclictest17552-21cron09:00:010
29010991614,1cyclictest16332-21turbostat07:50:002
2901099160,16cyclictest24516-21head08:06:092
29007991616,0cyclictest0-21swapper/108:01:071
29007991616,0cyclictest0-21swapper/107:41:071
29007991616,0cyclictest0-21swapper/107:21:071
29007991615,1cyclictest0-21swapper/108:26:071
2900799160,1cyclictest0-21swapper/107:15:011
29005991614,1cyclictest0-21swapper/008:46:170
2901599150,5cyclictest19994-21dump-pmu-power09:05:013
29010991513,1cyclictest31608-21apt-config07:15:012
29007991515,0cyclictest0-21swapper/108:56:071
29005991515,0cyclictest0-21swapper/008:26:070
29005991514,0cyclictest0-21swapper/007:56:070
2901599140,14cyclictest0-21swapper/308:55:383
2901599140,14cyclictest0-21swapper/307:30:153
2901099140,14cyclictest0-21swapper/208:00:192
29007991414,0cyclictest0-21swapper/108:40:351
29005991414,0cyclictest0-21swapper/008:20:260
29005991414,0cyclictest0-21swapper/007:45:190
2900599140,14cyclictest0-21swapper/008:10:200
2900599140,14cyclictest0-21swapper/008:05:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional