You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 04:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Aug 26, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
369321110,4sleep22072599cyclictest22:17:432
20640210897,6sleep20-21swapper/219:09:192
20607210897,6sleep00-21swapper/019:08:520
20406210695,6sleep10-21swapper/119:06:171
20658210285,12sleep30-21swapper/319:09:323
127842810,0sleep30-21swapper/323:35:123
154352750,0sleep30-21swapper/321:56:003
45092670,1sleep20-21swapper/222:51:592
253632630,1sleep10-21swapper/123:48:011
238502600,1sleep00-21swapper/022:39:100
283292590,1sleep128335-21aten2.4_r3power22:10:131
72092550,1sleep20-21swapper/221:47:292
2072499360,34cyclictest0-21swapper/119:10:111
2072399280,26cyclictest0-21swapper/020:15:120
20725992715,7cyclictest0-21swapper/223:16:062
20725992623,2cyclictest17290-21kworker/u8:023:07:042
71832250,1sleep30-21swapper/323:29:363
20726992522,2cyclictest31890-21kworker/u8:221:44:053
20726992522,2cyclictest24892-21kworker/u8:223:00:053
20725992522,2cyclictest16977-21kworker/u8:021:27:042
20725992522,2cyclictest10575-21kworker/u8:100:20:052
2072399253,20cyclictest22150irq/25-ahci[00019:35:120
20726992421,2cyclictest27251-21kworker/u8:222:28:053
20726992421,2cyclictest10575-21kworker/u8:100:18:063
20725992421,2cyclictest3069-21kworker/u8:221:18:052
20725992421,2cyclictest15048-21kworker/u8:122:49:042
20725992421,2cyclictest15048-21kworker/u8:122:49:042
20725992420,2cyclictest28397-21kworker/u8:220:56:052
2072599240,7cyclictest0-21swapper/223:37:042
20726992320,2cyclictest4622-21kworker/u8:022:23:043
20726992320,2cyclictest24892-21kworker/u8:222:56:013
20726992320,2cyclictest17609-21kworker/u8:121:54:043
20726992320,2cyclictest16977-21kworker/u8:021:28:013
20725992320,2cyclictest4622-21kworker/u8:022:39:042
20725992320,2cyclictest31890-21kworker/u8:221:42:012
20725992320,2cyclictest10575-21kworker/u8:100:07:052
20726992219,2cyclictest7770-21kworker/u8:123:50:053
20726992219,2cyclictest7770-21kworker/u8:123:47:043
20726992219,2cyclictest3069-21kworker/u8:221:19:053
20726992219,2cyclictest27251-21kworker/u8:222:10:043
20726992219,2cyclictest17609-21kworker/u8:122:17:043
20726992219,2cyclictest16977-21kworker/u8:021:30:013
20726992219,2cyclictest15048-21kworker/u8:122:44:053
2072699221,19cyclictest0-21swapper/319:10:123
20725992219,2cyclictest31388-21kworker/u8:121:09:052
20725992219,2cyclictest21657-21kworker/u8:022:03:042
20725992219,2cyclictest17290-21kworker/u8:023:14:042
20725992219,2cyclictest10575-21kworker/u8:100:16:012
2072599220,18cyclictest0-21swapper/222:08:052
2072599220,17cyclictest0-21swapper/219:51:052
20726992118,2cyclictest7770-21kworker/u8:123:59:043
20726992118,2cyclictest4037-21kworker/u8:000:23:043
20726992118,2cyclictest4037-21kworker/u8:000:02:053
20726992118,2cyclictest28528-21kworker/u8:223:22:053
20726992118,2cyclictest23452-21kworker/u8:123:17:043
20726992118,2cyclictest21657-21kworker/u8:022:06:063
20726992118,2cyclictest16977-21kworker/u8:021:23:043
20725992118,2cyclictest31890-21kworker/u8:221:50:012
20725992118,2cyclictest23076-21kworker/u8:220:33:042
20725992118,2cyclictest23076-21kworker/u8:220:19:052
20725992118,2cyclictest23076-21kworker/u8:220:09:042
2072399210,19cyclictest0-21swapper/021:20:130
20726992017,2cyclictest4828-21kworker/u8:020:02:013
20726992017,2cyclictest4622-21kworker/u8:022:37:043
20726992017,2cyclictest31388-21kworker/u8:121:08:013
20726992017,2cyclictest30652-21kworker/u8:200:30:013
20726992017,2cyclictest28528-21kworker/u8:223:32:043
20726992017,2cyclictest24892-21kworker/u8:223:10:043
20726992017,2cyclictest23076-21kworker/u8:220:17:053
20726992017,2cyclictest21657-21kworker/u8:022:04:043
20726992017,2cyclictest16977-21kworker/u8:020:48:013
20726992017,2cyclictest15048-21kworker/u8:122:32:053
2072699201,2cyclictest0-21swapper/300:38:053
2072699200,16cyclictest0-21swapper/300:14:043
2072699200,15cyclictest0-21swapper/323:43:043
20725992017,2cyclictest4037-21kworker/u8:000:13:042
20725992017,2cyclictest28528-21kworker/u8:223:30:042
20725992017,2cyclictest23076-21kworker/u8:220:13:042
20725992017,2cyclictest18457-21kworker/u8:119:30:042
20725992017,2cyclictest16977-21kworker/u8:020:46:042
2072599200,3cyclictest0-21swapper/200:38:052
2072599200,18cyclictest0-21swapper/200:29:042
2072599200,15cyclictest0-21swapper/222:30:052
2072399200,2cyclictest0-21swapper/020:30:130
20726991916,2cyclictest4037-21kworker/u8:000:05:043
20726991916,2cyclictest31069-21kworker/u8:019:42:043
20726991916,2cyclictest28397-21kworker/u8:220:58:043
20726991916,2cyclictest28397-21kworker/u8:220:52:053
20726991916,2cyclictest23076-21kworker/u8:220:22:043
20726991916,2cyclictest23076-21kworker/u8:219:48:043
20726991916,2cyclictest16977-21kworker/u8:020:43:043
20726991916,2cyclictest16977-21kworker/u8:020:39:043
20726991916,2cyclictest10575-21kworker/u8:100:26:043
2072699190,2cyclictest5959-21munin-node3
2072699190,18cyclictest0-21swapper/321:14:043
20725991916,2cyclictest31069-21kworker/u8:019:37:042
20725991916,2cyclictest30652-21kworker/u8:200:30:052
20725991916,2cyclictest2280-21kworker/u8:119:45:042
20725991916,2cyclictest14941-21kworker/u8:019:14:012
2072599191,2cyclictest0-21swapper/222:58:042
2072599190,2cyclictest0-21swapper/221:39:042
79602180,0sleep10-21swapper/121:48:401
20726991815,2cyclictest4828-21kworker/u8:019:58:013
20726991815,2cyclictest31069-21kworker/u8:019:38:013
20726991815,2cyclictest24892-21kworker/u8:222:45:043
20726991815,2cyclictest24892-21kworker/u8:222:45:043
20726991815,2cyclictest23076-21kworker/u8:220:07:043
20726991815,2cyclictest18457-21kworker/u8:119:25:053
20726991815,2cyclictest16977-21kworker/u8:021:01:043
2072699180,2cyclictest0-21swapper/321:39:043
2072699180,13cyclictest0-21swapper/320:10:043
20725991815,2cyclictest31388-21kworker/u8:121:00:042
20725991815,2cyclictest23076-21kworker/u8:220:27:042
20725991815,2cyclictest23076-21kworker/u8:219:55:042
2072599180,2cyclictest0-21swapper/222:42:042
20726991714,2cyclictest23076-21kworker/u8:219:52:053
20725991714,2cyclictest16977-21kworker/u8:020:42:052
2072599170,9cyclictest0-21swapper/223:53:042
2072599170,4cyclictest0-21swapper/223:46:042
2072599170,2cyclictest0-21swapper/221:55:042
2072599170,2cyclictest0-21swapper/221:22:042
2072599170,15cyclictest0-21swapper/222:22:042
20726991613,2cyclictest23076-21kworker/u8:220:26:053
2072699160,2cyclictest0-21swapper/323:06:043
2072699160,11cyclictest0-21swapper/319:22:043
2072699160,11cyclictest0-21swapper/319:22:043
20725991613,2cyclictest31069-21kworker/u8:019:41:042
20725991613,2cyclictest23076-21kworker/u8:220:21:042
2072599160,2cyclictest0-21swapper/220:35:042
2072599160,12cyclictest0-21swapper/223:55:042
20724991611,3cyclictest24956-21python00:21:021
2072399161,13cyclictest0-21swapper/023:33:280
20726991512,2cyclictest23076-21kworker/u8:219:32:043
2072699150,2cyclictest0-21swapper/322:52:043
20725991510,3cyclictest0-21swapper/219:15:122
2072599150,2cyclictest0-21swapper/221:30:062
2072599150,2cyclictest0-21swapper/200:02:012
2072499151,12cyclictest0-21swapper/100:10:061
20724991510,3cyclictest0-21swapper/119:55:181
2072499150,13cyclictest8649-21sort21:15:191
2072399151,3cyclictest0-21swapper/000:31:480
20723991510,3cyclictest23743-21df_inode00:20:150
20723991510,3cyclictest0-21swapper/021:53:500
20723991510,3cyclictest0-21swapper/021:13:290
2072399150,13cyclictest0-21swapper/022:17:010
2072399150,13cyclictest0-21swapper/019:41:590
2072699140,2cyclictest0-21swapper/319:17:043
2072599140,12cyclictest0-21swapper/220:50:202
2072599140,12cyclictest0-21swapper/219:25:122
2072499149,3cyclictest19440-21ssh23:08:121
2072499149,3cyclictest0-21swapper/121:13:211
2072499141,11cyclictest0-21swapper/100:30:531
2072499140,3cyclictest0-21swapper/122:56:131
2072499140,2cyclictest2607-21diskmemload22:04:021
2072499140,2cyclictest0-21swapper/121:51:221
2072499140,13cyclictest0-21swapper/122:46:031
2072499140,13cyclictest0-21swapper/122:46:021
2072499140,12cyclictest28976-21latency20:50:211
2072499140,12cyclictest2607-21diskmemload21:56:431
2072499140,12cyclictest1926-21cut22:15:401
2072499140,12cyclictest17143-21apt-get21:25:051
2072499140,12cyclictest0-21swapper/123:35:111
2072499140,12cyclictest0-21swapper/120:40:201
2072499140,11cyclictest0-21swapper/122:50:141
2072399142,6cyclictest0-21swapper/022:40:000
20723991410,2cyclictest0-21swapper/021:40:570
2072399140,3cyclictest30800-21ssh22:11:570
2072399140,2cyclictest2607-21diskmemload00:35:140
2072399140,2cyclictest0-21swapper/020:55:230
2072399140,13cyclictest0-21swapper/022:05:140
2072399140,13cyclictest0-21swapper/021:00:140
2072399140,12cyclictest29052-21awk00:25:180
2072399140,12cyclictest26255-21apt-get20:45:120
2072399140,12cyclictest15042-21ssh23:36:540
2072399140,12cyclictest10581-21ssh22:59:210
2072399140,12cyclictest10468-21ssh21:17:050
2072399140,12cyclictest0-21swapper/023:51:250
2072399140,12cyclictest0-21swapper/023:44:560
2072399140,12cyclictest0-21swapper/000:18:040
36742130,2sleep12607-21diskmemload23:59:521
20725991310,2cyclictest0-21swapper/222:26:122
2072599130,2cyclictest0-21swapper/223:25:152
2072599130,2cyclictest0-21swapper/219:21:052
2072599130,2cyclictest0-21swapper/219:21:042
2072599130,11cyclictest0-21swapper/223:44:102
2072499138,3cyclictest0-21swapper/123:21:021
2072499132,6cyclictest0-21swapper/100:20:001
20724991310,2cyclictest0-21swapper/123:41:331
20724991310,2cyclictest0-21swapper/123:31:041
20724991310,2cyclictest0-21swapper/122:40:021
20724991310,2cyclictest0-21swapper/121:32:031
20724991310,2cyclictest0-21swapper/120:36:021
2072499130,3cyclictest18324-21sh22:33:021
2072499130,12cyclictest0-21swapper/100:26:421
2072499130,11cyclictest2607-21diskmemload22:28:141
2072499130,11cyclictest0-21swapper/121:00:291
2072499130,10cyclictest0-21swapper/123:16:351
2072399138,3cyclictest0-21swapper/000:06:390
2072399132,6cyclictest0-21swapper/023:45:010
2072399132,6cyclictest0-21swapper/023:25:000
2072399132,6cyclictest0-21swapper/020:29:590
2072399132,6cyclictest0-21swapper/020:25:000
2072399132,2cyclictest0-21swapper/021:35:090
20723991310,2cyclictest0-21swapper/023:06:510
20723991310,2cyclictest0-21swapper/022:25:190
20723991310,2cyclictest0-21swapper/022:00:200
20723991310,2cyclictest0-21swapper/021:47:280
20723991310,2cyclictest0-21swapper/019:50:120
20723991310,2cyclictest0-21swapper/000:13:460
2072399130,2cyclictest0-21swapper/023:14:140
2072399130,2cyclictest0-21swapper/021:55:170
2072399130,2cyclictest0-21swapper/021:34:440
2072399130,12cyclictest0-21swapper/023:56:350
2072399130,12cyclictest0-21swapper/022:52:340
2072399130,12cyclictest0-21swapper/022:23:550
2072399130,12cyclictest0-21swapper/020:50:240
2072399130,11cyclictest0-21swapper/023:00:570
127392130,2sleep20-21swapper/223:00:492
2072699122,7cyclictest0-21swapper/320:30:013
2072599129,2cyclictest0-21swapper/222:12:022
2072599129,2cyclictest0-21swapper/221:12:422
2072599120,1cyclictest8798-21apt-get20:00:112
2072599120,11cyclictest0-21swapper/223:20:092
2072499129,2cyclictest0-21swapper/119:35:301
2072499128,2cyclictest4758-21munin-node1
2072499128,2cyclictest0-21swapper/120:10:141
2072499128,2cyclictest0-21swapper/119:30:141
2072499127,3cyclictest23490-21munin-node1
2072499122,6cyclictest0-21swapper/120:05:001
2072499122,5cyclictest0-21swapper/120:15:001
2072499120,2cyclictest2607-21diskmemload00:00:521
2072499120,2cyclictest0-21swapper/121:21:021
2072499120,11cyclictest0-21swapper/123:27:031
2072499120,11cyclictest0-21swapper/121:43:581
2072499120,11cyclictest0-21swapper/121:39:121
2072499120,10cyclictest2607-21diskmemload23:00:231
2072399129,2cyclictest0-21swapper/021:25:100
2072399129,2cyclictest0-21swapper/019:25:110
2072399129,2cyclictest0-21swapper/000:00:190
2072399121,9cyclictest22270-21apt-get20:35:060
2072399120,2cyclictest0-21swapper/019:55:190
2072399120,1cyclictest0-21swapper/023:23:040
2072399120,11cyclictest0-21swapper/023:15:140
2072399120,11cyclictest0-21swapper/022:46:390
2072399120,11cyclictest0-21swapper/022:46:380
2072399120,11cyclictest0-21swapper/022:30:170
2072399120,11cyclictest0-21swapper/019:31:070
2072499118,2cyclictest0-21swapper/123:13:451
2072499118,2cyclictest0-21swapper/121:05:591
2072499117,2cyclictest0-21swapper/122:35:101
2072499117,2cyclictest0-21swapper/120:20:131
2072499117,2cyclictest0-21swapper/119:20:141
2072499117,2cyclictest0-21swapper/119:20:131
2072499116,3cyclictest9450-21diskstats00:05:161
2072499111,8cyclictest0-21swapper/120:31:051
2072499111,3cyclictest10803-21munin-node1
2072499110,9cyclictest27003-21latency20:45:191
2072499110,9cyclictest24750-21tr19:20:001
2072499110,10cyclictest0-21swapper/123:51:131
2072499110,10cyclictest0-21swapper/122:20:471
2072499110,10cyclictest0-21swapper/100:35:331
2072399111,6cyclictest0-21swapper/019:45:510
2072399110,9cyclictest23070-21aten2.4_r3power19:15:130
2072399110,3cyclictest3649-21snmpd19:10:450
2072499102,3cyclictest20722-21cyclictest19:43:511
2072499101,7cyclictest0-21swapper/119:45:121
2072499100,8cyclictest0-21swapper/119:25:151
2072399107,2cyclictest0-21swapper/020:10:170
2072399105,3cyclictest25917-21ps19:20:190
2072399105,3cyclictest25917-21ps19:20:180
2072399101,6cyclictest0-21swapper/020:06:030
2072399100,8cyclictest1578-21df_abs21:05:220
207249996,2cyclictest0-21swapper/120:55:201
207249990,3cyclictest0-21swapper/120:25:131
207239994,3cyclictest25083-21fschecks_time20:40:180
207239983,3cyclictest8888-21aten2.4_r3power20:00:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional