You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 03:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Tue Apr 28, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
166032117106,6sleep30-21swapper/319:06:553
16739211187,19sleep00-21swapper/019:08:410
16691211099,6sleep20-21swapper/219:08:032
16695210998,6sleep10-21swapper/119:08:061
174952820,0sleep30-21swapper/322:38:193
62182760,1sleep00-21swapper/021:15:430
311322760,5sleep31687499cyclictest00:01:123
257812730,0sleep20-21swapper/222:12:332
238762700,0sleep30-21swapper/323:54:353
282012680,0sleep30-21swapper/323:59:013
63222220,0sleep20-21swapper/222:26:002
109292220,1sleep310932-21missed_timers23:05:183
299552210,0sleep10-21swapper/121:41:501
16873992016,2cyclictest4833-21kworker/u8:123:47:052
1687199200,18cyclictest0-21swapper/000:05:110
16874991916,2cyclictest30027-21kworker/u8:019:22:043
16874991916,2cyclictest22462-21kworker/u8:021:04:043
16874991916,2cyclictest12458-21kworker/u8:120:42:053
16873991916,2cyclictest7665-21kworker/u8:223:19:042
16873991916,2cyclictest7665-21kworker/u8:223:03:042
16873991916,2cyclictest7665-21kworker/u8:222:48:052
16873991916,2cyclictest2502-21kworker/u8:122:30:062
16873991916,2cyclictest17788-21kworker/u8:022:42:062
16872991916,2cyclictest8288-21kworker/u8:020:12:051
16872991916,2cyclictest12458-21kworker/u8:120:57:051
16874991815,2cyclictest5403-21kworker/u8:100:15:043
16874991814,3cyclictest30068-21kworker/u8:022:04:053
16873991815,2cyclictest31767-21kworker/u8:200:08:052
16873991815,2cyclictest28502-21kworker/u8:221:10:052
16873991815,2cyclictest22954-21kworker/u8:122:16:052
16873991815,2cyclictest10921-21kworker/u8:200:22:052
16872991815,2cyclictest380-21kworker/u8:219:54:011
16874991714,2cyclictest31767-21kworker/u8:200:09:053
16874991714,2cyclictest29649-21kworker/u8:022:18:053
16874991713,2cyclictest7665-21kworker/u8:223:18:043
16873991714,2cyclictest7665-21kworker/u8:223:20:052
16873991714,2cyclictest380-21kworker/u8:220:05:052
16873991714,2cyclictest32709-21kworker/u8:121:19:042
16873991714,2cyclictest29649-21kworker/u8:022:23:042
16873991714,2cyclictest28502-21kworker/u8:221:09:042
16873991714,2cyclictest20742-21kworker/u8:219:20:042
16873991714,2cyclictest12458-21kworker/u8:120:58:052
16873991714,2cyclictest12458-21kworker/u8:120:43:042
1687199171,2cyclictest0-21swapper/000:30:110
1687499161,13cyclictest6482-21tr00:10:133
1687499161,13cyclictest0-21swapper/320:45:173
1687499160,14cyclictest0-21swapper/320:57:053
16873991613,2cyclictest9998-21kworker/u8:023:42:012
16873991613,2cyclictest7665-21kworker/u8:222:50:042
16873991613,2cyclictest4833-21kworker/u8:123:52:052
16873991613,2cyclictest380-21kworker/u8:220:21:052
16873991613,2cyclictest3519-21kworker/u8:123:06:062
16873991613,2cyclictest31767-21kworker/u8:200:03:042
16873991613,2cyclictest30027-21kworker/u8:019:35:042
16873991613,2cyclictest26581-21kworker/u8:000:26:012
16873991613,2cyclictest2502-21kworker/u8:122:37:042
16873991613,2cyclictest22462-21kworker/u8:021:02:042
16873991613,2cyclictest22375-21kworker/u8:221:35:052
16873991613,2cyclictest13231-21kworker/u8:323:12:052
16873991613,2cyclictest12458-21kworker/u8:120:35:042
16873991613,2cyclictest12458-21kworker/u8:120:32:022
16873991613,2cyclictest12458-21kworker/u8:120:28:012
16873991613,2cyclictest11309-21kworker/u8:021:23:052
16872991612,3cyclictest24355-21turbostat00:34:551
16872991612,2cyclictest7665-21kworker/u8:223:09:041
1687299160,15cyclictest0-21swapper/119:22:051
1687299160,14cyclictest6038-21apt-get20:05:051
1687199161,13cyclictest8245-21ssh00:11:200
16871991611,3cyclictest25849-21ssh23:55:490
16874991512,2cyclictest32709-21kworker/u8:121:15:043
16874991512,2cyclictest0-21swapper/300:34:563
1687499151,12cyclictest11075-21ssh22:31:033
1687499150,14cyclictest0-21swapper/320:12:043
16873991512,2cyclictest7725-21kworker/u8:121:56:022
16873991512,2cyclictest7725-21kworker/u8:121:56:012
16873991512,2cyclictest380-21kworker/u8:220:17:042
16873991512,2cyclictest380-21kworker/u8:220:03:042
16873991512,2cyclictest380-21kworker/u8:219:53:042
16873991512,2cyclictest30807-21kworker/u8:023:30:022
16873991512,2cyclictest30068-21kworker/u8:021:42:042
16873991512,2cyclictest30027-21kworker/u8:019:12:012
16873991512,2cyclictest28873-21kworker/u8:119:48:042
16873991512,2cyclictest28873-21kworker/u8:119:44:022
16873991512,2cyclictest27870-21kworker/u8:000:35:052
16873991512,2cyclictest27870-21kworker/u8:000:34:042
16873991512,2cyclictest26581-21kworker/u8:023:58:022
16873991512,2cyclictest26581-21kworker/u8:000:18:042
16873991512,2cyclictest22462-21kworker/u8:020:49:052
16873991512,2cyclictest13102-21kworker/u8:222:03:042
1687399150,13cyclictest0-21swapper/223:38:232
1687399150,13cyclictest0-21swapper/221:30:002
16872991512,2cyclictest0-21swapper/122:20:351
16872991512,2cyclictest0-21swapper/100:37:451
1687299150,13cyclictest13694-21latency_hist22:00:011
1687299150,13cyclictest13694-21latency_hist22:00:001
1687299150,13cyclictest0-21swapper/123:45:201
1687299150,13cyclictest0-21swapper/119:25:511
1687199151,12cyclictest0-21swapper/023:51:070
16871991510,3cyclictest30808-21ssh21:43:160
16871991510,3cyclictest10190-21latency_hist20:15:000
16871991510,3cyclictest0-21swapper/023:45:500
1687199150,13cyclictest0-21swapper/020:09:590
127632151,3sleep10-21swapper/123:41:391
16874991411,2cyclictest4833-21kworker/u8:123:48:053
16874991411,2cyclictest30068-21kworker/u8:022:07:053
16874991411,2cyclictest30068-21kworker/u8:021:58:053
16874991411,2cyclictest30068-21kworker/u8:021:58:043
16874991411,2cyclictest22375-21kworker/u8:221:36:043
16874991410,3cyclictest0-21swapper/321:53:063
16874991410,2cyclictest7665-21kworker/u8:223:10:043
1687499140,2cyclictest0-21swapper/321:10:163
1687499140,12cyclictest0-21swapper/323:35:123
1687499140,12cyclictest0-21swapper/323:00:113
1687499140,12cyclictest0-21swapper/300:25:293
16873991411,2cyclictest380-21kworker/u8:219:58:022
16873991411,2cyclictest30068-21kworker/u8:022:08:052
16873991411,2cyclictest30068-21kworker/u8:021:50:042
16873991411,2cyclictest30068-21kworker/u8:021:49:052
16873991411,2cyclictest30027-21kworker/u8:019:33:052
16873991411,2cyclictest30027-21kworker/u8:019:27:042
16873991411,2cyclictest26581-21kworker/u8:000:12:022
16873991411,2cyclictest22462-21kworker/u8:020:54:042
16873991411,2cyclictest15222-21kworker/u8:119:17:052
16873991411,2cyclictest11309-21kworker/u8:021:31:052
16872991411,2cyclictest10921-21kworker/u8:200:21:051
16872991411,2cyclictest0-21swapper/122:10:141
16872991411,2cyclictest0-21swapper/122:03:441
16872991411,2cyclictest0-21swapper/100:14:251
1687299140,3cyclictest0-21swapper/123:03:181
1687299140,3cyclictest0-21swapper/121:33:581
1687299140,3cyclictest0-21swapper/119:40:141
1687299140,2cyclictest32272-21diskmemload22:19:021
1687299140,2cyclictest0-21swapper/122:32:251
1687299140,2cyclictest0-21swapper/121:50:011
1687299140,2cyclictest0-21swapper/121:04:041
1687299140,2cyclictest0-21swapper/100:17:461
1687299140,13cyclictest0-21swapper/122:57:351
1687299140,13cyclictest0-21swapper/122:45:551
1687299140,13cyclictest0-21swapper/122:37:051
1687299140,13cyclictest0-21swapper/100:09:241
1687299140,12cyclictest32272-21diskmemload21:15:141
1687199141,3cyclictest13398-21ssh00:17:070
16871991411,2cyclictest9-21ksoftirqd/000:03:110
16871991411,2cyclictest101ktimersoftd/023:10:090
16871991410,3cyclictest3127-21nscd22:45:140
1687199140,12cyclictest2612-21wc19:54:590
1687199140,12cyclictest11502-21ps23:40:170
1687499139,2cyclictest29476-21iostat23:25:163
16874991310,2cyclictest12923-21munin-node3
16874991310,2cyclictest0-21swapper/322:47:063
16874991310,2cyclictest0-21swapper/322:25:553
16874991310,2cyclictest0-21swapper/322:20:263
16874991310,2cyclictest0-21swapper/321:46:043
16874991310,2cyclictest0-21swapper/321:40:163
16874991310,2cyclictest0-21swapper/321:25:113
16874991310,2cyclictest0-21swapper/319:25:153
16874991310,2cyclictest0-21swapper/300:35:133
1687499130,2cyclictest4401-21ssh23:33:163
1687499130,2cyclictest0-21swapper/321:21:573
1687499130,2cyclictest0-21swapper/319:45:133
1687499130,12cyclictest0-21swapper/322:42:163
1687499130,11cyclictest0-21swapper/300:20:193
16873991310,2cyclictest7665-21kworker/u8:222:56:022
16873991310,2cyclictest24227-21kworker/u8:123:25:042
1687299131,10cyclictest22396-21apt-get20:45:131
16872991310,2cyclictest0-21swapper/123:36:131
16872991310,2cyclictest0-21swapper/123:15:301
16872991310,2cyclictest0-21swapper/123:10:251
16872991310,2cyclictest0-21swapper/121:50:081
16872991310,2cyclictest0-21swapper/121:13:151
16872991310,2cyclictest0-21swapper/120:36:021
1687299130,3cyclictest0-21swapper/123:30:171
1687299130,2cyclictest0-21swapper/122:50:191
1687299130,2cyclictest0-21swapper/121:25:101
1687299130,2cyclictest0-21swapper/121:20:421
1687299130,2cyclictest0-21swapper/120:50:591
1687299130,2cyclictest0-21swapper/119:30:111
1687299130,2cyclictest0-21swapper/100:00:221
1687299130,12cyclictest0-21swapper/123:55:301
1687299130,12cyclictest0-21swapper/123:52:501
1687299130,12cyclictest0-21swapper/123:21:081
1687299130,12cyclictest0-21swapper/122:40:131
1687299130,12cyclictest0-21swapper/122:28:171
1687299130,12cyclictest0-21swapper/122:05:301
1687299130,12cyclictest0-21swapper/121:37:171
1687299130,12cyclictest0-21swapper/119:10:151
1687299130,12cyclictest0-21swapper/100:25:561
1687299130,11cyclictest0-21swapper/119:35:491
1687199138,3cyclictest0-21swapper/019:21:010
1687199132,6cyclictest0-21swapper/023:20:000
1687199132,6cyclictest0-21swapper/019:39:590
1687199131,7cyclictest18591-21kworker/u8:023:14:590
1687199131,11cyclictest11-21rcuc/021:24:370
16871991310,2cyclictest9-21ksoftirqd/021:46:200
16871991310,2cyclictest8536-21ssh23:37:280
16871991310,2cyclictest0-21swapper/023:25:490
16871991310,2cyclictest0-21swapper/022:14:300
16871991310,2cyclictest0-21swapper/021:30:180
16871991310,2cyclictest0-21swapper/021:29:010
1687199130,2cyclictest0-21swapper/022:35:080
1687199130,2cyclictest0-21swapper/000:25:130
1687199130,12cyclictest9-21ksoftirqd/022:21:180
1687199130,12cyclictest0-21swapper/023:30:170
1687199130,11cyclictest32272-21diskmemload22:25:180
1687499129,2cyclictest9998-21kworker/u8:023:41:043
1687499129,2cyclictest0-21swapper/322:51:553
1687499120,2cyclictest0-21swapper/322:57:573
1687499120,2cyclictest0-21swapper/319:54:023
1687499120,11cyclictest0-21swapper/319:31:003
1687499120,10cyclictest0-21swapper/319:38:433
1687399129,2cyclictest8288-21kworker/u8:020:11:042
1687299129,2cyclictest0-21swapper/123:25:191
1687299129,2cyclictest0-21swapper/120:25:171
1687199129,2cyclictest0-21swapper/022:52:560
1687199129,2cyclictest0-21swapper/022:08:480
1687199129,2cyclictest0-21swapper/000:38:090
1687199129,2cyclictest0-21swapper/000:21:290
1687199127,3cyclictest18871-21munin-node0
1687199126,4cyclictest9454-21ssh22:30:120
1687199122,6cyclictest0-21swapper/019:11:290
16871991210,1cyclictest0-21swapper/022:00:280
1687199120,2cyclictest0-21swapper/023:05:190
1687199120,2cyclictest0-21swapper/023:01:000
1687199120,2cyclictest0-21swapper/022:15:580
1687199120,2cyclictest0-21swapper/021:59:510
1687199120,2cyclictest0-21swapper/021:59:500
1687199120,11cyclictest0-21swapper/022:57:280
1687199120,11cyclictest0-21swapper/021:52:170
1687199120,11cyclictest0-21swapper/021:35:400
1687199120,11cyclictest0-21swapper/021:10:200
1687199120,11cyclictest0-21swapper/020:15:190
1687199120,11cyclictest0-21swapper/020:00:180
1687199120,10cyclictest0-21swapper/020:31:460
244352110,2sleep30-21swapper/322:10:553
1687499118,2cyclictest380-21kworker/u8:220:09:053
1687499118,2cyclictest0-21swapper/319:15:163
1687499110,10cyclictest0-21swapper/323:23:153
1687499110,10cyclictest0-21swapper/321:32:023
1687299118,2cyclictest0-21swapper/119:45:151
1687299110,9cyclictest0-21swapper/120:00:131
1687299110,3cyclictest0-21swapper/121:05:121
1687299110,3cyclictest0-21swapper/120:40:171
1687299110,3cyclictest0-21swapper/120:20:121
1687299110,3cyclictest0-21swapper/119:55:191
1687199112,6cyclictest0-21swapper/019:42:580
1687199111,6cyclictest0-21swapper/020:21:450
1687199111,6cyclictest0-21swapper/019:31:000
1687199110,2cyclictest20404-21aten2.4_r3power20:40:120
1687499107,2cyclictest380-21kworker/u8:220:29:043
1687499107,2cyclictest22462-21kworker/u8:020:52:013
1687499107,2cyclictest12458-21kworker/u8:120:39:043
1687499107,2cyclictest0-21swapper/321:05:143
1687499107,2cyclictest0-21swapper/319:40:133
1687299100,9cyclictest0-21swapper/119:16:031
1687299100,8cyclictest0-21swapper/120:30:111
1687199107,2cyclictest0-21swapper/020:55:060
1687199107,2cyclictest0-21swapper/019:55:190
1687199105,3cyclictest23381-21grep19:25:130
1687199102,7cyclictest0-21swapper/020:26:010
1687199102,5cyclictest0-21swapper/020:36:590
1687199101,7cyclictest0-21swapper/021:00:140
1687199100,7cyclictest0-21swapper/019:48:590
1687199100,2cyclictest0-21swapper/021:06:000
168749996,2cyclictest380-21kworker/u8:220:19:053
168749996,2cyclictest380-21kworker/u8:219:59:053
168749996,2cyclictest12458-21kworker/u8:120:34:053
168729996,2cyclictest0-21swapper/120:15:411
168719994,3cyclictest24667-21tr20:50:110
168719990,7cyclictest0-21swapper/020:45:150
168719990,4cyclictest19905-21grep19:15:180
168749985,2cyclictest15222-21kworker/u8:119:10:013
168749981,3cyclictest0-21swapper/320:00:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional