You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 07:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Thu Mar 12, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20829212397,19sleep00-21swapper/019:05:150
21749211395,13sleep30-21swapper/319:06:343
21819210998,6sleep10-21swapper/119:07:281
21307210992,12sleep20-21swapper/219:05:572
27742750,1sleep20-21swapper/222:10:442
324452700,0sleep30-21swapper/323:12:543
146402670,1sleep30-21swapper/321:18:153
99342260,0sleep1221ktimersoftd/122:50:151
53282220,0sleep10-21swapper/121:40:491
2204199171,14cyclictest18211-21ssh22:26:011
2204099173,2cyclictest101ktimersoftd/022:36:010
2204199161,3cyclictest0-21swapper/121:21:021
2204199161,2cyclictest28010-21apt-get20:45:051
2204199161,13cyclictest5848-21diskmemload21:45:131
2204199161,13cyclictest0-21swapper/123:00:111
2204199160,14cyclictest5848-21diskmemload00:25:481
2204099161,13cyclictest7562-21iostat00:25:190
22042991510,3cyclictest8873-21munin-node2
2204299150,13cyclictest20854-21munin-run21:24:592
2204299150,13cyclictest0-21swapper/221:35:122
22041991512,2cyclictest0-21swapper/121:35:151
22041991512,2cyclictest0-21swapper/121:27:451
22041991512,2cyclictest0-21swapper/120:05:151
22041991511,3cyclictest21963-21turbostat20:34:551
2204199150,14cyclictest0-21swapper/123:16:451
2204199150,13cyclictest0-21swapper/122:02:271
22040991511,2cyclictest1938-21aten2.4_r3power21:00:100
2204099151,12cyclictest0-21swapper/021:15:500
22040991510,3cyclictest18782-21ssh22:59:550
2204099150,13cyclictest0-21swapper/022:10:150
2204099150,13cyclictest0-21swapper/022:00:180
137982150,0sleep00-21swapper/000:31:030
315562141,3sleep331679-21telnet22:40:123
277502140,3sleep20-21swapper/221:31:012
22043991411,2cyclictest1130-21kworker/u8:022:54:043
22043991411,2cyclictest0-21swapper/323:50:123
2204399140,12cyclictest6888-21kworker/u8:200:35:043
2204399140,12cyclictest0-21swapper/323:20:133
2204399140,12cyclictest0-21swapper/321:20:163
2204399140,12cyclictest0-21swapper/300:00:023
2204299141,2cyclictest21536-21apt-get23:35:112
22042991411,2cyclictest7583-21ssh00:25:182
22042991411,2cyclictest0-21swapper/219:41:012
2204299140,12cyclictest0-21swapper/223:51:412
2204299140,12cyclictest0-21swapper/222:35:032
2204299140,12cyclictest0-21swapper/221:52:132
2204299140,12cyclictest0-21swapper/221:19:012
2204299140,12cyclictest0-21swapper/220:50:112
2204299140,12cyclictest0-21swapper/220:15:012
22041991411,2cyclictest0-21swapper/123:48:051
22041991411,2cyclictest0-21swapper/123:35:131
22041991411,2cyclictest0-21swapper/123:06:251
22041991411,2cyclictest0-21swapper/122:44:551
22041991411,2cyclictest0-21swapper/122:08:351
2204199140,2cyclictest0-21swapper/122:30:251
2204199140,2cyclictest0-21swapper/100:08:451
2204199140,1cyclictest0-21swapper/121:16:351
2204199140,13cyclictest0-21swapper/123:51:251
2204199140,13cyclictest0-21swapper/123:41:251
2204199140,13cyclictest0-21swapper/123:27:351
2204199140,13cyclictest0-21swapper/122:15:551
2204199140,13cyclictest0-21swapper/120:11:051
2204199140,13cyclictest0-21swapper/100:37:361
2204199140,12cyclictest4720-21fschecks_count22:45:151
2204199140,12cyclictest2842-21cut22:10:491
2204199140,12cyclictest0-21swapper/100:00:151
2204099141,3cyclictest25271-21ssh23:38:400
22040991411,2cyclictest0-21swapper/023:02:490
22040991411,2cyclictest0-21swapper/021:56:400
2204099140,2cyclictest0-21swapper/022:49:100
2204099140,2cyclictest0-21swapper/022:42:090
2204099140,2cyclictest0-21swapper/022:23:260
2204099140,13cyclictest3450-21kworker/u8:120:17:050
2204099140,13cyclictest3450-21kworker/u8:120:17:040
2204099140,13cyclictest24078-21ssh22:31:490
2204099140,13cyclictest0-21swapper/023:51:390
2204099140,13cyclictest0-21swapper/000:01:300
2204099140,12cyclictest0-21swapper/022:07:190
2204099140,12cyclictest0-21swapper/021:38:520
2204099140,12cyclictest0-21swapper/021:26:300
2204099140,12cyclictest0-21swapper/019:50:160
211592140,2sleep00-21swapper/000:39:380
195472140,2sleep00-21swapper/021:23:050
81872130,2sleep10-21swapper/123:20:351
57762130,2sleep35848-21diskmemload21:41:053
326642130,9sleep00-21swapper/020:55:120
22043991310,2cyclictest0-21swapper/323:34:123
22043991310,2cyclictest0-21swapper/323:01:333
22043991310,2cyclictest0-21swapper/322:17:593
22043991310,2cyclictest0-21swapper/321:11:013
2204399130,2cyclictest5848-21diskmemload00:30:113
2204399130,2cyclictest0-21swapper/321:56:433
2204399130,2cyclictest0-21swapper/319:30:123
2204399130,12cyclictest0-21swapper/323:45:203
2204399130,12cyclictest0-21swapper/321:50:133
2204399130,12cyclictest0-21swapper/320:20:133
2204399130,12cyclictest0-21swapper/320:20:133
2204399130,12cyclictest0-21swapper/300:11:023
2204399130,11cyclictest630-21ssh22:09:243
2204399130,11cyclictest30573-21kworker/u8:223:56:043
2204399130,11cyclictest23749-21ssh23:36:223
2204399130,11cyclictest22219-21kworker/u8:120:41:043
2204399130,11cyclictest0-21swapper/323:18:293
2204299139,2cyclictest0-21swapper/219:35:152
22042991310,2cyclictest0-21swapper/223:46:312
22042991310,2cyclictest0-21swapper/223:32:342
22042991310,2cyclictest0-21swapper/223:26:042
22042991310,2cyclictest0-21swapper/223:18:012
22042991310,2cyclictest0-21swapper/223:05:232
22042991310,2cyclictest0-21swapper/222:58:552
22042991310,2cyclictest0-21swapper/222:50:132
22042991310,2cyclictest0-21swapper/222:49:202
22042991310,2cyclictest0-21swapper/222:30:342
22042991310,2cyclictest0-21swapper/222:26:212
22042991310,2cyclictest0-21swapper/222:03:592
22042991310,2cyclictest0-21swapper/221:58:002
22042991310,2cyclictest0-21swapper/221:42:112
22042991310,2cyclictest0-21swapper/219:30:172
22042991310,2cyclictest0-21swapper/200:18:242
22042991310,2cyclictest0-21swapper/200:12:412
22042991310,2cyclictest0-21swapper/200:01:442
2204299130,2cyclictest0-21swapper/223:24:052
2204299130,2cyclictest0-21swapper/223:11:432
2204299130,2cyclictest0-21swapper/222:15:132
2204299130,2cyclictest0-21swapper/220:30:122
2204299130,2cyclictest0-21swapper/200:21:352
2204299130,12cyclictest0-21swapper/223:56:002
2204299130,12cyclictest0-21swapper/223:40:122
2204299130,12cyclictest0-21swapper/222:41:332
2204299130,12cyclictest0-21swapper/222:24:292
2204299130,12cyclictest0-21swapper/222:05:112
2204299130,12cyclictest0-21swapper/221:13:192
2204299130,12cyclictest0-21swapper/220:56:002
2204299130,12cyclictest0-21swapper/200:30:542
22041991310,2cyclictest28857-21apt-get23:10:061
22041991310,2cyclictest0-21swapper/123:55:141
22041991310,2cyclictest0-21swapper/123:34:271
22041991310,2cyclictest0-21swapper/122:21:071
22041991310,2cyclictest0-21swapper/100:15:351
2204199130,2cyclictest0-21swapper/121:10:271
2204199130,2cyclictest0-21swapper/100:24:361
2204199130,12cyclictest0-21swapper/122:55:281
2204199130,12cyclictest0-21swapper/121:30:591
2204199130,12cyclictest0-21swapper/120:20:151
2204199130,12cyclictest0-21swapper/120:20:141
2204199130,12cyclictest0-21swapper/119:45:151
2204199130,12cyclictest0-21swapper/100:11:281
22040991310,2cyclictest5848-21diskmemload23:40:430
22040991310,2cyclictest5848-21diskmemload21:43:470
22040991310,2cyclictest28216-21cut20:45:010
22040991310,2cyclictest12334-21ssh23:57:460
22040991310,2cyclictest0-21swapper/023:20:400
22040991310,2cyclictest0-21swapper/023:10:040
22040991310,2cyclictest0-21swapper/022:27:110
22040991310,2cyclictest0-21swapper/021:45:190
22040991310,2cyclictest0-21swapper/021:05:140
22040991310,2cyclictest0-21swapper/019:15:170
2204099130,2cyclictest0-21swapper/023:26:580
2204099130,2cyclictest0-21swapper/022:51:400
2204099130,2cyclictest0-21swapper/022:16:590
2204099130,12cyclictest0-21swapper/023:30:110
2204099130,12cyclictest0-21swapper/023:17:190
2204099130,12cyclictest0-21swapper/021:53:430
2204099130,12cyclictest0-21swapper/021:30:190
2204099130,12cyclictest0-21swapper/021:10:390
2204099130,12cyclictest0-21swapper/019:55:000
2204099130,12cyclictest0-21swapper/019:35:120
2204099130,12cyclictest0-21swapper/019:25:150
2204099130,12cyclictest0-21swapper/000:10:160
2204099130,12cyclictest0-21swapper/000:08:190
2204099130,11cyclictest0-21swapper/000:20:330
167632130,2sleep20-21swapper/200:35:122
2204399129,2cyclictest25693-21ssh23:05:533
2204399129,2cyclictest0-21swapper/323:27:293
2204399129,2cyclictest0-21swapper/322:48:033
2204399129,2cyclictest0-21swapper/322:10:303
2204399129,2cyclictest0-21swapper/321:26:403
2204399129,2cyclictest0-21swapper/320:50:153
2204399129,2cyclictest0-21swapper/320:35:113
2204399129,2cyclictest0-21swapper/300:09:023
2204399121,3cyclictest14435-21df20:10:153
2204399120,2cyclictest28742-21ssh22:36:213
2204399120,2cyclictest27999-21rm23:40:523
2204399120,2cyclictest23783-21ssh22:00:033
2204399120,2cyclictest0-21swapper/319:20:163
2204399120,2cyclictest0-21swapper/319:16:033
2204399120,11cyclictest478-21kworker/u8:100:20:053
2204399120,11cyclictest26492-21kworker/u8:000:25:043
2204399120,11cyclictest26492-21kworker/u8:000:15:043
2204399120,11cyclictest0-21swapper/322:31:033
2204399120,11cyclictest0-21swapper/322:25:003
2204399120,11cyclictest0-21swapper/321:31:403
2204399120,11cyclictest0-21swapper/320:55:113
2204399120,10cyclictest25926-21kworker/u8:119:26:043
2204299129,2cyclictest0-21swapper/220:25:192
2204299120,2cyclictest0-21swapper/223:00:482
2204299120,2cyclictest0-21swapper/221:27:012
2204299120,2cyclictest0-21swapper/219:45:142
2204299120,11cyclictest0-21swapper/220:45:132
2204299120,11cyclictest0-21swapper/200:07:542
2204199129,2cyclictest0-21swapper/119:25:151
2204199129,2cyclictest0-21swapper/119:10:391
2204199127,3cyclictest0-21swapper/120:16:031
2204199127,3cyclictest0-21swapper/120:16:031
2204199121,9cyclictest1880-21munin-node1
2204199121,3cyclictest12598-21sed00:30:151
2204199121,3cyclictest0-21swapper/119:35:161
2204199121,10cyclictest0-21swapper/120:40:111
2204199120,3cyclictest20207-21cut21:55:431
2204199120,3cyclictest0-21swapper/121:06:051
2204199120,11cyclictest0-21swapper/122:35:461
2204199120,11cyclictest0-21swapper/121:50:061
2204099129,2cyclictest0-21swapper/019:10:110
2204099129,2cyclictest0-21swapper/000:15:250
2204099120,1cyclictest0-21swapper/020:10:150
2204099120,11cyclictest0-21swapper/023:45:590
2204099120,11cyclictest0-21swapper/023:05:200
2204099120,11cyclictest0-21swapper/020:45:180
2204099120,11cyclictest0-21swapper/020:09:190
158232120,2sleep30-21swapper/322:24:253
47452110,2sleep00-21swapper/019:45:170
2204399116,3cyclictest0-21swapper/320:34:553
2204399110,9cyclictest0-21swapper/321:45:213
2204399110,10cyclictest32477-21kworker/u8:219:37:043
2204399110,10cyclictest14185-21kworker/u8:019:10:043
2204399110,10cyclictest13600-21kworker/u8:221:07:043
2204399110,10cyclictest0-21swapper/322:57:383
2204399110,10cyclictest0-21swapper/321:38:323
2204299118,2cyclictest0-21swapper/221:00:092
2204299110,10cyclictest3450-21kworker/u8:119:50:042
2204299110,10cyclictest14185-21kworker/u8:019:15:042
2204199118,2cyclictest1870-21apt-get21:00:101
2204199111,3cyclictest0-21swapper/120:55:151
2204199111,3cyclictest0-21swapper/120:35:171
2204199111,2cyclictest26295-21apt-get19:20:091
2204199110,9cyclictest0-21swapper/119:15:121
2204199110,3cyclictest9869-21cron20:00:001
2204199110,10cyclictest0-21swapper/119:50:291
2204099118,2cyclictest0-21swapper/019:20:100
2204099110,1cyclictest0-21swapper/020:35:130
20962110,2sleep30-21swapper/319:40:123
112732110,1sleep337-21rcuc/320:01:023
2204399107,2cyclictest0-21swapper/320:45:193
2204399105,3cyclictest8616-21grep19:55:133
2204399105,3cyclictest20465-21tr20:25:133
2204399100,2cyclictest0-21swapper/320:18:193
2204399100,2cyclictest0-21swapper/320:18:193
2204299107,2cyclictest0-21swapper/220:35:142
2204299107,2cyclictest0-21swapper/220:00:132
2204299105,3cyclictest18798-21if_eth020:20:152
2204299105,3cyclictest18798-21if_eth020:20:152
2204299100,9cyclictest22219-21kworker/u8:120:44:062
2204199105,3cyclictest30419-21aten2.4_r3power20:50:111
2204199101,3cyclictest0-21swapper/119:31:021
2204199100,2cyclictest0-21swapper/120:25:101
2204099105,3cyclictest21540-21grep20:26:020
2204099104,4cyclictest30388-21tail20:50:110
2204099101,3cyclictest32093-21cron19:35:000
22245290,1sleep20-21swapper/219:10:072
220439994,3cyclictest3127-21nscd19:45:153
220439990,8cyclictest0-21swapper/321:00:133
220439990,7cyclictest3450-21kworker/u8:120:05:043
220429995,2cyclictest3728-21runrttasks19:28:062
220429994,3cyclictest8746-21interrupts19:55:142
220419990,3cyclictest0-21swapper/120:00:161
220409996,2cyclictest0-21swapper/020:30:090
220409994,3cyclictest2024-21aten2.4_r3power19:40:100
220409994,3cyclictest10479-21df_abs20:00:150
220439984,2cyclictest6116-21cut19:50:113
220429983,3cyclictest4177-21grep21:05:132
220429983,3cyclictest27064-21load19:20:152
220429983,3cyclictest16464-21df_abs20:15:152
220429983,3cyclictest16464-21df_abs20:15:152
220429983,3cyclictest12208-21aten2.4-expect20:05:112
220409984,3cyclictest18268-21basename20:20:130
220409984,3cyclictest18268-21basename20:20:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional