You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 13:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue May 12, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1156321390,1sleep121-21rcuc/122:16:021
1799721380,1sleep10-21swapper/121:13:491
29978211495,14sleep30-21swapper/319:06:073
28276211391,15sleep10-21swapper/119:05:011
30002211194,12sleep20-21swapper/219:06:262
30279210981,6sleep00-21swapper/019:09:570
209132920,1sleep220917-21unixbench_multi00:11:022
113922780,0sleep00-21swapper/022:15:530
45232720,0sleep30-21swapper/321:34:273
44722660,1sleep20-21swapper/221:34:222
3031299230,2cyclictest0-21swapper/223:05:112
3031099210,19cyclictest0-21swapper/020:50:130
3031099210,19cyclictest0-21swapper/020:45:120
30312992017,2cyclictest0-21swapper/220:00:102
3031199200,18cyclictest207150irq/24-eth122:50:151
3031199200,18cyclictest0-21swapper/100:31:441
3031199194,3cyclictest28476-21aten2.4_r3power00:20:131
3031199191,3cyclictest0-21swapper/123:26:041
3031199191,16cyclictest5627-21grep21:35:151
3031199190,2cyclictest0-21swapper/121:45:511
3031199190,1cyclictest0-21swapper/122:47:131
3031199190,18cyclictest0-21swapper/122:21:131
3031099190,3cyclictest0-21swapper/019:29:050
178172190,1sleep2301ktimersoftd/221:13:302
3031199187,2cyclictest0-21swapper/120:10:191
3031199186,3cyclictest26996-21cut20:20:151
3031199181,3cyclictest9703-21apt-get21:40:121
3031199181,15cyclictest0-21swapper/123:35:141
3031199181,15cyclictest0-21swapper/121:00:141
3031199181,15cyclictest0-21swapper/119:45:151
3031199180,2cyclictest0-21swapper/122:06:241
3031199180,16cyclictest28370-21munin-node1
3031199180,16cyclictest16305-21timerandwakeup22:56:021
3031199180,16cyclictest0-21swapper/123:40:181
3031099180,16cyclictest0-21swapper/023:45:120
235832180,0sleep337-21rcuc/300:15:003
3031199175,3cyclictest1049-21df_abs00:25:141
3031199171,6cyclictest0-21swapper/123:50:041
3031199171,3cyclictest14088-21diskmemload22:40:181
3031199171,14cyclictest0-21swapper/119:10:151
3031199170,2cyclictest0-21swapper/123:03:231
3031199170,15cyclictest0-21swapper/121:30:121
3031199170,15cyclictest0-21swapper/121:20:141
3031199170,15cyclictest0-21swapper/120:05:171
3031199170,15cyclictest0-21swapper/100:05:421
3031099170,3cyclictest0-21swapper/023:41:050
316922160,0sleep20-21swapper/222:38:192
30312991613,2cyclictest301ktimersoftd/219:15:112
3031199166,2cyclictest0-21swapper/123:20:111
3031199164,3cyclictest3305-21cron19:44:591
3031199164,3cyclictest32687-21aten2.4-expect19:15:111
3031199164,3cyclictest3127-21nscd23:47:111
3031199164,3cyclictest3107-21sh23:17:061
3031199164,3cyclictest2140-21aten2.4-expect19:20:111
3031199164,3cyclictest0-21swapper/122:30:151
3031199164,2cyclictest207150irq/24-eth100:03:171
3031199164,2cyclictest0-21swapper/123:06:031
3031199162,4cyclictest0-21swapper/122:25:451
3031199161,6cyclictest0-21swapper/123:59:521
3031199161,6cyclictest0-21swapper/121:50:111
3031199161,5cyclictest14088-21diskmemload00:10:131
3031199161,4cyclictest5241-21ssh22:10:071
3031199161,3cyclictest0-21swapper/121:59:241
3031199161,3cyclictest0-21swapper/100:36:421
3031199161,2cyclictest0-21swapper/122:03:461
3031199161,2cyclictest0-21swapper/120:40:111
3031199161,13cyclictest0-21swapper/120:26:021
3031199160,8cyclictest0-21swapper/123:30:031
3031199160,7cyclictest0-21swapper/100:15:131
3031199160,3cyclictest24437-21munin-node1
3031199160,3cyclictest0-21swapper/121:05:171
3031199160,2cyclictest0-21swapper/121:25:121
3031199160,1cyclictest0-21swapper/123:13:041
3031199160,14cyclictest0-21swapper/120:00:171
3031099163,2cyclictest11-21rcuc/021:06:020
3031099161,13cyclictest0-21swapper/000:36:050
3031099160,14cyclictest11-21rcuc/000:30:160
232482160,1sleep0101ktimersoftd/021:54:520
3031399152,7cyclictest0-21swapper/322:30:013
3031399151,3cyclictest16850-21ssh00:06:523
30313991510,3cyclictest0-21swapper/322:12:023
3031399150,13cyclictest0-21swapper/322:00:013
3031399150,13cyclictest0-21swapper/321:15:183
3031399150,13cyclictest0-21swapper/320:25:113
3031299150,13cyclictest0-21swapper/222:45:162
3031199154,3cyclictest8709-21fschecks_count20:55:151
3031199154,2cyclictest6254-21munin-node1
3031199153,3cyclictest8725-21df19:35:141
3031199153,3cyclictest4350-21aten2.4_r3power20:45:131
3031199152,3cyclictest17057-21munin-node1
3031199151,3cyclictest7766-21grep19:31:021
3031199150,5cyclictest0-21swapper/121:15:281
3031199150,2cyclictest0-21swapper/119:51:021
3031199150,13cyclictest30488-21munin-node1
3031099152,7cyclictest5003-21copy22:10:000
30310991512,2cyclictest9-21ksoftirqd/021:17:550
30310991510,3cyclictest8874-21ssh21:39:080
3031099150,2cyclictest0-21swapper/023:10:110
3031099150,2cyclictest0-21swapper/000:15:150
3031399141,11cyclictest30554-21ssh23:11:303
3031399141,11cyclictest19775-21hddtemp_smartct23:00:163
30313991410,2cyclictest28288-21apt-get21:25:113
30313991410,2cyclictest14088-21diskmemload22:15:593
3031399140,3cyclictest3649-21snmpd21:46:483
3031399140,12cyclictest949-21munin-node3
3031399140,12cyclictest30276-21ssh22:01:103
3031399140,12cyclictest23247-21runrttasks21:54:513
3031399140,12cyclictest0-21swapper/323:38:433
3031399140,12cyclictest0-21swapper/323:30:183
3031299141,11cyclictest8087-21ssh00:32:222
3031199143,2cyclictest0-21swapper/119:25:131
3031199141,3cyclictest425-21taskset20:35:141
3031099149,3cyclictest13245-21ssh00:03:310
3031099142,7cyclictest0-21swapper/022:50:010
3031099142,6cyclictest0-21swapper/020:14:590
3031099142,6cyclictest0-21swapper/000:05:010
30310991412,1cyclictest0-21swapper/023:16:050
30310991411,2cyclictest26170-21ssh23:06:450
72902130,2sleep314088-21diskmemload21:36:243
3031399139,2cyclictest0-21swapper/323:48:523
3031399131,11cyclictest9382-21ssh23:24:533
30313991310,2cyclictest2852-21ssh22:41:313
30313991310,2cyclictest14088-21diskmemload00:20:013
30313991310,2cyclictest0-21swapper/323:41:133
30313991310,2cyclictest0-21swapper/323:08:393
30313991310,2cyclictest0-21swapper/321:11:383
30313991310,2cyclictest0-21swapper/320:30:303
30313991310,2cyclictest0-21swapper/300:30:403
3031399130,2cyclictest27173-21ssh21:23:433
3031399130,2cyclictest14088-21diskmemload22:08:303
3031399130,2cyclictest0-21swapper/322:23:213
3031399130,2cyclictest0-21swapper/300:17:133
3031399130,12cyclictest0-21swapper/300:25:203
3031399130,11cyclictest0-21swapper/322:35:313
3031399130,11cyclictest0-21swapper/300:35:223
30312991310,2cyclictest0-21swapper/223:40:282
30312991310,2cyclictest0-21swapper/223:37:472
30312991310,2cyclictest0-21swapper/223:25:152
30312991310,2cyclictest0-21swapper/200:36:012
30312991310,2cyclictest0-21swapper/200:03:372
3031299130,2cyclictest14088-21diskmemload23:15:132
3031299130,2cyclictest0-21swapper/223:00:142
3031299130,2cyclictest0-21swapper/222:59:312
3031299130,2cyclictest0-21swapper/200:16:452
3031299130,12cyclictest0-21swapper/221:22:062
3031299130,11cyclictest10780-21ssh22:15:162
3031299130,11cyclictest0-21swapper/223:53:532
3031299130,11cyclictest0-21swapper/223:31:422
3031099138,3cyclictest2611-21ssh22:06:270
3031099138,3cyclictest0-21swapper/021:20:240
3031099131,2cyclictest9526-21latency_hist00:00:000
3031099131,2cyclictest0-21swapper/023:50:160
3031099131,11cyclictest11-21rcuc/022:20:580
30310991310,2cyclictest14088-21diskmemload22:04:450
30310991310,2cyclictest0-21swapper/023:34:350
30310991310,2cyclictest0-21swapper/022:42:550
30310991310,2cyclictest0-21swapper/021:10:550
3031099130,2cyclictest0-21swapper/023:01:090
3031099130,12cyclictest9-21ksoftirqd/000:10:120
3031099130,12cyclictest0-21swapper/022:57:440
3031099130,12cyclictest0-21swapper/022:28:350
3031099130,12cyclictest0-21swapper/021:47:210
3031099130,12cyclictest0-21swapper/019:20:140
3031099130,11cyclictest0-21swapper/022:45:100
3031099130,11cyclictest0-21swapper/022:38:520
3031099130,11cyclictest0-21swapper/021:00:120
10192130,2sleep00-21swapper/021:30:150
63462120,2sleep30-21swapper/323:55:243
304872121,2sleep230491-21apt-get20:30:112
3031399129,2cyclictest0-21swapper/323:50:123
3031399129,2cyclictest0-21swapper/323:25:193
3031399129,2cyclictest0-21swapper/323:16:123
3031399129,2cyclictest0-21swapper/322:30:303
3031399129,2cyclictest0-21swapper/321:42:413
3031399129,2cyclictest0-21swapper/320:40:113
3031399123,5cyclictest0-21swapper/319:21:003
3031399122,7cyclictest0-21swapper/320:15:003
3031399121,9cyclictest6839-21http_loadtime20:50:153
3031399121,6cyclictest0-21swapper/319:50:003
3031399120,2cyclictest0-21swapper/322:56:073
3031399120,1cyclictest0-21swapper/319:31:003
3031399120,11cyclictest0-21swapper/322:50:233
3031399120,11cyclictest0-21swapper/322:48:203
3031399120,11cyclictest0-21swapper/321:00:133
3031399120,11cyclictest0-21swapper/319:15:103
3031399120,11cyclictest0-21swapper/319:10:113
3031399120,11cyclictest0-21swapper/300:01:583
3031299129,2cyclictest9536-21ssh22:14:512
3031299129,2cyclictest301ktimersoftd/222:05:322
3031299129,2cyclictest14088-21diskmemload23:10:232
3031299129,2cyclictest0-21swapper/222:41:262
3031299129,2cyclictest0-21swapper/222:26:082
3031299129,2cyclictest0-21swapper/222:20:462
3031299129,2cyclictest0-21swapper/221:46:572
3031299129,2cyclictest0-21swapper/221:36:372
3031299127,3cyclictest30523-21munin-node2
3031299121,6cyclictest0-21swapper/220:50:002
3031299120,6cyclictest22371-21runrttasks20:10:002
3031299120,2cyclictest0-21swapper/223:59:472
3031299120,2cyclictest0-21swapper/222:32:452
3031299120,2cyclictest0-21swapper/222:00:192
3031299120,2cyclictest0-21swapper/220:25:152
3031299120,2cyclictest0-21swapper/200:20:242
3031299120,2cyclictest0-21swapper/200:05:182
3031299120,11cyclictest0-21swapper/223:45:222
3031299120,11cyclictest0-21swapper/222:50:122
3031299120,11cyclictest0-21swapper/221:29:162
3031299120,11cyclictest0-21swapper/220:40:152
3031299120,11cyclictest0-21swapper/200:25:482
3031099129,2cyclictest0-21swapper/023:35:590
3031099129,2cyclictest0-21swapper/022:31:140
3031099129,2cyclictest0-21swapper/021:28:480
3031099129,2cyclictest0-21swapper/020:20:140
3031099129,2cyclictest0-21swapper/000:20:120
3031099120,2cyclictest0-21swapper/021:40:510
3031099120,2cyclictest0-21swapper/019:40:490
3031099120,11cyclictest14088-21diskmemload23:22:220
3031099120,11cyclictest0-21swapper/023:25:180
3031099120,11cyclictest0-21swapper/020:26:020
3031099120,11cyclictest0-21swapper/020:05:170
3031099120,11cyclictest0-21swapper/019:46:060
3031099120,11cyclictest0-21swapper/019:11:050
3031099120,11cyclictest0-21swapper/000:26:500
261652120,2sleep00-21swapper/021:57:010
3031399112,6cyclictest0-21swapper/320:09:023
3031299112,5cyclictest0-21swapper/220:25:002
3031299111,5cyclictest0-21swapper/220:00:002
3031299111,5cyclictest0-21swapper/219:45:002
3031299110,2cyclictest0-21swapper/223:20:012
3031299110,2cyclictest0-21swapper/221:55:322
3031299110,10cyclictest0-21swapper/221:54:262
3031099111,7cyclictest0-21swapper/020:04:590
3031099111,6cyclictest0-21swapper/019:31:000
3031099110,10cyclictest0-21swapper/020:44:350
189512110,2sleep20-21swapper/221:15:062
3031399102,7cyclictest0-21swapper/320:57:023
3031399102,7cyclictest0-21swapper/320:22:023
3031399100,8cyclictest3649-21snmpd19:36:053
3031399100,6cyclictest0-21swapper/319:26:003
3031299107,2cyclictest0-21swapper/219:25:052
3031299105,3cyclictest14088-21diskmemload21:40:012
3031299100,8cyclictest0-21swapper/221:05:132
3031099107,2cyclictest0-21swapper/020:32:360
3031099107,2cyclictest0-21swapper/019:15:140
3031099105,3cyclictest8435-21basename19:35:120
3031099100,2cyclictest0-21swapper/020:14:590
3031099100,1cyclictest0-21swapper/019:52:140
133742100,2sleep30-21swapper/321:06:023
303139994,3cyclictest25287-21tail20:15:193
303139994,3cyclictest18780-21df_abs20:00:123
303139994,3cyclictest17806-21unixbench_singl19:56:043
303139994,3cyclictest14609-21tr19:50:133
303129994,3cyclictest7561-21threads19:31:022
303129991,7cyclictest0-21swapper/220:12:592
303129991,6cyclictest0-21swapper/220:51:352
303129991,5cyclictest0-21swapper/221:05:002
303129991,4cyclictest0-21swapper/220:40:002
303129990,8cyclictest0-21swapper/220:15:452
303109996,2cyclictest0-21swapper/019:55:180
303109994,3cyclictest8388-21head20:55:120
303109994,3cyclictest3728-21runrttasks20:39:360
303139983,3cyclictest10521-21cpu19:40:133
303139981,5cyclictest4281-21basename20:45:133
303129983,3cyclictest9727-21unixbench_multi19:36:022
303129983,3cyclictest9382-21cut20:56:012
303129983,3cyclictest2370-21tr19:20:132
303129983,3cyclictest15103-21latency19:50:162
303129983,3cyclictest12674-21sh19:45:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional