You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 10:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sat Dec 06, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
96202114103,6sleep10-21swapper/119:09:171
9601211194,12sleep20-21swapper/219:09:022
9579211089,16sleep00-21swapper/019:08:430
9648210279,6sleep30-21swapper/319:09:393
281912700,1sleep231-21ksoftirqd/219:55:122
190322700,0sleep20-21swapper/220:50:242
33062590,0sleep20-21swapper/222:29:402
9705994928,19cyclictest0-21swapper/019:15:110
9705993617,18cyclictest0-21swapper/022:55:130
970899320,30cyclictest0-21swapper/320:35:113
9706992514,6cyclictest221ktimersoftd/123:14:051
970799230,21cyclictest0-21swapper/222:58:192
36932230,1sleep1221ktimersoftd/100:13:301
970799221,19cyclictest23750-21ssh00:35:132
970799221,13cyclictest26609-21ssh00:03:072
970799220,2cyclictest0-21swapper/222:23:192
970799220,2cyclictest0-21swapper/222:11:392
970799220,2cyclictest0-21swapper/222:11:382
970799220,2cyclictest0-21swapper/200:14:002
970899211,2cyclictest0-21swapper/323:20:153
9707992116,3cyclictest26154-21ssh21:10:122
970799211,2cyclictest0-21swapper/223:10:112
970799210,3cyclictest31728-21ssh21:50:142
970799210,2cyclictest0-21swapper/223:30:252
970799210,2cyclictest0-21swapper/221:58:092
970799210,2cyclictest0-21swapper/221:48:192
970799210,19cyclictest0-21swapper/221:40:322
970799210,19cyclictest0-21swapper/221:23:342
970799210,12cyclictest0-21swapper/222:38:142
970699210,4cyclictest0-21swapper/121:26:051
148072210,2sleep014811-21unixbench_multi22:40:280
970799200,3cyclictest2441-21ssh23:02:362
970799200,3cyclictest21452-21sshd20:55:552
970799200,3cyclictest17254-21timerwakeupswit20:45:232
970799200,3cyclictest155892sleep219:22:592
970799200,3cyclictest13279-21ssh22:40:072
970799200,3cyclictest11354-21taskset19:10:312
970799200,3cyclictest0-21swapper/223:26:062
970799200,3cyclictest0-21swapper/222:52:422
970799200,3cyclictest0-21swapper/222:07:342
970799200,3cyclictest0-21swapper/222:00:512
970799200,3cyclictest0-21swapper/221:35:352
970799200,3cyclictest0-21swapper/200:31:392
970799200,3cyclictest0-21swapper/200:23:312
970799200,2cyclictest0-21swapper/223:51:272
970799200,2cyclictest0-21swapper/223:35:302
970799200,2cyclictest0-21swapper/223:21:502
970799200,2cyclictest0-21swapper/223:18:582
970799200,2cyclictest0-21swapper/200:25:142
970799200,18cyclictest0-21swapper/223:05:042
9706992017,2cyclictest14345-21kworker/u8:221:33:041
9706992015,3cyclictest22717-21kworker/u8:222:56:051
970699200,18cyclictest0-21swapper/120:50:121
970599200,18cyclictest0-21swapper/000:35:130
970799190,3cyclictest22942-21ssh23:59:472
970799190,3cyclictest19661-21ssh22:45:382
970799190,3cyclictest1471-21rm21:18:102
970799190,3cyclictest14269-21sh21:30:552
970799190,3cyclictest13587-21chrt20:38:232
970799190,3cyclictest0-21swapper/222:15:592
970799190,3cyclictest0-21swapper/221:00:272
970799190,2cyclictest3743-21ssh22:30:042
970799190,2cyclictest0-21swapper/223:45:152
970799190,2cyclictest0-21swapper/220:00:262
970799190,2cyclictest0-21swapper/200:05:362
970799190,1cyclictest0-21swapper/221:26:242
9706991916,2cyclictest31154-21kworker/u8:222:27:041
9706991916,2cyclictest2341-21kworker/u8:223:04:041
9706991915,2cyclictest22717-21kworker/u8:222:52:041
21492190,0sleep30-21swapper/321:19:183
970899188,2cyclictest0-21swapper/321:48:393
970899183,6cyclictest0-21swapper/322:25:283
970899181,10cyclictest25827-21diskmemload22:34:543
970899180,2cyclictest0-21swapper/320:55:163
970899180,10cyclictest25827-21diskmemload21:28:253
970899180,10cyclictest0-21swapper/323:31:123
970799180,3cyclictest0-21swapper/219:35:502
970799180,2cyclictest0-21swapper/223:44:352
970799180,2cyclictest0-21swapper/221:05:262
970799180,2cyclictest0-21swapper/220:05:112
970799180,2cyclictest0-21swapper/219:50:142
970799180,2cyclictest0-21swapper/200:15:462
9706991815,2cyclictest9807-21kworker/u8:200:23:051
9706991815,2cyclictest18110-21kworker/u8:021:12:051
970899175,3cyclictest27862-21sh19:55:003
970899173,5cyclictest0-21swapper/319:45:253
970899172,5cyclictest0-21swapper/323:29:593
970899171,14cyclictest2927-21ssh21:20:123
970899170,2cyclictest0-21swapper/321:05:253
970799171,14cyclictest18465-21uniq19:30:152
970799170,2cyclictest16003-21apt-get19:25:102
970799170,2cyclictest0-21swapper/220:32:232
970799170,2cyclictest0-21swapper/220:26:142
970799170,2cyclictest0-21swapper/220:24:272
970799170,2cyclictest0-21swapper/219:48:152
970799170,2cyclictest0-21swapper/219:42:032
970799170,2cyclictest0-21swapper/219:16:382
9706991714,2cyclictest18119-21kworker/u8:000:36:051
970699171,2cyclictest0-21swapper/100:02:041
9706991711,4cyclictest0-21swapper/121:20:121
970699170,2cyclictest0-21swapper/123:37:041
970899165,3cyclictest18047-21telnet19:30:123
970899160,9cyclictest0-21swapper/323:59:193
970899160,9cyclictest0-21swapper/323:40:463
970799160,2cyclictest0-21swapper/220:40:062
970799160,2cyclictest0-21swapper/220:18:102
970799160,2cyclictest0-21swapper/220:10:032
9706991613,2cyclictest27910-21kworker/u8:121:17:041
9706991613,2cyclictest21786-21kworker/u8:121:58:061
9706991613,2cyclictest13600-21kworker/u8:119:25:041
9706991613,2cyclictest10133-21kworker/u8:022:09:041
9706991612,2cyclictest32476-21kworker/u8:223:45:051
9706991611,3cyclictest0-21swapper/121:50:151
970899157,2cyclictest0-21swapper/323:39:353
970899157,2cyclictest0-21swapper/300:39:283
970899155,3cyclictest16954-21cut19:25:173
9706991512,2cyclictest32476-21kworker/u8:223:40:041
9706991512,2cyclictest21786-21kworker/u8:121:45:051
9706991512,2cyclictest21152-21kworker/u8:122:19:051
9706991512,2cyclictest18009-21kworker/u8:219:39:051
9706991512,2cyclictest13600-21kworker/u8:119:19:041
970699151,12cyclictest5129-21runrttasks23:20:231
970699150,10cyclictest0-21swapper/123:30:051
970899142,6cyclictest0-21swapper/320:29:593
970899140,7cyclictest0-21swapper/321:50:583
970899140,6cyclictest0-21swapper/319:35:583
9706991411,2cyclictest3681-21kworker/u8:120:26:041
9706991411,2cyclictest30102-21kworker/u8:220:42:011
9706991411,2cyclictest2341-21kworker/u8:223:06:051
9706991411,2cyclictest21786-21kworker/u8:121:42:041
9706991411,2cyclictest13600-21kworker/u8:119:54:041
9706991411,2cyclictest0-21swapper/123:18:511
9706991410,2cyclictest19162-21aten2.4-expect00:30:141
9706991410,2cyclictest18781-21ssh23:55:141
970699140,3cyclictest8928-21ssh22:00:171
970699140,2cyclictest332250irq/24-eth123:50:041
970699140,2cyclictest0-21swapper/123:28:041
970699140,2cyclictest0-21swapper/120:55:221
970699140,2cyclictest0-21swapper/100:27:211
970699140,12cyclictest0-21swapper/122:10:251
970699140,12cyclictest0-21swapper/122:10:241
9705991411,2cyclictest29750-21kworker/u8:023:01:040
9705991411,2cyclictest0-21swapper/022:05:150
970599140,2cyclictest0-21swapper/000:18:240
970599140,13cyclictest0-21swapper/019:30:260
970899138,3cyclictest9107-21apt-get23:45:053
970899132,6cyclictest0-21swapper/320:35:003
970899130,6cyclictest0-21swapper/321:55:243
970899130,5cyclictest0-21swapper/300:19:553
970899130,3cyclictest0-21swapper/300:22:523
970899130,2cyclictest0-21swapper/300:25:163
970899130,12cyclictest0-21swapper/322:05:143
970899130,11cyclictest0-21swapper/322:45:103
970899130,11cyclictest0-21swapper/321:30:053
9706991310,2cyclictest3932-21kworker/u8:100:16:041
9706991310,2cyclictest31154-21kworker/u8:222:31:051
9706991310,2cyclictest30102-21kworker/u8:220:38:051
9706991310,2cyclictest22180-21kworker/u8:020:13:051
9706991310,2cyclictest18009-21kworker/u8:219:31:051
9706991310,2cyclictest13600-21kworker/u8:119:57:051
9706991310,2cyclictest13600-21kworker/u8:119:47:051
9706991310,2cyclictest13600-21kworker/u8:119:23:051
9706991310,2cyclictest0-21swapper/122:35:011
9706991310,2cyclictest0-21swapper/120:15:241
9706991310,2cyclictest0-21swapper/100:06:041
970699130,2cyclictest0-21swapper/122:46:561
970699130,2cyclictest0-21swapper/122:42:351
970699130,2cyclictest0-21swapper/120:30:161
970699130,12cyclictest0-21swapper/120:21:051
970699130,11cyclictest18843-21ssh21:35:461
9705991310,2cyclictest25827-21diskmemload23:14:150
9705991310,2cyclictest10133-21kworker/u8:022:10:020
9705991310,2cyclictest10133-21kworker/u8:022:10:020
9705991310,2cyclictest0-21swapper/023:15:260
9705991310,2cyclictest0-21swapper/000:26:450
9705991310,2cyclictest0-21swapper/000:00:290
970599130,2cyclictest3324-21apt-get21:55:100
970599130,2cyclictest25827-21diskmemload23:50:340
970599130,2cyclictest25827-21diskmemload22:21:550
970599130,12cyclictest0-21swapper/021:20:160
970599130,11cyclictest0-21swapper/022:32:240
970599130,11cyclictest0-21swapper/022:04:050
93982130,2sleep00-21swapper/023:45:080
970899129,2cyclictest0-21swapper/323:10:353
970899129,2cyclictest0-21swapper/300:10:223
970899127,3cyclictest0-21swapper/321:13:173
970899122,7cyclictest0-21swapper/321:43:583
970899121,3cyclictest15759-21munin-run19:25:013
970899120,5cyclictest0-21swapper/319:18:023
970899120,2cyclictest0-21swapper/323:02:323
970899120,2cyclictest0-21swapper/319:40:263
970899120,11cyclictest0-21swapper/323:50:133
970899120,11cyclictest0-21swapper/322:35:453
970899120,11cyclictest0-21swapper/320:05:113
970899120,10cyclictest0-21swapper/320:04:553
970699129,2cyclictest30102-21kworker/u8:220:49:051
970699129,2cyclictest30102-21kworker/u8:220:07:041
970699129,2cyclictest0-21swapper/122:20:061
970699129,2cyclictest0-21swapper/121:00:171
970699129,2cyclictest0-21swapper/119:10:191
970699122,7cyclictest0-21swapper/120:03:591
970599129,2cyclictest25827-21diskmemload00:34:550
970599129,2cyclictest21786-21kworker/u8:121:51:050
970599129,2cyclictest0-21swapper/023:32:110
970599129,2cyclictest0-21swapper/023:20:150
970599122,7cyclictest0-21swapper/020:32:580
970599122,7cyclictest0-21swapper/020:06:010
970599121,6cyclictest21499-21ssh21:40:010
970599120,2cyclictest0-21swapper/021:32:150
970599120,2cyclictest0-21swapper/021:26:540
970599120,2cyclictest0-21swapper/000:22:350
970599120,2cyclictest0-21swapper/000:05:140
970599120,11cyclictest0-21swapper/022:45:190
970599120,11cyclictest0-21swapper/021:46:560
970599120,11cyclictest0-21swapper/020:15:150
970599120,11cyclictest0-21swapper/020:10:210
970599120,11cyclictest0-21swapper/019:45:250
970899118,2cyclictest25827-21diskmemload00:03:153
970899118,2cyclictest0-21swapper/323:16:133
970899118,2cyclictest0-21swapper/322:44:543
970899118,2cyclictest0-21swapper/322:10:283
970899118,2cyclictest0-21swapper/322:10:273
970899118,2cyclictest0-21swapper/322:01:513
970899118,2cyclictest0-21swapper/320:20:163
970899116,3cyclictest23784-21sed22:15:293
970899115,4cyclictest4324-21nscd00:05:163
970899112,7cyclictest0-21swapper/320:11:023
970899112,7cyclictest0-21swapper/319:10:583
970899112,6cyclictest0-21swapper/320:45:023
970899111,6cyclictest0-21swapper/322:20:143
970899110,9cyclictest0-21swapper/321:38:093
970899110,2cyclictest0-21swapper/323:06:033
970599118,2cyclictest27910-21kworker/u8:121:14:060
970599118,2cyclictest25827-21diskmemload22:25:490
970599118,2cyclictest25827-21diskmemload22:15:040
970599118,2cyclictest0-21swapper/023:40:150
970599118,2cyclictest0-21swapper/023:28:220
970599114,6cyclictest25827-21diskmemload22:50:040
970599112,6cyclictest0-21swapper/021:19:010
970599112,6cyclictest0-21swapper/020:36:020
970599110,2cyclictest0-21swapper/021:41:330
970599110,10cyclictest25827-21diskmemload23:05:080
970599110,10cyclictest0-21swapper/023:35:110
86552110,7sleep025827-21diskmemload22:35:120
315462110,1sleep3381ktimersoftd/322:59:493
284672110,1sleep30-21swapper/319:55:133
970899107,2cyclictest25827-21diskmemload00:31:163
970899107,2cyclictest0-21swapper/320:40:153
970899105,3cyclictest23152-21grep22:50:163
970899102,7cyclictest0-21swapper/320:51:013
970699102,6cyclictest4166-21rsyslogd21:05:561
970699100,8cyclictest22047-21munin-node1
970599107,2cyclictest2110-21ssh00:10:550
970599107,2cyclictest0-21swapper/023:58:050
970599102,7cyclictest0-21swapper/020:25:020
970599102,7cyclictest0-21swapper/020:00:590
970599102,6cyclictest0-21swapper/021:05:240
970599102,6cyclictest0-21swapper/020:50:240
970599102,6cyclictest0-21swapper/020:40:240
970599100,8cyclictest7678-21cron20:25:000
97089994,3cyclictest5129-21runrttasks21:03:543
97089990,8cyclictest0-21swapper/320:15:153
97059996,2cyclictest0-21swapper/021:00:130
97059996,2cyclictest0-21swapper/019:55:220
97059995,2cyclictest17190-21grep20:45:230
97059995,2cyclictest14092-21aten2.4_r3power19:20:120
97059994,3cyclictest21107-21mailstats19:35:240
97059994,3cyclictest10279-21df_abs19:10:140
97059990,8cyclictest0-21swapper/019:40:140
97059990,2cyclictest0-21swapper/019:25:210
97059983,3cyclictest26434-21df_abs19:50:130
97059983,3cyclictest21320-21unixbench_multi20:55:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional