You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 02:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Wed Apr 22, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2827799260,25cyclictest0-21swapper/109:29:291
2828599250,24cyclictest22021-21diskmemload12:38:163
2828599250,24cyclictest22021-21diskmemload10:09:483
2828599250,24cyclictest0-21swapper/312:21:483
28280992520,4cyclictest0-21swapper/211:20:032
2827799250,24cyclictest8940-21sh12:36:101
2827799250,24cyclictest22021-21diskmemload11:25:021
2827799250,24cyclictest0-21swapper/110:59:351
2827599250,1cyclictest15071-21diskmemload11:08:400
28285992422,1cyclictest0-21swapper/310:13:083
28285992421,2cyclictest24967-21sh10:45:503
2828599240,3cyclictest30467-21awk09:50:003
2828599240,23cyclictest22021-21diskmemload09:50:363
2828599240,0cyclictest22021-21diskmemload09:38:423
2828599240,0cyclictest0-21swapper/311:56:593
2828099240,24cyclictest0-21swapper/211:11:532
2828099240,23cyclictest22021-21diskmemload09:19:302
2828099240,23cyclictest0-21swapper/211:45:222
2828099240,23cyclictest0-21swapper/211:35:262
28277992423,0cyclictest22-21ksoftirqd/109:55:301
2827799240,3cyclictest23166-21dpkg12:20:011
2827799240,23cyclictest6341-21ssh12:02:481
2827799240,23cyclictest26579-21ssh10:16:081
2827799240,23cyclictest22021-21diskmemload12:11:391
2827799240,23cyclictest22021-21diskmemload10:46:241
2827799240,23cyclictest22021-21diskmemload09:53:021
2827799240,23cyclictest18989-21ssh10:40:221
2827799240,23cyclictest0-21swapper/109:23:031
2827599242,21cyclictest1255-21sh11:25:400
28275992422,1cyclictest0-21swapper/011:43:100
2827599240,23cyclictest8444-21apt-key10:00:010
2827599240,23cyclictest2625-21sh09:21:200
28285992323,0cyclictest0-21swapper/311:10:393
28285992323,0cyclictest0-21swapper/309:44:023
28285992322,1cyclictest22021-21diskmemload12:06:323
28285992321,1cyclictest9875-21sh10:31:093
28285992321,1cyclictest0-21swapper/312:16:583
28285992321,1cyclictest0-21swapper/311:05:153
28285992321,1cyclictest0-21swapper/310:52:103
28285992320,2cyclictest29586-21sh08:20:003
28285992320,2cyclictest24799-21apt08:10:003
2828599230,23cyclictest22021-21diskmemload09:59:583
2828599230,23cyclictest0-21swapper/310:01:053
2828599230,23cyclictest0-21swapper/309:30:473
2828599230,23cyclictest0-21swapper/309:26:263
2828599230,23cyclictest0-21swapper/309:21:053
2828599230,22cyclictest4581-21ssh10:26:233
2828599230,22cyclictest31259-21cron11:25:003
2828599230,22cyclictest24805-21ssh11:17:503
2828599230,0cyclictest0-21swapper/311:32:383
2828599230,0cyclictest0-21swapper/310:42:183
2828599230,0cyclictest0-21swapper/310:37:453
28280992323,0cyclictest0-21swapper/210:27:282
28280992323,0cyclictest0-21swapper/209:57:502
28280992322,1cyclictest22021-21diskmemload11:06:452
28280992322,1cyclictest0-21swapper/212:15:402
28280992322,1cyclictest0-21swapper/212:10:252
28280992321,1cyclictest18677-21ssh09:37:312
28280992321,1cyclictest0-21swapper/211:59:272
28280992321,1cyclictest0-21swapper/210:02:202
28280992320,2cyclictest27758-21ssh11:51:362
28280992320,2cyclictest25695-21ptp4l10:15:232
28280992319,3cyclictest313-21systemd-journal09:00:002
2828099230,23cyclictest22021-21diskmemload11:02:102
2828099230,23cyclictest0-21swapper/210:35:482
2828099230,23cyclictest0-21swapper/209:25:262
2828099230,22cyclictest30775-21ssh12:25:362
2828099230,22cyclictest22021-21diskmemload10:10:572
2828099230,22cyclictest1791-21ssh11:26:352
2828099230,22cyclictest0-21swapper/210:55:182
2828099230,0cyclictest0-21swapper/211:30:482
2828099230,0cyclictest0-21swapper/210:51:242
2828099230,0cyclictest0-21swapper/209:49:332
28277992323,0cyclictest22021-21diskmemload09:48:471
28277992323,0cyclictest0-21swapper/112:23:391
28277992323,0cyclictest0-21swapper/111:52:321
28277992323,0cyclictest0-21swapper/110:25:331
28277992323,0cyclictest0-21swapper/109:10:181
28277992322,0cyclictest22-21ksoftirqd/111:05:011
28277992322,0cyclictest0-21swapper/109:15:151
28277992321,1cyclictest0-21swapper/110:13:581
28277992320,0cyclictest151rcu_preempt11:40:371
2827799230,22cyclictest8870-21sh10:00:021
2827799230,22cyclictest20585-21fschecks_count11:45:181
2827799230,22cyclictest19448-21sh09:38:481
2827799230,22cyclictest1751-21ssh12:30:151
2827799230,22cyclictest10622-21ssh12:06:321
2827799230,22cyclictest0-21swapper/111:11:471
2827799230,21cyclictest22021-21diskmemload11:22:271
2827799230,0cyclictest151rcu_preempt11:34:201
2827799230,0cyclictest151rcu_preempt10:06:261
2827799230,0cyclictest0-21swapper/110:50:331
28275992323,0cyclictest9602-21apt-get08:45:020
28275992323,0cyclictest0-21swapper/012:34:120
28275992323,0cyclictest0-21swapper/012:26:410
28275992323,0cyclictest0-21swapper/010:38:180
28275992323,0cyclictest0-21swapper/009:34:550
28275992322,1cyclictest0-21swapper/011:18:230
28275992321,1cyclictest17203-21sh10:07:260
28275992321,1cyclictest0-21swapper/010:13:130
28275992321,1cyclictest0-21swapper/009:37:430
2827599231,21cyclictest62550irq/127-eno112:15:020
2827599230,23cyclictest0-21swapper/010:03:010
2827599230,23cyclictest0-21swapper/009:28:280
2827599230,23cyclictest0-21swapper/009:17:210
2827599230,22cyclictest62550irq/127-eno112:02:120
2827599230,22cyclictest24490-21cat12:20:190
2827599230,22cyclictest0-21swapper/009:12:080
2827599230,21cyclictest0-21swapper/009:50:260
2827599230,0cyclictest0-21swapper/012:35:460
2827599230,0cyclictest0-21swapper/012:06:020
2827599230,0cyclictest0-21swapper/010:30:200
2827599230,0cyclictest0-21swapper/009:46:010
2827599230,0cyclictest0-21swapper/009:43:540
28285992222,0cyclictest0-21swapper/311:38:293
28285992222,0cyclictest0-21swapper/308:30:153
28285992221,1cyclictest0-21swapper/312:30:033
28285992220,1cyclictest31721-21ssh12:27:013
28285992220,1cyclictest22380-21idleruntime-cro08:05:003
28285992220,1cyclictest1849-21cut10:55:223
2828599220,22cyclictest28902-21ssh11:53:243
2828599220,21cyclictest22021-21diskmemload10:20:593
2828599220,21cyclictest22021-21diskmemload09:10:283
2828599220,21cyclictest0-21swapper/312:00:313
2828599220,1cyclictest22048-21perf09:10:003
2828599220,1cyclictest22021-21diskmemload11:02:593
2828599220,1cyclictest0-21swapper/312:10:223
2828599220,1cyclictest0-21swapper/311:45:253
2828599220,0cyclictest22021-21diskmemload09:15:363
28280992222,0cyclictest0-21swapper/212:37:562
28280992221,1cyclictest32701-21apt-get09:20:162
28280992221,1cyclictest0-21swapper/210:21:132
28280992220,1cyclictest897-21apt-get07:20:162
28280992220,1cyclictest0-21swapper/209:40:282
2828099220,21cyclictest22478-21apt-get09:10:162
2828099220,21cyclictest12825-21ssh09:31:192
2828099220,21cyclictest0-21swapper/212:20:522
2828099220,21cyclictest0-21swapper/211:15:042
2828099220,21cyclictest0-21swapper/208:10:152
2828099220,1cyclictest0-21swapper/212:05:202
2828099220,1cyclictest0-21swapper/210:45:412
2828099220,0cyclictest0-21swapper/211:42:402
28277992222,0cyclictest30651-1kworker/u9:010:30:071
28277992222,0cyclictest22021-21diskmemload10:23:501
28277992221,1cyclictest9163-21sh11:02:131
28277992221,1cyclictest22-21ksoftirqd/108:45:011
28277992221,1cyclictest0-21swapper/110:35:331
28277992220,1cyclictest20660-21grep09:40:141
2827799220,21cyclictest0-21swapper/109:30:431
2827799220,1cyclictest24769-21cron08:10:001
2827799220,0cyclictest0-21swapper/111:55:091
2827799220,0cyclictest0-21swapper/111:35:391
28275992222,0cyclictest0-21swapper/011:30:040
28275992222,0cyclictest0-21swapper/010:55:180
28275992222,0cyclictest0-21swapper/010:25:450
28275992221,1cyclictest29291-21ssh11:21:480
28275992220,1cyclictest595-21munin-plugin-st07:20:000
28275992220,1cyclictest22670-21apt-get08:05:140
2827599220,2cyclictest15661-21ssh12:11:290
2827599220,22cyclictest0-21swapper/011:58:570
2827599220,21cyclictest25635-21ssh10:46:510
2827599220,21cyclictest17807-21apt-get07:55:150
2827599220,21cyclictest0-21swapper/011:50:010
2827599220,21cyclictest0-21swapper/011:45:010
2827599220,21cyclictest0-21swapper/011:36:260
2827599220,21cyclictest0-21swapper/011:12:180
2827599220,21cyclictest0-21swapper/011:00:020
2827599220,21cyclictest0-21swapper/010:20:570
2827599220,21cyclictest0-21swapper/008:25:020
2827599220,1cyclictest26647-21ssh10:16:130
2827599220,1cyclictest17191-21munin-run09:00:000
2827599220,1cyclictest14791-21perf08:55:000
28285992120,0cyclictest0-21swapper/311:42:103
28285992119,1cyclictest1462-21diskmemload11:25:583
28285992119,1cyclictest0-21swapper/307:25:153
2828599210,20cyclictest0-21swapper/310:15:153
2828599210,1cyclictest17472-21apt-get09:00:153
28280992121,0cyclictest22021-21diskmemload10:41:262
2828099210,21cyclictest12741-21perf07:45:012
2828099210,21cyclictest0-21swapper/210:30:152
2828099210,21cyclictest0-21swapper/210:05:042
2828099210,0cyclictest9602-21apt-get08:45:022
28277992120,0cyclictest22-21ksoftirqd/108:50:171
28277992119,1cyclictest22-21ksoftirqd/107:40:011
2827799210,1cyclictest0-21swapper/109:00:151
28285992020,0cyclictest28504-21apt-get07:10:143
28285992020,0cyclictest0-21swapper/307:45:143
28285992020,0cyclictest0-21swapper/307:30:143
28285992018,1cyclictest30900-21apt-get07:15:163
2828599200,20cyclictest0-21swapper/308:40:143
2828599200,0cyclictest0-21swapper/308:45:153
28280992020,0cyclictest0-21swapper/208:35:162
28280992019,1cyclictest5703-21apt-get07:30:142
28280992018,1cyclictest0-21swapper/208:20:002
2828099200,20cyclictest0-21swapper/208:00:152
28277992020,0cyclictest0-21swapper/108:35:161
28277992020,0cyclictest0-21swapper/107:50:151
2827799200,20cyclictest0-21swapper/108:15:161
2827599200,20cyclictest0-21swapper/008:20:160
2827599200,0cyclictest19866-21apt-get09:05:150
2827599200,0cyclictest0-21swapper/007:25:150
28285991919,0cyclictest0-21swapper/308:25:173
28280991919,0cyclictest0-21swapper/208:50:172
28280991919,0cyclictest0-21swapper/207:15:162
28280991917,1cyclictest2362-21cron08:30:012
28277991918,0cyclictest0-21swapper/107:40:161
2827599192,16cyclictest622-21gdbus07:50:010
28275991919,0cyclictest0-21swapper/008:10:150
28275991918,1cyclictest15410-21apt-get07:50:150
28285991818,0cyclictest0-21swapper/307:55:153
28285991818,0cyclictest0-21swapper/307:35:143
28280991818,0cyclictest22670-21apt-get08:05:152
28280991818,0cyclictest0-21swapper/208:30:162
28277991818,0cyclictest0-21swapper/109:05:151
28277991818,0cyclictest0-21swapper/108:55:151
28277991815,2cyclictest2394-21turbostat08:30:011
2827599180,17cyclictest0-21swapper/008:00:150
28285991717,0cyclictest0-21swapper/308:20:163
28285991715,1cyclictest3040-21grep07:25:003
2828599170,16cyclictest4178-21munin-node07:53:443
28280991717,0cyclictest0-21swapper/209:00:152
28280991714,2cyclictest609-21rs:main2
28277991717,0cyclictest0-21swapper/108:10:151
28277991717,0cyclictest0-21swapper/107:45:141
28277991714,2cyclictest22-21ksoftirqd/108:00:011
28275991717,0cyclictest0-21swapper/008:40:150
2828599160,14cyclictest0-21swapper/307:40:453
28280991616,0cyclictest0-21swapper/208:45:012
28280991616,0cyclictest0-21swapper/207:10:142
2827599161,9cyclictest62550irq/127-eno108:30:180
28275991615,1cyclictest8098-21apt-get07:35:140
28285991513,1cyclictest0-21swapper/308:10:223
2828599150,1cyclictest0-21swapper/308:55:223
2828599150,14cyclictest0-21swapper/308:52:373
28280991515,0cyclictest0-21swapper/207:45:142
28280991513,1cyclictest606-21dbus-daemon08:25:002
28280991513,1cyclictest15410-21apt-get07:50:152
28277991515,0cyclictest0-21swapper/108:20:161
28277991515,0cyclictest0-21swapper/107:30:141
28277991513,2cyclictest22-21ksoftirqd/108:35:011
2827799150,14cyclictest0-21swapper/107:10:151
2827599155,9cyclictest19193-21users09:00:250
28275991514,1cyclictest27462-21apt-get08:15:160
2827599150,1cyclictest0-21swapper/007:10:150
2827599150,0cyclictest0-21swapper/007:34:350
2828599140,14cyclictest0-21swapper/308:36:183
28280991414,0cyclictest0-21swapper/207:26:432
2828099140,14cyclictest0-21swapper/209:05:482
2828099140,0cyclictest0-21swapper/207:35:022
28277991414,0cyclictest0-21swapper/108:46:431
2827799140,14cyclictest0-21swapper/107:20:041
2827799140,0cyclictest0-21swapper/108:00:071
2827799140,0cyclictest0-21swapper/107:15:091
28275991414,0cyclictest10619-21apt-get07:40:160
28275991414,0cyclictest0-21swapper/008:35:110
2827599140,0cyclictest0-21swapper/007:20:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional