You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 17:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Wed Aug 19, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25355992822,5cyclictest6711-21munin-run08:45:010
2535599280,24cyclictest0-21swapper/010:24:220
2535599270,26cyclictest0-21swapper/012:25:590
25355992620,5cyclictest24424-21ssh12:04:470
2535599260,25cyclictest0-21swapper/009:52:010
2535599260,1cyclictest0-21swapper/010:56:540
2536599250,24cyclictest0-21swapper/311:43:233
2536099250,24cyclictest18725-21diskmemload10:46:352
2536099250,24cyclictest13307-21munin-run11:55:012
25357992525,0cyclictest0-21swapper/111:11:321
25357992523,1cyclictest19168-21ssh09:37:251
25357992523,1cyclictest0-21swapper/111:35:201
25357992523,1cyclictest0-21swapper/109:44:451
25357992523,1cyclictest0-21swapper/109:11:571
2535799250,24cyclictest18725-21diskmemload10:40:481
25355992523,2cyclictest0-21swapper/009:15:150
25355992523,2cyclictest0-21swapper/009:15:150
25355992522,3cyclictest18725-21diskmemload10:25:560
25355992522,3cyclictest0-21swapper/012:13:390
25355992521,4cyclictest18725-21diskmemload09:36:520
25355992520,4cyclictest19494-21rm11:30:400
2535599250,24cyclictest30325-21ssh09:47:080
2535599250,21cyclictest30351-21ssh12:37:090
2535599250,1cyclictest0-21swapper/011:47:410
2535599250,0cyclictest0-21swapper/009:55:170
25365992423,1cyclictest21099-21ssh12:29:573
2536599240,24cyclictest0-21swapper/311:08:003
2536599240,23cyclictest18725-21diskmemload11:35:083
2536599240,23cyclictest0-21swapper/310:27:023
2536599240,1cyclictest0-21swapper/312:24:513
2536099240,23cyclictest0-21swapper/211:11:342
2536099240,22cyclictest313-21systemd-journal12:35:012
2536099240,0cyclictest0-21swapper/209:53:062
25357992423,1cyclictest27931-21ssh09:16:371
25357992423,1cyclictest27931-21ssh09:16:371
25357992423,1cyclictest0-21swapper/109:34:171
25357992422,1cyclictest12639-21latency_hist07:50:011
25357992422,1cyclictest0-21swapper/111:43:361
25357992421,2cyclictest7853-21awk07:40:001
2535799240,2cyclictest14404-21ssh10:01:201
2535799240,23cyclictest2274-21idleruntime-cro10:20:011
2535799240,23cyclictest18725-21diskmemload12:31:351
2535799240,23cyclictest12865-21ssh10:57:101
2535799240,23cyclictest0-21swapper/109:23:411
2535799240,1cyclictest0-21swapper/111:47:281
25355992424,0cyclictest0-21swapper/009:14:470
25355992423,1cyclictest0-21swapper/011:18:460
25355992422,2cyclictest0-21swapper/012:16:460
2535599242,1cyclictest21408-21sh09:40:040
25355992421,2cyclictest24668-21cron08:15:000
25355992421,2cyclictest18725-21diskmemload12:21:570
25355992420,3cyclictest0-21swapper/012:07:260
2535599240,23cyclictest4315-21awk08:40:010
2535599240,23cyclictest0-21swapper/011:41:320
2535599240,23cyclictest0-21swapper/009:26:170
2535599240,0cyclictest2214-21ssh10:19:580
2535599240,0cyclictest0-21swapper/011:10:440
25365992323,0cyclictest18725-21diskmemload09:20:373
25365992323,0cyclictest0-21swapper/310:30:523
25365992323,0cyclictest0-21swapper/309:48:393
25365992322,1cyclictest0-21swapper/309:15:063
25365992322,1cyclictest0-21swapper/309:15:063
25365992321,1cyclictest5326-21rm09:54:363
25365992321,1cyclictest18725-21diskmemload09:11:173
25365992320,2cyclictest13603-21sh10:00:193
2536599230,2cyclictest636-21ssh10:45:583
2536599230,23cyclictest0-21swapper/311:50:383
2536599230,23cyclictest0-21swapper/310:21:033
2536599230,22cyclictest7374-21rm10:52:203
2536599230,22cyclictest3144-21ssh12:13:493
2536599230,22cyclictest2301-21munin-run10:20:013
2536599230,22cyclictest21868-21ssh12:01:203
2536599230,22cyclictest18725-21diskmemload12:32:073
2536599230,22cyclictest1710-21apache209:45:003
2536599230,22cyclictest11186-21ssh09:30:143
2536599230,22cyclictest0-21swapper/310:55:113
2536599230,1cyclictest27612-21awk11:10:103
2536599230,1cyclictest27125-21awk08:20:003
2536599230,0cyclictest0-21swapper/309:59:433
25360992323,0cyclictest18725-21diskmemload12:04:512
25360992323,0cyclictest0-21swapper/210:53:502
25360992323,0cyclictest0-21swapper/209:59:122
25360992322,1cyclictest28387-21apt-get07:15:062
25360992322,1cyclictest18725-21diskmemload11:00:412
25360992322,1cyclictest18725-21diskmemload10:21:082
25360992321,1cyclictest0-21swapper/211:26:132
25360992319,4cyclictest0-21swapper/211:17:372
2536099230,23cyclictest0-21swapper/212:17:282
2536099230,23cyclictest0-21swapper/211:07:022
2536099230,23cyclictest0-21swapper/210:55:592
2536099230,23cyclictest0-21swapper/209:21:072
2536099230,22cyclictest18725-21diskmemload10:42:352
2536099230,22cyclictest11032-21ssh09:30:132
2536099230,0cyclictest0-21swapper/211:46:122
2536099230,0cyclictest0-21swapper/209:38:112
2536099230,0cyclictest0-21swapper/209:16:052
2536099230,0cyclictest0-21swapper/209:16:052
25357992323,0cyclictest18725-21diskmemload11:09:411
25357992323,0cyclictest0-21swapper/111:52:441
25357992323,0cyclictest0-21swapper/111:00:481
25357992323,0cyclictest0-21swapper/110:21:561
25357992321,1cyclictest0-21swapper/110:48:071
25357992320,2cyclictest9728-21munin-plugin-st09:30:011
25357992320,2cyclictest313-21systemd-journal07:55:011
2535799230,23cyclictest0-21swapper/112:07:141
2535799230,23cyclictest0-21swapper/109:58:491
2535799230,22cyclictest21528-21sh12:00:551
2535799230,22cyclictest2091-21sed09:50:181
2535799230,22cyclictest14023-21sh12:23:121
2535799230,22cyclictest0-21swapper/110:31:221
2535799230,22cyclictest0-21swapper/110:25:291
2535799230,22cyclictest0-21swapper/109:48:141
2535799230,22cyclictest0-21swapper/107:20:001
2535799230,0cyclictest0-21swapper/112:11:021
2535799230,0cyclictest0-21swapper/111:23:131
2535799230,0cyclictest0-21swapper/110:36:201
2535799230,0cyclictest0-21swapper/110:06:131
25355992321,1cyclictest0-21swapper/010:40:550
25355992320,3cyclictest0-21swapper/009:20:090
25355992320,2cyclictest0-21swapper/011:51:140
2535599230,2cyclictest606-21dbus-daemon08:00:010
2535599230,23cyclictest0-21swapper/011:37:200
2535599230,23cyclictest0-21swapper/011:20:130
2535599230,23cyclictest0-21swapper/011:05:130
2535599230,23cyclictest0-21swapper/011:00:020
2535599230,23cyclictest0-21swapper/010:45:020
2535599230,23cyclictest0-21swapper/010:10:530
2535599230,23cyclictest0-21swapper/010:05:060
2535599230,22cyclictest5791-21grep10:50:190
2535599230,22cyclictest18725-21diskmemload10:31:190
2535599230,0cyclictest18725-21diskmemload12:33:450
2535599230,0cyclictest0-21swapper/010:00:190
2535599230,0cyclictest0-21swapper/009:32:170
25365992222,0cyclictest18725-21diskmemload11:30:283
25365992222,0cyclictest0-21swapper/311:46:453
25365992222,0cyclictest0-21swapper/311:03:103
25365992222,0cyclictest0-21swapper/310:11:063
25365992220,1cyclictest7015-21sh11:20:153
25365992220,1cyclictest34-21ksoftirqd/308:10:003
25365992220,1cyclictest34-21ksoftirqd/307:15:013
25365992220,1cyclictest12547-21cat11:25:113
25365992219,2cyclictest16306-21grep09:05:003
2536599220,21cyclictest2928-21munin-run07:30:003
2536599220,21cyclictest27022-21ssh12:05:303
2536599220,21cyclictest20537-21ssh10:35:113
2536599220,21cyclictest10242-21ls07:45:013
2536599220,21cyclictest0-21swapper/312:35:063
2536599220,21cyclictest0-21swapper/311:56:193
2536599220,21cyclictest0-21swapper/309:35:083
2536599220,1cyclictest28886-21rm10:43:073
2536599220,1cyclictest2234-21rm11:15:393
2536599220,1cyclictest20006-21sh10:05:373
2536599220,0cyclictest18725-21diskmemload09:26:203
25360992222,0cyclictest0-21swapper/212:20:492
25360992222,0cyclictest0-21swapper/211:22:452
25360992222,0cyclictest0-21swapper/210:00:282
25360992221,1cyclictest1856-21ssh12:12:032
25360992220,1cyclictest27514-21df09:45:092
25360992220,1cyclictest17744-21diskstats11:30:102
25360992220,1cyclictest0-21swapper/210:10:162
25360992219,2cyclictest30904-21sh11:40:462
25360992219,2cyclictest18725-21diskmemload11:35:072
2536099220,22cyclictest0-21swapper/212:28:162
2536099220,21cyclictest28151-21missed_timers12:35:132
2536099220,21cyclictest0-21swapper/210:35:122
2536099220,21cyclictest0-21swapper/210:30:432
2536099220,21cyclictest0-21swapper/210:15:502
2536099220,21cyclictest0-21swapper/210:08:332
2536099220,1cyclictest29736-21ssh12:09:142
2536099220,1cyclictest26440-21ssh09:44:402
2536099220,1cyclictest0-21swapper/211:55:222
2536099220,1cyclictest0-21swapper/209:25:132
25357992222,0cyclictest0-21swapper/112:25:481
25357992222,0cyclictest0-21swapper/111:30:121
25357992222,0cyclictest0-21swapper/111:26:351
25357992220,1cyclictest6960-21apt-get08:45:071
25357992220,1cyclictest0-21swapper/111:15:121
2535799220,21cyclictest8104-21apt-get07:40:081
2535799220,21cyclictest13443-21apt-get11:55:061
2535799220,21cyclictest0-21swapper/107:25:001
2535799220,1cyclictest6208-21sh10:50:441
25355992220,1cyclictest0-21swapper/011:25:080
2535599220,22cyclictest0-21swapper/011:57:040
2535599220,21cyclictest22266-21cron08:10:000
2535599220,1cyclictest0-21swapper/008:30:000
2535599220,0cyclictest0-21swapper/008:00:070
25365992121,0cyclictest0-21swapper/309:05:063
25365992121,0cyclictest0-21swapper/308:50:073
25365992120,1cyclictest0-21swapper/308:40:073
2536599210,0cyclictest0-21swapper/312:15:333
25360992121,0cyclictest0-21swapper/208:50:072
25360992120,1cyclictest17710-21apt-get08:00:062
25360992120,0cyclictest3183-21apt-get07:30:062
2536099210,21cyclictest0-21swapper/210:25:172
2536099210,21cyclictest0-21swapper/209:10:192
2536099210,20cyclictest10505-21apt-get07:45:072
2536099210,20cyclictest0-21swapper/209:00:082
2536099210,0cyclictest0-21swapper/207:40:082
25357992121,0cyclictest9355-21apt-get08:50:071
25357992119,1cyclictest4564-21apt-get08:40:071
2535799210,21cyclictest0-21swapper/112:15:581
2535799210,21cyclictest0-21swapper/110:11:531
2535799210,20cyclictest0-21swapper/109:00:071
2535799210,20cyclictest0-21swapper/108:25:071
2535799210,0cyclictest0-21swapper/107:25:071
2535599210,20cyclictest0-21swapper/007:45:070
2535599210,0cyclictest5582-21apt-get07:35:060
25365992020,0cyclictest0-21swapper/307:15:063
2536599200,0cyclictest0-21swapper/308:20:073
25355992020,0cyclictest0-21swapper/008:45:070
25355992020,0cyclictest0-21swapper/008:30:080
25355992020,0cyclictest0-21swapper/008:30:080
25355992017,2cyclictest12903-21taskset07:50:070
2535599200,2cyclictest3151-21/usr/sbin/munin07:30:090
2535599200,0cyclictest0-21swapper/009:00:070
25365991917,1cyclictest34-21ksoftirqd/307:55:013
25365991917,1cyclictest1884-21idleruntime-cro08:35:013
25365991917,1cyclictest1884-21idleruntime-cro08:35:013
2536599190,18cyclictest0-21swapper/308:45:073
25360991918,1cyclictest0-21swapper/208:30:002
25357991919,0cyclictest0-21swapper/109:05:061
25357991919,0cyclictest0-21swapper/108:15:061
25357991918,1cyclictest0-21swapper/108:40:011
25357991917,1cyclictest27746-21munin-run07:15:011
2535799190,0cyclictest0-21swapper/107:30:061
25355991919,0cyclictest0-21swapper/007:10:070
25355991914,0cyclictest0-21swapper/008:55:070
25365991818,0cyclictest0-21swapper/307:20:063
25360991818,0cyclictest0-21swapper/207:20:062
25360991816,1cyclictest27374-21apt-get08:20:072
25360991816,1cyclictest1875-21cron08:35:012
25360991816,1cyclictest1875-21cron08:35:012
25357991818,0cyclictest0-21swapper/108:20:071
25357991816,1cyclictest24681-21sh08:15:001
25355991818,0cyclictest0-21swapper/007:40:080
25355991818,0cyclictest0-21swapper/007:15:020
25365991717,0cyclictest0-21swapper/308:35:063
25365991717,0cyclictest0-21swapper/307:35:063
2536599170,1cyclictest29768-21apt-get08:25:073
2536099176,9cyclictest611-21irqbalance07:35:102
25360991717,0cyclictest0-21swapper/208:50:012
25360991715,1cyclictest13905-21idleruntime-cro09:00:002
2536099170,16cyclictest0-21swapper/207:25:072
25357991717,0cyclictest0-21swapper/108:00:071
25360991616,0cyclictest0-21swapper/208:10:072
2536099160,2cyclictest26673-21users08:15:162
25357991614,1cyclictest15294-21apt-get07:55:061
25355991616,0cyclictest0-21swapper/008:20:070
25355991614,1cyclictest0-21swapper/007:20:160
25365991515,0cyclictest11752-21apt-get08:55:073
25360991515,0cyclictest16561-21apt-get09:05:062
2536099150,14cyclictest0-21swapper/207:10:152
25357991515,0cyclictest0-21swapper/108:05:081
2535599150,2cyclictest0-21swapper/007:25:070
25365991414,0cyclictest0-21swapper/308:00:323
25365991414,0cyclictest0-21swapper/307:45:073
25365991414,0cyclictest0-21swapper/307:30:033
2536599140,14cyclictest0-21swapper/307:55:213
2536599140,0cyclictest0-21swapper/308:10:043
25360991414,0cyclictest20159-21apt-get08:05:082
2536099140,14cyclictest0-21swapper/208:41:232
2536099140,14cyclictest0-21swapper/208:36:142
2536099140,14cyclictest0-21swapper/207:52:272
2536099140,0cyclictest0-21swapper/207:55:532
2535799140,0cyclictest0-21swapper/108:30:191
2535799140,0cyclictest0-21swapper/108:30:191
25355991414,0cyclictest0-21swapper/009:05:060
2535599140,14cyclictest0-21swapper/008:52:080
2535599140,14cyclictest0-21swapper/008:15:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional