You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 16:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 31, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1461099280,27cyclictest0-21swapper/311:57:243
1461099280,1cyclictest14362-21sh09:15:383
14610992722,5cyclictest7980-21diskmemload09:43:063
1461099270,26cyclictest0-21swapper/311:02:363
14610992621,5cyclictest0-21swapper/308:38:343
1461099260,25cyclictest0-21swapper/312:12:523
1461099260,25cyclictest0-21swapper/311:18:483
1461099260,21cyclictest8946-21diskmemload09:10:543
1461099260,0cyclictest0-21swapper/309:33:363
14607992624,1cyclictest23656-21apt-get09:53:340
14610992520,4cyclictest22575-21ssh11:48:233
14610992520,4cyclictest0-21swapper/312:37:183
1461099250,25cyclictest0-21swapper/311:05:263
1461099250,24cyclictest3854-21ssh11:30:363
1461099250,24cyclictest0-21swapper/312:06:193
1461099250,24cyclictest0-21swapper/310:48:123
1461099250,24cyclictest0-21swapper/309:56:573
1461099250,24cyclictest0-21swapper/309:50:553
1461099250,0cyclictest7980-21diskmemload09:46:343
14609992523,1cyclictest186402chrt10:18:102
1460999250,24cyclictest0-21swapper/210:48:412
1460999250,1cyclictest10187-21ssh10:09:332
1460899250,1cyclictest3671-21cron09:35:001
14607992523,1cyclictest3996-21sh09:35:060
1460799250,24cyclictest24561-21ssh09:24:290
1460799250,1cyclictest0-21swapper/012:04:490
14610992423,1cyclictest7980-21diskmemload10:44:033
14610992421,3cyclictest0-21swapper/311:26:103
14610992421,3cyclictest0-21swapper/311:26:103
14610992421,3cyclictest0-21swapper/310:14:143
14610992421,2cyclictest19055-21sh11:43:483
14610992420,4cyclictest0-21swapper/311:53:053
14610992417,6cyclictest0-21swapper/310:18:343
1461099240,24cyclictest0-21swapper/312:03:153
1461099240,23cyclictest7980-21diskmemload11:23:233
1461099240,23cyclictest22119-21runrttasks09:23:343
1461099240,23cyclictest0-21swapper/312:34:133
1461099240,23cyclictest0-21swapper/310:55:473
1461099240,23cyclictest0-21swapper/310:28:503
1461099240,0cyclictest0-21swapper/312:22:143
1461099240,0cyclictest0-21swapper/310:35:523
1461099240,0cyclictest0-21swapper/310:05:153
1461099240,0cyclictest0-21swapper/309:37:093
14609992423,0cyclictest22074-21/usr/sbin/munin09:23:352
1460999240,24cyclictest0-21swapper/212:38:292
1460999240,24cyclictest0-21swapper/210:02:402
1460999240,23cyclictest0-21swapper/209:36:402
1460999240,1cyclictest7980-21diskmemload11:24:362
1460999240,1cyclictest7980-21diskmemload09:40:162
14608992424,0cyclictest0-21swapper/110:35:271
14608992422,1cyclictest14578-21sh11:11:591
1460899240,23cyclictest7980-21diskmemload12:09:351
1460899240,23cyclictest7980-21diskmemload12:04:381
1460899240,23cyclictest7980-21diskmemload11:09:521
1460899240,23cyclictest15625-21ssh10:14:161
1460899240,23cyclictest0-21swapper/109:24:251
1460899240,1cyclictest0-21swapper/109:18:201
1460899240,0cyclictest0-21swapper/112:20:081
1460899240,0cyclictest0-21swapper/110:53:341
14607992424,0cyclictest0-21swapper/011:52:440
14607992423,1cyclictest7980-21diskmemload10:16:020
14607992422,1cyclictest27716-21sh09:28:300
1460799240,24cyclictest0-21swapper/011:37:150
1460799240,24cyclictest0-21swapper/010:37:300
1460799240,23cyclictest7980-21diskmemload11:26:180
1460799240,23cyclictest7980-21diskmemload11:26:180
14610992323,0cyclictest0-21swapper/310:22:333
14610992320,3cyclictest0-21swapper/311:35:253
14610992320,2cyclictest18420-21awk08:25:013
1461099230,23cyclictest0-21swapper/311:10:083
1461099230,23cyclictest0-21swapper/310:03:383
1461099230,22cyclictest0-21swapper/310:51:133
1461099230,22cyclictest0-21swapper/309:25:093
1461099230,0cyclictest24781-21apt-get07:33:343
14609992323,0cyclictest0-21swapper/212:20:582
14609992323,0cyclictest0-21swapper/210:55:512
14609992323,0cyclictest0-21swapper/210:54:482
1460999230,23cyclictest0-21swapper/210:30:072
1460999230,23cyclictest0-21swapper/209:47:052
1460999230,23cyclictest0-21swapper/209:30:382
1460999230,23cyclictest0-21swapper/209:16:152
1460999230,22cyclictest27896-21ssh10:25:252
1460999230,22cyclictest23667-21sh09:53:342
1460999230,22cyclictest10258-21latency_hist12:05:002
1460999230,0cyclictest7980-21diskmemload12:05:232
1460999230,0cyclictest7980-21diskmemload11:57:312
1460999230,0cyclictest7980-21diskmemload10:20:172
1460999230,0cyclictest0-21swapper/211:41:552
1460999230,0cyclictest0-21swapper/211:18:502
1460999230,0cyclictest0-21swapper/211:11:272
14608992323,0cyclictest7980-21diskmemload10:31:291
14608992323,0cyclictest0-21swapper/112:37:041
14608992323,0cyclictest0-21swapper/111:56:321
14608992323,0cyclictest0-21swapper/111:48:241
14608992323,0cyclictest0-21swapper/111:15:211
14608992323,0cyclictest0-21swapper/110:49:291
14608992323,0cyclictest0-21swapper/110:19:051
14608992323,0cyclictest0-21swapper/109:40:031
14608992323,0cyclictest0-21swapper/109:36:331
14608992321,1cyclictest3596-21ssh11:02:161
1460899231,21cyclictest211rcuc/110:55:271
1460899231,21cyclictest211rcuc/110:01:351
1460899231,1cyclictest31554-21ssh11:26:381
1460899231,1cyclictest31554-21ssh11:26:381
1460899230,23cyclictest0-21swapper/111:43:301
1460899230,23cyclictest0-21swapper/110:24:261
1460899230,22cyclictest8713-21ssh11:34:531
1460899230,22cyclictest27051-21sh09:55:311
1460899230,22cyclictest25239-21rm09:25:081
1460899230,22cyclictest21319-21sh09:50:201
1460899230,22cyclictest10668-21sh11:37:251
1460899230,0cyclictest0-21swapper/112:33:321
1460899230,0cyclictest0-21swapper/112:13:341
1460899230,0cyclictest0-21swapper/111:20:441
14607992323,0cyclictest7980-21diskmemload11:17:580
14607992323,0cyclictest7980-21diskmemload10:56:400
14607992323,0cyclictest7980-21diskmemload10:07:480
14607992323,0cyclictest0-21swapper/011:32:480
14607992323,0cyclictest0-21swapper/010:21:380
14607992323,0cyclictest0-21swapper/010:04:390
14607992321,1cyclictest31486-21sh10:28:410
1460799230,23cyclictest17649-21diskstats11:43:400
1460799230,23cyclictest0-21swapper/012:13:450
1460799230,23cyclictest0-21swapper/010:41:180
1460799230,22cyclictest22460-21sh11:48:140
1460799230,21cyclictest0-21swapper/012:26:120
1460799230,1cyclictest30798-21idleruntime-cro08:50:000
1460799230,0cyclictest0-21swapper/011:21:060
1460799230,0cyclictest0-21swapper/009:59:120
14610992220,1cyclictest3190-21turbostat.cron09:00:003
14610992220,1cyclictest19445-21sendmail-msp07:20:003
1461099220,1cyclictest19990-21apt-get07:23:333
1461099220,1cyclictest11154-21latency_hist08:10:003
1461099220,1cyclictest0-21swapper/312:15:573
14609992222,0cyclictest0-21swapper/211:08:412
14609992222,0cyclictest0-21swapper/211:00:592
14609992220,2cyclictest20296-21ssh11:45:092
14609992220,1cyclictest3826-21ssh11:30:342
14609992220,1cyclictest30403-21ssh11:25:022
14609992220,1cyclictest30403-21ssh11:25:022
14609992220,1cyclictest28410-21awk08:45:002
14609992220,1cyclictest0-21swapper/210:11:142
14609992220,1cyclictest0-21swapper/209:10:112
1460999220,22cyclictest0-21swapper/211:52:232
1460999220,22cyclictest0-21swapper/210:35:242
1460999220,21cyclictest7980-21diskmemload09:25:352
1460999220,21cyclictest405-21ssh12:25:202
1460999220,21cyclictest27279-21apt-get07:38:342
1460999220,21cyclictest21211-21grep08:30:012
1460999220,21cyclictest17048-21awk07:15:002
1460999220,21cyclictest10249-21ssh11:36:412
1460999220,21cyclictest0-21swapper/212:30:342
1460999220,21cyclictest0-21swapper/212:15:212
1460999220,1cyclictest27287-21ssh09:55:532
1460999220,1cyclictest0-21swapper/210:44:122
14608992222,0cyclictest0-21swapper/112:15:231
14608992222,0cyclictest0-21swapper/111:50:511
14608992222,0cyclictest0-21swapper/110:26:291
14608992222,0cyclictest0-21swapper/110:07:031
14608992221,1cyclictest8585-21sh09:10:281
1460899222,0cyclictest3739-21apt-get09:03:341
14608992220,1cyclictest8766-21perf08:05:001
14608992220,1cyclictest16031-21sendmail-msp08:20:011
1460899220,21cyclictest15877-21ssh09:45:341
1460899220,21cyclictest0-21swapper/108:23:341
1460899220,21cyclictest0-21swapper/108:08:351
1460899220,1cyclictest1369-21ssh12:26:411
1460899220,1cyclictest12111-21ssh10:40:131
14607992222,0cyclictest0-21swapper/010:50:420
14607992221,1cyclictest62550irq/127-eno110:11:260
14607992221,1cyclictest11449-21ssh12:35:080
14607992220,1cyclictest0-21swapper/010:46:490
1460799221,5cyclictest0-21swapper/008:55:000
1460799220,22cyclictest3422-21ssh10:33:330
1460799220,22cyclictest0-21swapper/009:10:520
1460799220,21cyclictest21679-21rm12:15:150
1460799220,21cyclictest0-21swapper/011:55:110
1460799220,21cyclictest0-21swapper/011:05:220
1460799220,21cyclictest0-21swapper/009:46:000
1460799220,21cyclictest0-21swapper/008:25:020
1460799220,1cyclictest15704-21sh09:17:280
1460799220,1cyclictest0-21swapper/012:32:510
1460799220,1cyclictest0-21swapper/012:23:020
1460799220,1cyclictest0-21swapper/012:08:350
1460799220,1cyclictest0-21swapper/011:10:590
1460799220,1cyclictest0-21swapper/011:03:480
1460799220,1cyclictest0-21swapper/009:42:480
1460799220,1cyclictest0-21swapper/009:10:010
14610992120,1cyclictest8000-21perf09:10:013
1461099210,20cyclictest0-21swapper/307:58:343
1461099210,1cyclictest19036-21apt-get08:25:023
14609992120,1cyclictest21741-21apt-get08:33:342
14609992120,1cyclictest16059-21ssh12:10:032
14609992119,1cyclictest0-21swapper/208:05:002
1460999210,20cyclictest0-21swapper/208:08:352
1460999210,0cyclictest0-21swapper/208:13:342
14608992121,0cyclictest0-21swapper/108:25:021
1460899210,20cyclictest0-21swapper/108:38:341
1460899210,1cyclictest11680-21apt-get08:13:341
14607992121,0cyclictest0-21swapper/007:20:000
1461099200,6cyclictest30511-21timerwakeupswit08:48:443
1461099200,0cyclictest0-21swapper/308:53:343
1461099200,0cyclictest0-21swapper/307:43:263
14609992020,0cyclictest4469-21apt-get07:58:332
14609992020,0cyclictest0-21swapper/207:50:012
1460999200,0cyclictest0-21swapper/209:03:342
1460999200,0cyclictest0-21swapper/207:28:332
14608992020,0cyclictest2076-21apt-get07:53:351
14608992020,0cyclictest0-21swapper/107:33:341
14607992020,0cyclictest0-21swapper/007:33:340
14607992020,0cyclictest0-21swapper/007:23:330
1460799200,0cyclictest0-21swapper/008:23:340
14610991919,0cyclictest22382-21apt-get07:28:333
14610991919,0cyclictest0-21swapper/307:53:353
14610991919,0cyclictest0-21swapper/307:38:343
14609991919,0cyclictest7980-21diskmemload09:10:012
14609991919,0cyclictest0-21swapper/207:23:332
14609991918,1cyclictest24133-21apt-get08:38:342
14608991919,0cyclictest1310-21apt-get08:58:341
14608991919,0cyclictest0-21swapper/108:33:341
14608991919,0cyclictest0-21swapper/107:43:341
14608991919,0cyclictest0-21swapper/107:13:341
1460899191,0cyclictest0-21swapper/107:38:341
14607991919,0cyclictest0-21swapper/008:43:330
14607991919,0cyclictest0-21swapper/008:38:340
14607991919,0cyclictest0-21swapper/008:18:340
14607991917,1cyclictest0-21swapper/009:05:010
14610991818,0cyclictest6886-21apt-get08:03:333
14610991817,1cyclictest32088-21apt-get07:48:333
14609991818,0cyclictest0-21swapper/207:33:342
14609991816,2cyclictest17572-21apt-get07:18:332
14609991816,1cyclictest3197-21cron09:00:002
14609991816,1cyclictest15997-21sh08:20:012
14608991818,0cyclictest0-21swapper/107:48:331
14608991816,1cyclictest0-21swapper/109:10:011
14607991818,0cyclictest0-21swapper/008:13:340
14610991714,2cyclictest28429-21munin-plugin-st08:45:003
1461099170,14cyclictest0-21swapper/308:15:013
14608991716,1cyclictest0-21swapper/107:30:011
14608991715,1cyclictest20188-21cstates07:23:341
14607991717,0cyclictest0-21swapper/008:33:340
14607991717,0cyclictest0-21swapper/007:43:340
14607991716,0cyclictest0-21swapper/007:13:340
14610991616,0cyclictest0-21swapper/308:33:343
14610991614,1cyclictest0-21swapper/307:13:333
1461099160,0cyclictest0-21swapper/309:02:453
14607991615,1cyclictest4469-21apt-get07:58:330
1460999150,14cyclictest0-21swapper/208:23:432
14608991515,0cyclictest0-21swapper/108:43:341
14608991514,1cyclictest0-21swapper/108:53:331
14607991515,0cyclictest0-21swapper/008:08:350
14607991514,1cyclictest0-21swapper/007:38:340
14607991513,1cyclictest0-21swapper/007:53:400
14609991414,0cyclictest0-21swapper/208:45:462
1460999140,14cyclictest0-21swapper/208:50:232
1460999140,14cyclictest0-21swapper/207:51:012
1460999140,0cyclictest0-21swapper/207:40:192
1460899140,14cyclictest0-21swapper/107:15:221
14607991414,0cyclictest0-21swapper/008:04:190
14607991414,0cyclictest0-21swapper/007:48:330
1460799140,14cyclictest0-21swapper/007:25:340
1460799140,0cyclictest0-21swapper/008:58:120
14610991313,0cyclictest0-21swapper/308:12:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional