You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 18:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jun 10, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1827699250,24cyclictest16764-21latency_hist10:15:003
1827699250,24cyclictest11560-21diskmemload09:59:343
1827699250,24cyclictest0-21swapper/310:37:143
18271992522,2cyclictest13904-21ssh09:13:102
1827199250,24cyclictest16710-21ssh10:14:572
1826399251,24cyclictest62550irq/127-eno112:04:560
1826399250,24cyclictest28835-21ssh11:56:410
18276992423,1cyclictest0-21swapper/311:35:583
18276992422,1cyclictest28842-21ssh12:27:233
18276992422,1cyclictest0-21swapper/310:15:353
18276992421,2cyclictest27241-21basename11:25:013
1827699240,23cyclictest0-21swapper/312:35:293
1827699240,22cyclictest313-21systemd-journal08:55:003
1827699240,1cyclictest11560-21diskmemload11:34:223
18271992423,1cyclictest3304-21ssh09:33:022
18271992423,1cyclictest11560-21diskmemload12:05:052
18271992422,1cyclictest28-21ksoftirqd/210:40:472
18271992422,1cyclictest0-21swapper/210:59:372
18271992421,2cyclictest11560-21diskmemload11:00:282
1827199240,23cyclictest32593-21grep11:30:012
1827199240,23cyclictest32593-21grep11:30:012
1827199240,23cyclictest0-21swapper/212:39:252
1827199240,23cyclictest0-21swapper/211:51:502
1827199240,0cyclictest0-21swapper/210:54:192
18267992424,0cyclictest0-21swapper/112:08:101
18267992424,0cyclictest0-21swapper/110:19:021
1826799240,24cyclictest0-21swapper/109:31:201
1826799240,23cyclictest11560-21diskmemload11:34:241
1826799240,23cyclictest0-21swapper/111:06:301
1826799240,23cyclictest0-21swapper/110:56:411
1826799240,23cyclictest0-21swapper/110:11:031
1826799240,23cyclictest0-21swapper/109:59:311
1826799240,23cyclictest0-21swapper/109:11:111
1826799240,1cyclictest0-21swapper/112:24:301
1826799240,0cyclictest0-21swapper/111:10:351
1826799240,0cyclictest0-21swapper/110:45:201
18263992424,0cyclictest11560-21diskmemload10:28:300
1826399240,23cyclictest847-21ssh11:00:170
1826399240,23cyclictest30817-21ssh11:29:230
1826399240,23cyclictest30817-21ssh11:29:230
1826399240,23cyclictest11560-21diskmemload11:35:070
1826399240,23cyclictest0-21swapper/012:10:310
1826399240,23cyclictest0-21swapper/009:45:230
18276992323,0cyclictest11560-21diskmemload10:25:583
18276992323,0cyclictest0-21swapper/312:33:133
18276992323,0cyclictest0-21swapper/312:00:393
18276992323,0cyclictest0-21swapper/311:53:163
18276992323,0cyclictest0-21swapper/311:14:043
18276992323,0cyclictest0-21swapper/310:30:103
18276992322,1cyclictest25872-21apt-get09:24:203
18276992322,1cyclictest11560-21diskmemload11:03:223
18276992321,1cyclictest8102-21ssh10:07:483
18276992321,1cyclictest0-21swapper/309:28:123
18276992320,2cyclictest7583-21rm11:07:183
1827699230,2cyclictest28959-21sh11:56:513
1827699230,23cyclictest0-21swapper/309:33:413
1827699230,22cyclictest23374-21ssh10:20:563
1827699230,22cyclictest1770-21ssh10:01:163
1827699230,22cyclictest12645-21ssh09:11:203
1827699230,22cyclictest0-21swapper/309:16:113
1827699230,1cyclictest23070-21ssh09:50:373
18271992323,0cyclictest0-21swapper/212:32:012
18271992323,0cyclictest0-21swapper/212:01:202
18271992323,0cyclictest0-21swapper/209:48:272
18271992321,1cyclictest0-21swapper/211:41:512
18271992321,0cyclictest0-21swapper/211:56:532
18271992320,2cyclictest17332-21ssh11:15:512
18271992320,2cyclictest12239-21ssh09:40:272
18271992320,2cyclictest11968-21ssh11:10:492
18271992319,1cyclictest0-21swapper/212:21:352
1827199230,2cyclictest313-21systemd-journal08:20:012
1827199230,2cyclictest11081-21ssh10:09:392
1827199230,22cyclictest6382-21ssh11:05:312
1827199230,22cyclictest2897-21ssh10:32:462
1827199230,22cyclictest22150-21ssh11:20:042
1827199230,22cyclictest17479-21ssh11:45:502
1827199230,22cyclictest11560-21diskmemload09:26:352
1827199230,1cyclictest0-21swapper/209:36:112
1827199230,0cyclictest11560-21diskmemload12:25:052
1827199230,0cyclictest11560-21diskmemload12:19:132
1827199230,0cyclictest0-21swapper/212:14:482
1827199230,0cyclictest0-21swapper/210:45:342
1827199230,0cyclictest0-21swapper/210:38:512
18267992323,0cyclictest0-21swapper/110:35:041
18267992323,0cyclictest0-21swapper/110:06:141
18267992323,0cyclictest0-21swapper/110:02:321
18267992323,0cyclictest0-21swapper/109:50:291
18267992322,1cyclictest11560-21diskmemload12:00:211
18267992321,2cyclictest5723-21ssh11:04:591
18267992321,1cyclictest4965-21apt-get08:59:201
18267992321,1cyclictest0-21swapper/110:29:051
18267992320,2cyclictest18595-21sh12:17:511
1826799230,23cyclictest0-21swapper/111:38:111
1826799230,23cyclictest0-21swapper/110:43:021
1826799230,23cyclictest0-21swapper/110:23:571
1826799230,23cyclictest0-21swapper/109:37:361
1826799230,22cyclictest22982-21sh10:50:541
1826799230,22cyclictest22293-21sh11:20:161
1826799230,22cyclictest13227-21rm09:41:581
1826799230,22cyclictest0-21swapper/112:38:241
1826799230,22cyclictest0-21swapper/109:45:161
1826799230,0cyclictest0-21swapper/111:50:541
1826799230,0cyclictest0-21swapper/111:43:001
1826799230,0cyclictest0-21swapper/111:19:411
1826799230,0cyclictest0-21swapper/107:54:201
18263992323,0cyclictest11560-21diskmemload09:57:230
18263992323,0cyclictest0-21swapper/012:25:160
18263992323,0cyclictest0-21swapper/011:43:230
18263992323,0cyclictest0-21swapper/010:55:060
18263992323,0cyclictest0-21swapper/009:40:120
18263992322,1cyclictest11560-21diskmemload10:20:290
18263992321,1cyclictest0-21swapper/010:40:110
18263992321,1cyclictest0-21swapper/009:27:450
18263992320,2cyclictest7027-21ssh09:35:390
1826399231,1cyclictest62550irq/127-eno111:33:330
1826399230,23cyclictest0-21swapper/012:31:180
1826399230,23cyclictest0-21swapper/010:38:140
1826399230,23cyclictest0-21swapper/010:15:360
1826399230,22cyclictest1784-21ssh09:30:510
1826399230,22cyclictest17210-21ssh10:45:200
1826399230,22cyclictest14704-21cron08:10:000
1826399230,22cyclictest0-21swapper/012:09:220
1826399230,22cyclictest0-21swapper/011:19:500
1826399230,22cyclictest0-21swapper/010:10:140
1826399230,22cyclictest0-21swapper/009:22:050
1826399230,22cyclictest0-21swapper/009:16:440
1826399230,22cyclictest0-21swapper/009:11:060
1826399230,21cyclictest0-21swapper/010:32:580
1826399230,1cyclictest0-21swapper/012:35:100
1826399230,1cyclictest0-21swapper/011:22:030
18276992221,1cyclictest0-21swapper/312:11:043
18276992221,1cyclictest0-21swapper/312:05:143
18276992220,1cyclictest0-21swapper/310:58:153
18276992220,1cyclictest0-21swapper/310:44:243
18276992220,1cyclictest0-21swapper/307:15:003
18276992219,2cyclictest6861-21ssh09:35:253
18276992219,2cyclictest22406-21ssh12:20:413
18276992219,2cyclictest16866-21ssh12:15:133
1827699220,22cyclictest11560-21diskmemload11:45:553
1827699220,21cyclictest605-21avahi-daemon07:25:013
1827699220,21cyclictest18088-21ssh10:46:323
1827699220,21cyclictest11560-21diskmemload11:40:533
1827699220,21cyclictest0-21swapper/309:45:213
1827699220,21cyclictest0-21swapper/307:29:203
1827699220,1cyclictest9906-21cron08:00:003
1827699220,1cyclictest22961-21ssh10:50:523
1827699220,0cyclictest0-21swapper/311:16:003
18271992222,0cyclictest11560-21diskmemload09:50:262
18271992220,1cyclictest0-21swapper/209:21:572
18271992220,1cyclictest0-21swapper/208:24:212
1827199220,21cyclictest29789-21ssh09:57:422
1827199220,21cyclictest11560-21diskmemload10:20:222
1827199220,21cyclictest0-21swapper/211:36:122
1827199220,21cyclictest0-21swapper/210:15:422
1827199220,21cyclictest0-21swapper/208:44:212
1827199220,21cyclictest0-21swapper/208:14:222
1827199220,1cyclictest10530-21apt-get08:04:212
1827199220,1cyclictest0-21swapper/211:32:492
1827199220,1cyclictest0-21swapper/210:00:552
18267992220,1cyclictest17617-21sh09:15:021
18267992220,1cyclictest0-21swapper/112:30:071
1826799220,2cyclictest27832-21sh11:25:291
1826799220,2cyclictest27832-21sh11:25:291
1826799220,21cyclictest32582-21apt-get08:49:191
1826799220,21cyclictest25441-21munin-run07:25:011
1826799220,21cyclictest17022-21apt-get11:45:031
1826799220,21cyclictest15715-21apt-get08:14:221
1826799220,21cyclictest12117-21sh12:11:111
1826799220,21cyclictest0-21swapper/111:55:411
1826799220,21cyclictest0-21swapper/110:30:571
1826799220,21cyclictest0-21swapper/109:20:011
1826799220,1cyclictest908-21apt-get07:44:221
1826799220,1cyclictest28818-21sh09:25:471
1826799220,0cyclictest0-21swapper/112:27:371
18263992222,0cyclictest0-21swapper/012:16:030
18263992222,0cyclictest0-21swapper/011:51:150
18263992222,0cyclictest0-21swapper/011:05:340
18263992222,0cyclictest0-21swapper/009:54:090
18263992220,1cyclictest0-21swapper/011:45:380
1826399220,21cyclictest13521-21sh11:13:180
1826399220,21cyclictest12342-21perf08:05:000
1826399220,21cyclictest0-21swapper/007:19:210
1826399220,0cyclictest0-21swapper/010:50:200
1826399220,0cyclictest0-21swapper/008:19:210
18276992118,2cyclictest32358-21timerandwakeup07:39:293
1827699210,21cyclictest0-21swapper/309:40:103
1827699210,1cyclictest5138-21perf07:50:003
1827699210,1cyclictest27728-21ssh11:25:213
1827699210,1cyclictest27728-21ssh11:25:213
1827699210,0cyclictest0-21swapper/308:34:233
18271992119,1cyclictest23623-21apt-get07:24:202
1827199210,21cyclictest0-21swapper/209:15:162
1827199210,20cyclictest2570-21apt-get08:54:202
1827199210,20cyclictest0-21swapper/209:04:202
1827199210,1cyclictest21205-21apt-get07:19:212
1827199210,0cyclictest8113-21apt-get07:59:212
18267992120,0cyclictest0-21swapper/108:39:201
18267992119,1cyclictest32745-21munin-run07:40:011
18267992118,2cyclictest313-21systemd-journal08:30:011
1826799210,20cyclictest0-21swapper/107:19:211
18263992121,0cyclictest0-21swapper/012:21:130
1826399210,20cyclictest0-21swapper/008:59:210
1826399210,20cyclictest0-21swapper/008:24:210
1826399210,0cyclictest0-21swapper/008:34:230
18276992020,0cyclictest0-21swapper/309:04:203
18276992020,0cyclictest0-21swapper/308:29:193
18276992020,0cyclictest0-21swapper/308:10:023
18276992020,0cyclictest0-21swapper/307:44:223
1827699200,20cyclictest0-21swapper/307:34:203
1827699200,0cyclictest0-21swapper/308:59:203
18271992020,0cyclictest3320-21apt-get07:49:202
18271992019,1cyclictest5718-21apt-get07:54:202
1827199200,0cyclictest22980-21apt-get08:29:202
18267992020,0cyclictest20586-21apt-get08:24:211
18267992020,0cyclictest0-21swapper/107:29:201
18267992020,0cyclictest0-21swapper/107:14:191
18267992019,0cyclictest12924-21apt-get08:09:211
1826799200,0cyclictest0-21swapper/108:19:211
18263992018,1cyclictest27772-21apt-get08:39:200
1826399200,0cyclictest0-21swapper/009:09:200
1826399200,0cyclictest0-21swapper/007:59:200
1826399200,0cyclictest0-21swapper/007:14:190
18276991919,0cyclictest0-21swapper/308:19:213
18276991919,0cyclictest0-21swapper/308:04:223
18276991919,0cyclictest0-21swapper/307:19:213
18276991916,2cyclictest29590-21latency_hist08:40:003
18271991918,0cyclictest18807-21apt-get07:14:192
18267991919,0cyclictest0-21swapper/109:04:201
18267991919,0cyclictest0-21swapper/108:54:201
18267991919,0cyclictest0-21swapper/108:34:231
18267991919,0cyclictest0-21swapper/107:49:201
18267991918,0cyclictest0-21swapper/107:35:011
18263991919,0cyclictest30809-21apt-get07:39:200
18263991919,0cyclictest0-21swapper/009:04:200
18263991917,1cyclictest24775-21perf08:30:010
18276991817,0cyclictest0-21swapper/308:24:213
18271991818,0cyclictest0-21swapper/208:59:202
18271991818,0cyclictest0-21swapper/208:39:202
18271991818,0cyclictest0-21swapper/208:09:202
18271991818,0cyclictest0-21swapper/207:39:202
18271991817,1cyclictest0-21swapper/207:44:222
18267991818,0cyclictest0-21swapper/108:04:211
18263991818,0cyclictest0-21swapper/007:54:200
18263991818,0cyclictest0-21swapper/007:44:220
18263991818,0cyclictest0-21swapper/007:24:200
18276991717,0cyclictest0-21swapper/308:09:213
18276991717,0cyclictest0-21swapper/307:54:213
1827699170,0cyclictest0-21swapper/308:44:223
18263991717,0cyclictest0-21swapper/008:49:190
1826399170,0cyclictest17586-21munin-run08:15:010
18276991616,0cyclictest0-21swapper/308:49:193
18271991615,1cyclictest28412-21apt-get07:34:202
18271991615,1cyclictest25382-21apt-get08:34:232
18267991616,0cyclictest0-21swapper/107:59:211
18263991616,0cyclictest0-21swapper/008:54:200
1826399160,1cyclictest27215-21proc_pri07:29:270
1827699150,1cyclictest95422chrt09:06:443
18271991514,0cyclictest26016-21apt-get07:29:202
1827199140,14cyclictest0-21swapper/209:06:152
1827199140,14cyclictest0-21swapper/208:45:182
18267991414,0cyclictest0-21swapper/109:05:031
1826799140,0cyclictest0-21swapper/108:40:431
1826399140,0cyclictest0-21swapper/008:40:300
1826399140,0cyclictest0-21swapper/007:45:410
1826399140,0cyclictest0-21swapper/007:30:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional