You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 23:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Fri Apr 10, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30857992722,4cyclictest0-21swapper/210:05:442
3085799260,25cyclictest6757-21ssh09:55:462
3085899250,24cyclictest9705-21rm09:27:353
30857992520,1cyclictest24995-21diskmemload10:17:492
3085799250,24cyclictest0-21swapper/212:21:022
3085399250,24cyclictest24995-21diskmemload11:26:031
3085399250,24cyclictest24995-21diskmemload09:36:131
3085399250,24cyclictest0-21swapper/112:35:231
3085399250,24cyclictest0-21swapper/110:38:581
3084899250,24cyclictest24995-21diskmemload09:44:560
3084899250,24cyclictest0-21swapper/012:04:150
3084899250,24cyclictest0-21swapper/010:21:090
3085899240,23cyclictest5740-21ssh09:54:363
30857992420,2cyclictest32592-21rm09:18:392
3085799240,23cyclictest24995-21diskmemload12:05:322
3085799240,23cyclictest1453-21ssh11:58:472
3085399240,0cyclictest1144-21apt-get08:24:141
30848992423,1cyclictest0-21swapper/010:36:000
30848992422,1cyclictest26680-21sh11:19:200
30848992422,1cyclictest0-21swapper/011:24:350
30848992422,1cyclictest0-21swapper/009:46:360
3084899240,1cyclictest27176-21apt-get12:24:150
3084899240,1cyclictest24995-21diskmemload10:12:450
3084899240,1cyclictest11663-21ssh10:00:250
30858992323,0cyclictest24995-21diskmemload12:20:243
30858992323,0cyclictest0-21swapper/312:08:123
30858992323,0cyclictest0-21swapper/311:21:413
30858992321,1cyclictest28282-21idleruntime-cro09:45:003
3085899230,23cyclictest32084-21ssh11:55:593
3085899230,23cyclictest0-21swapper/312:36:093
3085899230,23cyclictest0-21swapper/311:35:083
3085899230,23cyclictest0-21swapper/309:38:243
3085899230,23cyclictest0-21swapper/309:19:073
3085899230,22cyclictest9365-21munin-run10:30:003
3085899230,22cyclictest32659-21rm10:21:293
3085899230,22cyclictest25023-21ls09:10:003
3085899230,22cyclictest24995-21diskmemload11:29:063
3085899230,22cyclictest24995-21diskmemload10:06:213
3085899230,22cyclictest23803-21ssh11:15:563
3085899230,22cyclictest0-21swapper/310:00:253
3085899230,1cyclictest25270-21ssh10:45:543
3085899230,0cyclictest24995-21diskmemload11:04:393
3085899230,0cyclictest0-21swapper/312:13:183
3085899230,0cyclictest0-21swapper/309:55:253
3085899230,0cyclictest0-21swapper/309:46:003
30857992323,0cyclictest0-21swapper/211:05:202
30857992321,2cyclictest8440-21ssh11:00:502
30857992321,1cyclictest4509-21ssh10:57:412
30857992321,1cyclictest4509-21ssh10:57:412
30857992321,1cyclictest0-21swapper/209:24:222
30857992320,2cyclictest7375-21ssh11:32:102
30857992320,2cyclictest29680-21ssh12:25:012
30857992320,2cyclictest14532-21ssh11:39:182
3085799230,2cyclictest7719-21chrt12:35:322
3085799230,2cyclictest16402-21diskmemload12:13:162
3085799230,2cyclictest12994-21idleruntime-cro09:30:012
3085799230,23cyclictest0-21swapper/212:16:232
3085799230,23cyclictest0-21swapper/211:53:542
3085799230,23cyclictest0-21swapper/210:41:302
3085799230,23cyclictest0-21swapper/210:10:072
3085799230,23cyclictest0-21swapper/209:12:092
3085799230,22cyclictest5926-21sh10:27:262
3085799230,22cyclictest28678-21ssh09:45:222
3085799230,22cyclictest28496-21ssh11:20:232
3085799230,22cyclictest24892-21ssh10:45:212
3085799230,22cyclictest17146-21ssh11:41:262
3085799230,0cyclictest24995-21diskmemload09:43:162
3085799230,0cyclictest0-21swapper/212:31:572
3085799230,0cyclictest0-21swapper/211:15:572
30853992323,0cyclictest0-21swapper/112:12:561
30853992323,0cyclictest0-21swapper/111:22:471
30853992323,0cyclictest0-21swapper/111:19:311
30853992323,0cyclictest0-21swapper/109:58:511
30853992323,0cyclictest0-21swapper/109:30:521
30853992321,1cyclictest9965-21sh12:06:071
30853992321,1cyclictest7064-21grep09:24:231
30853992321,1cyclictest0-21swapper/112:30:071
30853992321,1cyclictest0-21swapper/109:44:151
3085399230,2cyclictest28465-21sh10:17:581
3085399230,23cyclictest0-21swapper/112:16:301
3085399230,23cyclictest0-21swapper/110:57:061
3085399230,23cyclictest0-21swapper/110:57:061
3085399230,23cyclictest0-21swapper/110:40:231
3085399230,23cyclictest0-21swapper/110:04:351
3085399230,22cyclictest28127-21ssh12:24:191
3085399230,22cyclictest24995-21diskmemload10:21:051
3085399230,22cyclictest24995-21diskmemload10:12:241
3085399230,22cyclictest21744-21diskmemload11:45:381
3085399230,22cyclictest17930-21cut11:10:011
3085399230,22cyclictest0-21swapper/110:06:211
3085399230,22cyclictest0-21swapper/109:18:431
3085399230,1cyclictest0-21swapper/109:27:051
3085399230,0cyclictest0-21swapper/112:25:451
3085399230,0cyclictest0-21swapper/112:01:311
30848992323,0cyclictest24995-21diskmemload11:03:090
30848992323,0cyclictest0-21swapper/012:16:040
30848992323,0cyclictest0-21swapper/011:47:300
30848992323,0cyclictest0-21swapper/010:52:360
30848992323,0cyclictest0-21swapper/010:33:050
30848992323,0cyclictest0-21swapper/010:15:280
30848992322,1cyclictest0-21swapper/011:36:490
30848992321,1cyclictest0-21swapper/010:10:010
30848992320,2cyclictest13780-21sh11:06:120
3084899230,2cyclictest22612-21sh09:05:000
3084899230,2cyclictest14016-21ssh12:09:440
3084899230,23cyclictest0-21swapper/011:25:140
3084899230,23cyclictest0-21swapper/010:42:130
3084899230,23cyclictest0-21swapper/010:25:400
3084899230,23cyclictest0-21swapper/009:56:020
3084899230,23cyclictest0-21swapper/009:39:220
3084899230,23cyclictest0-21swapper/009:20:250
3084899230,22cyclictest4111-21ssh12:33:000
3084899230,22cyclictest29611-21grep10:50:000
3084899230,22cyclictest24995-21diskmemload11:31:220
3084899230,22cyclictest18353-21ssh11:43:240
3084899230,22cyclictest0-21swapper/012:35:510
3084899230,1cyclictest0-21swapper/009:27:280
3084899230,0cyclictest0-21swapper/012:25:450
3084899230,0cyclictest0-21swapper/011:11:500
30858992222,0cyclictest24995-21diskmemload11:51:473
30858992222,0cyclictest0-21swapper/312:31:333
30858992222,0cyclictest0-21swapper/311:12:263
30858992222,0cyclictest0-21swapper/310:10:393
30858992220,1cyclictest313-21systemd-journal07:25:003
30858992220,1cyclictest30649-21ssh12:26:373
30858992220,1cyclictest19687-21sh12:15:203
30858992220,1cyclictest14947-21rm10:35:373
3085899220,21cyclictest6198-21apt-get07:29:143
3085899220,21cyclictest5398-21ssh12:01:543
3085899220,21cyclictest3884-21ssh09:21:263
3085899220,21cyclictest20231-21munin-run09:00:003
3085899220,21cyclictest17819-21munin-run08:55:003
3085899220,21cyclictest13340-21ssh09:30:153
3085899220,21cyclictest12639-21perf08:45:013
3085899220,21cyclictest0-21swapper/307:14:143
3085899220,1cyclictest25265-21ssh09:10:023
3085899220,1cyclictest0-21swapper/310:40:013
3085899220,0cyclictest0-21swapper/310:55:323
3085899220,0cyclictest0-21swapper/310:55:323
3085899220,0cyclictest0-21swapper/310:30:353
30857992220,1cyclictest313-21systemd-journal09:40:002
30857992220,1cyclictest0-21swapper/211:11:452
3085799220,21cyclictest5401-21rm12:01:552
3085799220,21cyclictest3802-21apt-get07:24:132
3085799220,21cyclictest24995-21diskmemload09:30:502
3085799220,21cyclictest1243-21ssh11:25:252
3085799220,21cyclictest0-21swapper/211:45:392
3085799220,21cyclictest0-21swapper/210:35:142
3085799220,1cyclictest0-21swapper/210:23:232
30853992222,0cyclictest0-21swapper/111:31:321
30853992222,0cyclictest0-21swapper/110:46:331
30853992222,0cyclictest0-21swapper/109:10:451
30853992220,1cyclictest5344-21cron08:30:011
3085399220,22cyclictest0-21swapper/111:00:471
3085399220,21cyclictest5817-21ssh10:27:161
3085399220,21cyclictest29614-21apt-get10:50:011
3085399220,21cyclictest26348-21apt-get08:09:161
3085399220,21cyclictest24995-21diskmemload11:50:221
3085399220,21cyclictest0-21swapper/109:50:141
3085399220,21cyclictest0-21swapper/109:45:201
3085399220,21cyclictest0-21swapper/107:29:141
3085399220,1cyclictest32317-21diskmemload11:56:201
3085399220,1cyclictest16703-21sh11:40:471
3085399220,1cyclictest11011-21ssh10:32:291
3085399220,0cyclictest11480-21ssh11:35:341
30848992221,1cyclictest24995-21diskmemload11:53:480
3084899220,22cyclictest0-21swapper/012:13:420
3084899220,22cyclictest0-21swapper/009:16:390
3084899220,22cyclictest0-21swapper/009:12:340
3084899220,21cyclictest5627-21awk07:25:000
3084899220,21cyclictest24995-21diskmemload09:51:100
3084899220,21cyclictest0-21swapper/008:39:150
3084899220,21cyclictest0-21swapper/008:34:140
3084899220,21cyclictest0-21swapper/008:09:160
3084899220,1cyclictest0-21swapper/009:33:410
30858992121,0cyclictest13958-21apt-get07:44:163
30858992121,0cyclictest0-21swapper/311:40:313
30858992121,0cyclictest0-21swapper/311:32:213
30858992121,0cyclictest0-21swapper/310:51:013
30858992121,0cyclictest0-21swapper/307:34:143
30858992120,1cyclictest0-21swapper/308:49:153
3085899210,21cyclictest0-21swapper/307:55:013
3085899210,20cyclictest2975-21munin-run08:25:003
3085899210,20cyclictest0-21swapper/308:04:153
3085899210,0cyclictest24995-21diskmemload11:05:073
30857992121,0cyclictest23205-21apt-get09:09:142
30857992121,0cyclictest0-21swapper/210:00:142
30857992119,0cyclictest0-21swapper/209:50:072
3085799210,21cyclictest0-21swapper/210:50:452
3085799210,20cyclictest0-21swapper/207:19:162
3085799210,1cyclictest8594-21apt-get07:34:142
30853992121,0cyclictest0-21swapper/107:49:151
30853992121,0cyclictest0-21swapper/107:14:141
3085399210,21cyclictest0-21swapper/107:59:141
3085399210,20cyclictest0-21swapper/107:34:141
3085399210,0cyclictest0-21swapper/111:11:241
30848992121,0cyclictest0-21swapper/008:24:140
30848992121,0cyclictest0-21swapper/008:19:160
3084899210,21cyclictest0-21swapper/011:55:110
3084899210,20cyclictest23335-21sh08:00:010
3084899210,0cyclictest0-21swapper/007:54:150
30858992020,0cyclictest0-21swapper/308:34:143
30858992020,0cyclictest0-21swapper/307:59:143
30858992019,1cyclictest28745-21apt-get08:14:153
30857992020,0cyclictest23955-21apt-get08:04:152
30857992019,1cyclictest11541-21apt-get07:39:142
30857992019,0cyclictest21537-21apt-get07:59:142
3085799200,0cyclictest31149-21apt-get08:19:162
3085799200,0cyclictest0-21swapper/207:29:152
30853992020,0cyclictest0-21swapper/109:05:001
30853992019,1cyclictest18391-21apt08:59:151
30853992019,0cyclictest19145-21apt-get07:54:161
30853992018,1cyclictest10234-21munin-run08:40:011
3085399200,0cyclictest0-21swapper/108:54:151
30848992020,0cyclictest0-21swapper/008:54:150
30848992020,0cyclictest0-21swapper/007:19:160
30857991919,0cyclictest0-21swapper/208:44:142
30857991918,1cyclictest18392-21apt-get08:59:152
30857991917,1cyclictest0-21swapper/208:45:022
30853991919,0cyclictest0-21swapper/108:49:151
30853991919,0cyclictest0-21swapper/108:34:141
30848991919,0cyclictest0-21swapper/008:29:150
30848991919,0cyclictest0-21swapper/007:34:140
30858991818,0cyclictest0-21swapper/307:35:023
30857991818,0cyclictest0-21swapper/208:24:142
30857991818,0cyclictest0-21swapper/207:49:152
30857991817,1cyclictest0-21swapper/207:14:142
30857991816,1cyclictest18170-21apt-get07:50:022
30853991818,0cyclictest0-21swapper/108:14:161
30853991818,0cyclictest0-21swapper/107:24:131
30848991818,0cyclictest0-21swapper/007:29:140
30858991717,0cyclictest20809-21apt-get09:04:143
30858991715,1cyclictest28166-21apt08:10:003
30853991717,0cyclictest0-21swapper/109:09:141
30853991716,1cyclictest10450-21apt-get07:35:021
30853991714,1cyclictest25772-21perf08:05:001
30848991716,0cyclictest0-21swapper/007:49:150
30858991616,0cyclictest0-21swapper/308:39:153
30857991616,0cyclictest0-21swapper/208:09:162
30857991616,0cyclictest0-21swapper/207:44:162
30857991614,1cyclictest8341-21apt-get08:39:152
3085799160,14cyclictest0-21swapper/208:51:022
30853991616,0cyclictest0-21swapper/108:19:161
30853991616,0cyclictest0-21swapper/107:19:161
30853991614,1cyclictest13958-21apt-get07:44:151
30848991616,0cyclictest31399-21apt-get07:14:140
30858991515,0cyclictest16353-21apt-get07:49:153
30857991515,0cyclictest3550-21apt-get08:29:142
30857991515,0cyclictest0-21swapper/208:14:162
30857991514,0cyclictest5945-21apt-get08:34:142
30848991515,0cyclictest0-21swapper/008:49:150
30848991513,1cyclictest0-21swapper/007:39:140
3084899150,14cyclictest0-21swapper/008:55:470
3085899140,14cyclictest0-21swapper/308:25:323
3085899140,14cyclictest0-21swapper/307:15:583
3085899140,0cyclictest0-21swapper/308:15:043
3085799140,14cyclictest0-21swapper/209:00:312
30853991414,0cyclictest0-21swapper/108:40:051
30848991414,0cyclictest0-21swapper/008:40:040
30848991414,0cyclictest0-21swapper/008:00:260
3084899140,14cyclictest0-21swapper/008:10:120
3084899140,14cyclictest0-21swapper/007:40:050
3084899140,0cyclictest0-21swapper/009:05:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional