You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 00:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sat May 16, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27371992726,1cyclictest5780-1kworker/u9:110:33:532
27376992523,1cyclictest0-21swapper/310:40:493
2737699250,24cyclictest14447-21ssh10:57:253
27371992523,1cyclictest11960-21ssh10:27:202
2737199250,25cyclictest0-21swapper/211:24:452
2736999250,24cyclictest0-21swapper/112:27:081
2736999250,24cyclictest0-21swapper/110:57:111
27368992523,1cyclictest0-21swapper/011:38:060
2736899250,24cyclictest20682-21diskmemload12:36:330
2736899250,24cyclictest20682-21diskmemload09:51:320
2736899250,24cyclictest20682-21diskmemload09:32:440
2736899250,24cyclictest0-21swapper/011:34:460
27376992423,1cyclictest18045-21ssh10:03:473
27376992423,1cyclictest0-21swapper/311:45:303
2737699240,23cyclictest15893-21ssh10:30:463
2737699240,0cyclictest20682-21diskmemload12:19:393
27371992420,0cyclictest0-21swapper/209:23:452
27371992419,1cyclictest16526-21ssh11:27:252
2737199240,24cyclictest5139-21ssh10:49:452
2737199240,23cyclictest0-21swapper/209:46:012
2737199240,1cyclictest24267-21ssh11:34:452
27369992423,1cyclictest20682-21diskmemload11:41:591
27369992423,1cyclictest0-21swapper/111:59:171
27369992423,1cyclictest0-21swapper/109:48:431
27369992422,1cyclictest0-21swapper/109:27:171
27369992421,2cyclictest0-21swapper/112:30:561
2736999240,24cyclictest0-21swapper/111:11:081
2736999240,24cyclictest0-21swapper/109:30:211
2736999240,23cyclictest20682-21diskmemload10:35:301
2736999240,23cyclictest0-21swapper/111:18:541
2736999240,0cyclictest0-21swapper/111:26:001
2736999240,0cyclictest0-21swapper/109:20:591
27368992423,1cyclictest62550irq/127-eno110:30:500
27368992423,0cyclictest0-21swapper/009:55:370
27368992423,0cyclictest0-21swapper/009:24:330
2736899240,24cyclictest0-21swapper/010:11:360
2736899240,23cyclictest20682-21diskmemload12:20:450
2736899240,23cyclictest20682-21diskmemload11:26:560
2736899240,23cyclictest20682-21diskmemload09:36:270
2736899240,23cyclictest0-21swapper/012:32:360
2736899240,23cyclictest0-21swapper/012:06:480
2736899240,23cyclictest0-21swapper/011:13:210
2736899240,0cyclictest0-21swapper/011:46:420
27376992323,0cyclictest20682-21diskmemload10:36:403
27376992323,0cyclictest0-21swapper/312:35:343
27376992323,0cyclictest0-21swapper/312:33:433
27376992320,2cyclictest8588-21ssh11:21:123
2737699230,2cyclictest22810-21ssh10:07:333
2737699230,2cyclictest17892-21sh09:36:053
2737699230,23cyclictest20682-21diskmemload10:19:263
2737699230,23cyclictest0-21swapper/311:50:143
2737699230,23cyclictest0-21swapper/311:35:483
2737699230,23cyclictest0-21swapper/311:17:573
2737699230,23cyclictest0-21swapper/309:40:123
2737699230,23cyclictest0-21swapper/309:19:273
2737699230,23cyclictest0-21swapper/309:10:563
2737699230,22cyclictest8163-21ssh09:55:263
2737699230,22cyclictest4931-21ssh10:21:253
2737699230,22cyclictest4379-21diskmemload12:12:533
2737699230,22cyclictest26228-21ssh10:11:443
2737699230,22cyclictest19437-21idleruntime-cro08:00:013
2737699230,22cyclictest1333-21ssh10:46:523
2737699230,22cyclictest11606-21ssh09:30:193
2737699230,0cyclictest0-21swapper/312:02:273
2737699230,0cyclictest0-21swapper/311:33:053
2737699230,0cyclictest0-21swapper/311:11:283
2737699230,0cyclictest0-21swapper/309:50:133
27371992323,0cyclictest0-21swapper/212:06:262
27371992323,0cyclictest0-21swapper/210:35:312
27371992323,0cyclictest0-21swapper/209:18:292
27371992321,2cyclictest24803-21sh11:35:062
27371992320,0cyclictest0-21swapper/212:10:162
2737199230,2cyclictest20771-21sh10:07:122
2737199230,23cyclictest0-21swapper/212:22:282
2737199230,23cyclictest0-21swapper/211:55:562
2737199230,23cyclictest0-21swapper/209:32:262
2737199230,23cyclictest0-21swapper/209:25:042
2737199230,22cyclictest8602-21rm09:55:582
2737199230,22cyclictest3468-21ssh11:44:292
2737199230,22cyclictest29633-21ssh11:11:152
2737199230,22cyclictest22607-21idleruntime-cro09:40:012
2737199230,22cyclictest10715-21rm11:50:412
2737199230,22cyclictest0-21swapper/211:46:142
2737199230,1cyclictest23615-21sh11:06:142
2737199230,0cyclictest0-21swapper/212:32:152
2737199230,0cyclictest0-21swapper/211:18:332
2737199230,0cyclictest0-21swapper/211:00:522
2737199230,0cyclictest0-21swapper/210:53:162
2737199230,0cyclictest0-21swapper/210:21:352
27369992323,0cyclictest20682-21diskmemload10:34:071
27369992323,0cyclictest20682-21diskmemload10:29:391
27369992323,0cyclictest0-21swapper/111:31:171
27369992323,0cyclictest0-21swapper/111:04:161
27369992323,0cyclictest0-21swapper/110:50:281
27369992323,0cyclictest0-21swapper/110:47:001
27369992323,0cyclictest0-21swapper/109:10:101
27369992321,1cyclictest0-21swapper/110:41:071
27369992321,1cyclictest0-21swapper/110:17:181
27369992321,1cyclictest0-21swapper/107:55:011
27369992320,2cyclictest5242-21sh11:46:341
27369992320,2cyclictest4733-21sh12:13:181
2736999230,23cyclictest0-21swapper/111:20:591
2736999230,22cyclictest26668-21sh10:12:161
2736999230,22cyclictest0-21swapper/112:01:231
2736999230,22cyclictest0-21swapper/109:43:421
2736999230,1cyclictest6065-21ssh09:53:291
2736999230,0cyclictest0-21swapper/111:35:281
2736999230,0cyclictest0-21swapper/110:23:301
2736999230,0cyclictest0-21swapper/110:05:351
2736999230,0cyclictest0-21swapper/109:56:221
27368992323,0cyclictest0-21swapper/010:24:460
27368992323,0cyclictest0-21swapper/009:48:500
27368992323,0cyclictest0-21swapper/009:16:210
27368992322,0cyclictest0-21swapper/010:55:290
27368992321,2cyclictest0-21swapper/010:06:220
27368992321,1cyclictest0-21swapper/011:56:030
27368992321,1cyclictest0-21swapper/011:00:190
27368992321,1cyclictest0-21swapper/010:50:060
2736899231,21cyclictest0-21swapper/010:02:210
2736899231,1cyclictest6499-21sh11:18:480
2736899230,23cyclictest0-21swapper/009:10:110
2736899230,22cyclictest62550irq/127-eno112:17:040
2736899230,22cyclictest20682-21diskmemload12:25:510
2736899230,22cyclictest20682-21diskmemload12:02:040
2736899230,22cyclictest20682-21diskmemload09:42:250
2736899230,22cyclictest0-21swapper/011:42:490
2736899230,22cyclictest0-21swapper/011:22:230
2736899230,1cyclictest26653-21ssh10:40:000
2736899230,0cyclictest0-21swapper/012:10:590
2736899230,0cyclictest0-21swapper/010:16:500
27376992222,0cyclictest20682-21diskmemload10:26:313
27376992222,0cyclictest0-21swapper/312:26:393
27376992222,0cyclictest0-21swapper/312:21:293
27376992222,0cyclictest0-21swapper/312:06:203
27376992220,2cyclictest32651-21sh09:48:153
2737699220,21cyclictest20682-21diskmemload11:00:193
2737699220,21cyclictest18740-21apt-get09:07:173
2737699220,1cyclictest13896-21ssh11:25:483
2737699220,0cyclictest0-21swapper/311:59:073
2737699220,0cyclictest0-21swapper/311:40:123
2737699220,0cyclictest0-21swapper/310:50:103
27371992222,0cyclictest0-21swapper/212:15:092
27371992222,0cyclictest0-21swapper/212:02:082
27371992221,1cyclictest31816-21sh10:44:352
27371992221,0cyclictest20682-21diskmemload10:57:042
27371992220,1cyclictest9136-21apt-get08:47:172
27371992220,1cyclictest2521-21ssh09:50:572
2737199220,22cyclictest23004-21rm09:40:222
2737199220,21cyclictest24309-21munin-run08:10:012
2737199220,21cyclictest13631-21ssh10:00:112
2737199220,21cyclictest11860-21munin-run07:45:002
2737199220,1cyclictest25497-21ssh10:10:492
2737199220,1cyclictest20947-21ssh09:10:012
2737199220,0cyclictest0-21swapper/212:37:312
2737199220,0cyclictest0-21swapper/212:28:202
27369992222,0cyclictest0-21swapper/112:06:081
27369992220,1cyclictest12846-21memory11:52:211
27369992220,1cyclictest0-21swapper/109:36:561
27369992219,2cyclictest29098-21dump-pmu-power08:20:001
2736999220,22cyclictest0-21swapper/112:20:411
2736999220,21cyclictest20682-21diskmemload10:00:061
2736999220,1cyclictest26907-21sh11:08:181
2736999220,1cyclictest0-21swapper/109:17:461
2736999220,0cyclictest0-21swapper/112:17:031
27368992221,1cyclictest11095-21ls08:50:010
27368992220,1cyclictest32138-21cron07:20:010
27368992220,1cyclictest0-21swapper/009:10:000
2736899220,22cyclictest0-21swapper/010:26:420
2736899220,21cyclictest26935-21sh10:40:170
2736899220,21cyclictest0-21swapper/011:50:010
2736899220,21cyclictest0-21swapper/011:05:010
2736899220,21cyclictest0-21swapper/009:25:180
2736899220,21cyclictest0-21swapper/007:22:160
27376992121,0cyclictest20682-21diskmemload09:25:373
27376992121,0cyclictest0-21swapper/311:05:193
27376992121,0cyclictest0-21swapper/308:57:173
27376992119,1cyclictest26696-21awk08:15:003
27376992119,1cyclictest21844-21turbostat.cron08:05:013
2737699210,21cyclictest0-21swapper/309:21:073
2737699210,20cyclictest0-21swapper/308:47:173
2737699210,20cyclictest0-21swapper/308:45:013
2737699210,20cyclictest0-21swapper/307:22:163
2737199210,1cyclictest0-21swapper/209:07:172
27369992121,0cyclictest31939-21apt-get08:27:171
2736999210,21cyclictest0-21swapper/108:07:181
27368992120,1cyclictest0-21swapper/008:57:170
27368992120,0cyclictest0-21swapper/008:27:170
27368992119,1cyclictest29755-21munin-run07:15:010
2736899210,20cyclictest0-21swapper/007:42:180
2736899210,20cyclictest0-21swapper/007:32:180
2736899210,0cyclictest0-21swapper/008:52:170
2736899210,0cyclictest0-21swapper/007:52:180
27376992020,0cyclictest11533-21apt-get08:52:183
27376992019,0cyclictest15075-21apt-get07:52:183
27376992018,1cyclictest31492-21awk08:25:003
2737699200,0cyclictest0-21swapper/308:17:153
2737699200,0cyclictest0-21swapper/308:07:173
27371992020,0cyclictest0-21swapper/208:32:172
27371992020,0cyclictest0-21swapper/208:27:162
27371992020,0cyclictest0-21swapper/208:22:172
27371992019,0cyclictest32589-21apt-get07:22:162
27371992018,1cyclictest13928-21apt-get08:57:172
27369992020,0cyclictest0-21swapper/108:42:171
27369992020,0cyclictest0-21swapper/107:32:181
27369992018,1cyclictest19447-21turbostat08:00:011
2736999200,0cyclictest0-21swapper/107:42:181
2736999200,0cyclictest0-21swapper/107:27:181
27368992020,0cyclictest0-21swapper/009:02:190
27368992020,0cyclictest0-21swapper/008:42:170
27368992020,0cyclictest0-21swapper/008:37:160
27368992020,0cyclictest0-21swapper/007:27:180
27376991919,0cyclictest0-21swapper/308:27:163
27371991919,0cyclictest0-21swapper/207:52:182
27371991918,0cyclictest0-21swapper/207:57:172
27369991919,0cyclictest0-21swapper/108:37:161
2736999190,18cyclictest0-21swapper/107:12:171
27376991818,0cyclictest0-21swapper/307:47:173
27371991818,0cyclictest7365-21apt-get07:37:152
27371991818,0cyclictest19885-21apt-get08:02:182
27371991818,0cyclictest0-21swapper/207:27:182
27369991818,0cyclictest0-21swapper/109:07:171
27369991818,0cyclictest0-21swapper/108:57:171
27369991818,0cyclictest0-21swapper/108:02:181
27368991818,0cyclictest0-21swapper/008:32:170
27368991818,0cyclictest0-21swapper/008:22:170
27368991816,1cyclictest9452-21wc07:40:000
27371991716,0cyclictest0-21swapper/208:52:172
27369991717,0cyclictest0-21swapper/108:52:181
27368991717,0cyclictest0-21swapper/008:17:160
27368991717,0cyclictest0-21swapper/008:02:180
2736899170,16cyclictest0-21swapper/007:47:170
27376991616,0cyclictest0-21swapper/307:42:183
27376991616,0cyclictest0-21swapper/307:27:183
27376991614,1cyclictest0-21swapper/308:32:223
27371991616,0cyclictest6738-21apt-get08:42:162
2736999160,15cyclictest30174-21apt-get07:17:161
27368991616,0cyclictest0-21swapper/007:57:170
27376991515,0cyclictest0-21swapper/307:37:153
27376991513,1cyclictest32174-21awk07:20:013
27371991515,0cyclictest0-21swapper/207:17:162
27371991514,0cyclictest4320-21apt-get08:37:162
27371991514,0cyclictest0-21swapper/208:12:182
27371991513,1cyclictest29749-21perf07:15:012
27369991515,0cyclictest0-21swapper/107:22:161
2736999150,15cyclictest0-21swapper/108:47:171
2736899150,14cyclictest0-21swapper/008:10:380
27376991414,0cyclictest0-21swapper/307:11:273
2737699140,14cyclictest0-21swapper/309:00:263
2737699140,14cyclictest0-21swapper/307:30:083
2737699140,0cyclictest0-21swapper/308:35:093
2737199140,14cyclictest0-21swapper/209:00:062
2737199140,14cyclictest0-21swapper/208:15:082
2737199140,14cyclictest0-21swapper/207:45:272
27369991414,0cyclictest0-21swapper/108:20:051
2736999140,14cyclictest0-21swapper/108:30:181
2736999140,14cyclictest0-21swapper/108:11:471
2736999140,14cyclictest0-21swapper/107:45:181
27368991414,0cyclictest0-21swapper/008:05:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional