You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 01:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Mar 29, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9141992523,1cyclictest15800-21apt-get12:03:152
914199250,24cyclictest28437-21cron07:50:012
914199250,24cyclictest12644-21ssh11:58:412
9140992523,1cyclictest22895-21apt-get11:38:161
914099250,24cyclictest0-21swapper/110:43:321
914099250,1cyclictest18976-21ssh10:30:061
914099250,1cyclictest0-21swapper/109:28:221
913999250,24cyclictest2538-21diskmemload10:36:200
9146992423,1cyclictest2773-21ssh12:21:173
914699240,23cyclictest2538-21diskmemload11:18:433
914699240,23cyclictest21015-21ssh10:33:163
914699240,23cyclictest20367-21ssh09:59:293
914699240,23cyclictest2008-21ssh10:45:243
914199241,0cyclictest2538-21diskmemload09:47:562
914199240,23cyclictest32502-21ssh12:18:222
914199240,23cyclictest2538-21diskmemload11:08:322
914199240,1cyclictest0-21swapper/209:58:152
9140992424,0cyclictest0-21swapper/110:55:251
9140992422,1cyclictest0-21swapper/109:16:161
9140992421,2cyclictest5666-21ssh09:45:011
914099240,23cyclictest16357-21latency_hist07:25:001
914099240,23cyclictest0-21swapper/110:37:401
914099240,23cyclictest0-21swapper/110:17:571
914099240,1cyclictest2751-21ssh12:21:141
914099240,0cyclictest0-21swapper/112:19:441
9139992423,1cyclictest2538-21diskmemload10:14:270
9139992423,1cyclictest0-21swapper/011:00:070
9139992423,1cyclictest0-21swapper/011:00:070
913999240,24cyclictest0-21swapper/012:10:140
913999240,24cyclictest0-21swapper/010:09:230
913999240,24cyclictest0-21swapper/009:57:250
913999240,23cyclictest2538-21diskmemload10:03:190
913999240,23cyclictest0-21swapper/011:18:490
913999240,1cyclictest9477-21ssh10:21:110
913999240,1cyclictest20207-21ssh12:06:370
9146992323,0cyclictest2538-21diskmemload09:30:023
9146992323,0cyclictest0-21swapper/311:42:563
9146992320,2cyclictest605-21avahi-daemon12:20:003
9146992320,2cyclictest17170-21sh12:35:043
914699230,2cyclictest24792-21ssh12:10:483
914699230,2cyclictest12720-21ssh10:55:433
914699230,23cyclictest0-21swapper/310:26:333
914699230,22cyclictest887-21ssh10:43:573
914699230,22cyclictest6663-21apt-get10:50:023
914699230,22cyclictest27548-21ssh11:10:013
914699230,22cyclictest2538-21diskmemload09:50:553
914699230,1cyclictest0-21swapper/309:37:173
914699230,0cyclictest2538-21diskmemload11:22:043
914699230,0cyclictest0-21swapper/311:58:173
914699230,0cyclictest0-21swapper/311:50:423
914699230,0cyclictest0-21swapper/311:12:473
914699230,0cyclictest0-21swapper/310:05:193
9141992323,0cyclictest2538-21diskmemload12:21:292
9141992323,0cyclictest0-21swapper/211:51:092
9141992323,0cyclictest0-21swapper/209:31:052
9141992322,1cyclictest2538-21diskmemload11:00:312
9141992322,1cyclictest2538-21diskmemload11:00:312
9141992321,1cyclictest20004-21ssh10:31:382
9141992321,1cyclictest0-21swapper/211:22:212
9141992320,2cyclictest31897-21sh11:46:372
914199230,2cyclictest8470-21ssh10:19:582
914199230,23cyclictest0-21swapper/212:12:172
914199230,23cyclictest0-21swapper/210:03:122
914199230,23cyclictest0-21swapper/209:19:042
914199230,22cyclictest25468-21ssh10:37:272
914199230,22cyclictest2538-21diskmemload09:12:392
914199230,22cyclictest17150-21ssh12:35:022
914199230,22cyclictest11072-21rm09:50:282
914199230,22cyclictest10233-21ssh10:22:192
914199230,0cyclictest0-21swapper/211:25:552
914199230,0cyclictest0-21swapper/211:11:362
9140992323,0cyclictest2538-21diskmemload12:30:291
9140992323,0cyclictest0-21swapper/111:46:041
9140992323,0cyclictest0-21swapper/111:10:201
9140992323,0cyclictest0-21swapper/111:09:431
9140992323,0cyclictest0-21swapper/109:51:131
9140992323,0cyclictest0-21swapper/109:23:451
9140992322,1cyclictest0-21swapper/107:28:161
9140992321,1cyclictest0-21swapper/110:01:251
914099230,23cyclictest0-21swapper/112:36:321
914099230,22cyclictest7099-21diskmemload11:22:301
914099230,22cyclictest32134-21ssh09:38:551
914099230,22cyclictest2538-21diskmemload10:20:291
914099230,22cyclictest0-21swapper/112:25:381
914099230,22cyclictest0-21swapper/110:48:331
914099230,22cyclictest0-21swapper/110:07:041
914099230,0cyclictest0-21swapper/112:04:141
914099230,0cyclictest0-21swapper/111:56:141
914099230,0cyclictest0-21swapper/111:02:051
914099230,0cyclictest0-21swapper/111:02:051
914099230,0cyclictest0-21swapper/110:50:331
9139992323,0cyclictest0-21swapper/011:33:540
9139992323,0cyclictest0-21swapper/010:17:380
9139992323,0cyclictest0-21swapper/009:52:290
9139992323,0cyclictest0-21swapper/009:40:120
9139992322,1cyclictest0-21swapper/011:49:120
9139992320,2cyclictest27052-21sh11:41:530
9139992320,2cyclictest0-21swapper/012:35:550
9139992320,2cyclictest0-21swapper/009:45:420
913999230,23cyclictest2538-21diskmemload11:55:280
913999230,23cyclictest0-21swapper/012:27:130
913999230,23cyclictest0-21swapper/010:40:120
913999230,22cyclictest774-21runrttasks11:06:590
913999230,22cyclictest0-21swapper/010:55:000
913999230,22cyclictest0-21swapper/009:27:400
913999230,1cyclictest30145-21ls09:00:000
913999230,1cyclictest0-21swapper/012:15:290
913999230,0cyclictest2538-21diskmemload12:30:500
913999230,0cyclictest2538-21diskmemload11:51:150
9146992222,0cyclictest2538-21diskmemload12:06:503
9146992222,0cyclictest2538-21diskmemload09:20:133
9146992222,0cyclictest0-21swapper/309:26:073
9146992220,1cyclictest606-21dbus-daemon07:20:013
9146992220,1cyclictest14546-21ssh12:01:183
9146992220,1cyclictest10519-21basename08:20:003
9146992220,1cyclictest0-21swapper/310:21:403
914699220,2cyclictest5775-21ssh09:45:033
914699220,2cyclictest32344-21sh11:47:183
914699220,2cyclictest16085-21rm11:30:283
914699220,21cyclictest8096-21rm09:15:253
914699220,21cyclictest3923-21rm10:15:273
914699220,21cyclictest26576-21apt-get07:48:143
914699220,21cyclictest2538-21diskmemload11:35:303
914699220,21cyclictest23200-21apt-get08:45:023
914699220,21cyclictest18749-21cron07:30:003
914699220,21cyclictest10795-21ssh11:25:093
914699220,21cyclictest0-21swapper/312:25:193
914699220,21cyclictest0-21swapper/308:08:143
914699220,1cyclictest0-21swapper/312:30:433
914699220,0cyclictest0-21swapper/311:00:183
914699220,0cyclictest0-21swapper/311:00:183
9141992222,0cyclictest0-21swapper/210:45:222
9141992222,0cyclictest0-21swapper/210:25:472
9141992221,1cyclictest2538-21diskmemload11:39:372
9141992221,1cyclictest16344-21ssh11:30:512
9141992220,2cyclictest4920-21sh09:44:092
9141992220,1cyclictest0-21swapper/209:23:302
914199220,22cyclictest2538-21diskmemload10:43:112
914199220,22cyclictest0-21swapper/210:54:342
914199220,21cyclictest12570-21ssh12:30:452
914199220,21cyclictest0-21swapper/211:43:192
914199220,21cyclictest0-21swapper/210:05:062
914199220,1cyclictest27770-21awk08:55:012
914199220,1cyclictest18105-21ssh09:25:062
914199220,1cyclictest1361-21apt-get08:03:142
914199220,1cyclictest10513-21idleruntime-cro08:20:002
914199220,1cyclictest0-21swapper/210:10:462
914199220,0cyclictest2538-21diskmemload11:15:402
914199220,0cyclictest0-21swapper/212:29:042
914199220,0cyclictest0-21swapper/210:59:172
9140992222,0cyclictest0-21swapper/111:40:491
9140992222,0cyclictest0-21swapper/111:15:341
9140992222,0cyclictest0-21swapper/109:56:021
9140992220,1cyclictest21149-21cron07:35:001
9140992220,1cyclictest0-21swapper/111:25:261
9140992220,1cyclictest0-21swapper/110:28:391
914099220,22cyclictest0-21swapper/110:10:251
914099220,21cyclictest6239-21ssh09:45:451
914099220,21cyclictest2538-21diskmemload12:11:341
914099220,21cyclictest2538-21diskmemload09:10:491
914099220,21cyclictest0-21swapper/112:08:571
914099220,21cyclictest0-21swapper/109:31:011
9139992222,0cyclictest2538-21diskmemload10:32:170
9139992221,1cyclictest9604-21apt-get07:13:140
9139992220,1cyclictest5191-21df09:13:160
9139992220,1cyclictest2538-21diskmemload09:30:470
9139992220,1cyclictest0-21swapper/009:38:380
913999220,22cyclictest0-21swapper/010:28:510
913999220,21cyclictest2538-21diskmemload09:21:130
913999220,21cyclictest13041-21ssh10:56:160
913999220,21cyclictest12931-21perf08:25:000
913999220,21cyclictest0-21swapper/009:10:000
913999220,1cyclictest3616-21ssh10:47:590
913999220,1cyclictest2898-21ssh12:21:280
913999220,1cyclictest28096-21ssh11:10:180
913999220,1cyclictest21703-21sh11:36:210
913999220,1cyclictest20187-21latency_hist08:40:010
913999220,1cyclictest12002-21apt-get07:18:120
913999220,1cyclictest11041-21sh11:25:320
913999220,1cyclictest0-21swapper/009:16:000
913999220,0cyclictest0-21swapper/011:23:080
9146992121,0cyclictest0-21swapper/310:36:563
9146992120,1cyclictest30877-21munin-run07:55:013
9146992119,1cyclictest821-21cron08:00:013
9146992119,1cyclictest729-21ssh09:40:043
9146992119,1cyclictest15877-21apt-get08:33:143
914699210,21cyclictest0-21swapper/308:03:143
914699210,20cyclictest2869-21ssh09:10:073
914699210,20cyclictest0-21swapper/307:23:153
914699210,0cyclictest0-21swapper/310:00:543
9141992121,0cyclictest16873-21apt-get07:28:162
9141992121,0cyclictest0-21swapper/207:58:162
9141992118,0cyclictest0-21swapper/212:05:182
914199210,0cyclictest0-21swapper/208:48:142
914099210,20cyclictest0-21swapper/108:38:131
914099210,1cyclictest866-21awk08:00:011
914099210,0cyclictest0-21swapper/109:08:141
914099210,0cyclictest0-21swapper/109:03:151
914099210,0cyclictest0-21swapper/107:38:161
9139992121,0cyclictest0-21swapper/008:48:140
9139992121,0cyclictest0-21swapper/007:48:140
9139992120,0cyclictest0-21swapper/008:33:150
9146992020,0cyclictest0-21swapper/309:03:153
9146992020,0cyclictest0-21swapper/308:38:133
9146992018,1cyclictest26085-21munin-run07:45:013
9146992018,1cyclictest0-21swapper/307:35:003
9141992020,0cyclictest18276-21apt-get08:38:132
914199200,20cyclictest0-21swapper/207:43:132
914199200,19cyclictest28272-21apt-get08:58:152
914199200,0cyclictest11034-21apt-get08:23:152
9140992020,0cyclictest0-21swapper/108:23:151
9140992020,0cyclictest0-21swapper/108:18:151
9140992017,2cyclictest15374-21perf08:30:001
914099200,0cyclictest0-21swapper/108:58:151
9139992020,0cyclictest6213-21apt-get08:13:140
9139992020,0cyclictest13428-21apt-get08:28:160
9139992020,0cyclictest0-21swapper/008:18:150
9139992020,0cyclictest0-21swapper/007:33:130
913999200,0cyclictest0-21swapper/007:43:120
9146991919,0cyclictest0-21swapper/309:08:143
9146991918,1cyclictest25877-21apt-get08:53:143
9141991919,0cyclictest14421-21apt-get07:23:152
914199190,18cyclictest32591-21munin-run09:05:002
9140991919,0cyclictest0-21swapper/108:03:141
9139991919,0cyclictest0-21swapper/008:53:140
9139991919,0cyclictest0-21swapper/008:03:140
9139991919,0cyclictest0-21swapper/007:23:150
9146991818,0cyclictest0-21swapper/308:43:153
9141991818,0cyclictest28973-21apt-get07:53:152
9140991818,0cyclictest0-21swapper/107:18:131
9140991816,1cyclictest0-21swapper/107:45:011
9139991818,0cyclictest0-21swapper/009:03:150
9146991717,0cyclictest0-21swapper/307:13:133
9141991717,0cyclictest640-21apt-get09:08:142
9141991717,0cyclictest0-21swapper/207:13:142
9141991716,1cyclictest13428-21apt-get08:28:162
9140991717,0cyclictest0-21swapper/108:45:021
914099170,16cyclictest0-21swapper/108:43:151
9139991717,0cyclictest0-21swapper/008:08:140
9139991717,0cyclictest0-21swapper/007:28:160
9139991716,1cyclictest31369-21apt-get07:58:160
9141991616,0cyclictest0-21swapper/208:13:142
9140991616,0cyclictest0-21swapper/107:48:141
914099160,15cyclictest0-21swapper/108:53:191
913999160,2cyclictest23176-21sort07:38:240
9141991515,0cyclictest0-21swapper/208:33:142
9141991514,1cyclictest13915-21perf07:20:012
9141991514,0cyclictest0-21swapper/207:33:132
914099150,1cyclictest7508-21rt-features08:13:211
9139991515,0cyclictest0-21swapper/007:53:150
914699140,14cyclictest0-21swapper/308:55:463
914699140,14cyclictest0-21swapper/308:25:343
914699140,14cyclictest0-21swapper/308:10:273
914699140,14cyclictest0-21swapper/307:35:053
914699140,0cyclictest0-21swapper/308:20:253
914199140,14cyclictest0-21swapper/208:09:022
914199140,0cyclictest0-21swapper/208:41:542
9140991414,0cyclictest0-21swapper/107:10:541
914099140,14cyclictest0-21swapper/108:31:491
914099140,14cyclictest0-21swapper/107:50:401
9139991414,0cyclictest0-21swapper/008:40:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional