You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 15:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Jul 11, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29285992621,2cyclictest12443-21rm11:23:002
29290992525,0cyclictest0-21swapper/310:39:343
29290992523,1cyclictest30949-21sh12:08:233
2929099250,24cyclictest719-21ssh11:12:263
2929099250,24cyclictest23104-21diskmemload10:53:383
2929099250,1cyclictest0-21swapper/310:55:033
29285992523,1cyclictest0-21swapper/211:11:012
2928599250,24cyclictest0-21swapper/210:46:022
2928199250,24cyclictest0-21swapper/111:31:411
2928099250,24cyclictest0-21swapper/011:31:020
2928099250,24cyclictest0-21swapper/009:21:330
29290992424,0cyclictest0-21swapper/312:31:433
29290992422,1cyclictest0-21swapper/312:23:563
2929099240,23cyclictest9812-21sh12:18:233
2929099240,23cyclictest23104-21diskmemload11:23:193
2929099240,23cyclictest23104-21diskmemload10:21:203
2929099240,1cyclictest30632-21sh10:13:243
2929099240,1cyclictest23104-21diskmemload10:19:583
2929099240,0cyclictest23104-21diskmemload12:36:233
2929099240,0cyclictest151rcu_preempt09:53:413
2928599240,23cyclictest23104-21diskmemload10:26:502
2928599240,1cyclictest23732-21ssh09:38:282
2928599240,1cyclictest0-21swapper/212:30:072
29281992421,2cyclictest29361-21ssh11:09:551
2928199240,24cyclictest0-21swapper/111:50:091
2928199240,24cyclictest0-21swapper/111:26:231
2928199240,24cyclictest0-21swapper/110:19:551
2928199240,23cyclictest25914-21ssh12:32:051
2928199240,23cyclictest25616-21ssh11:35:261
2928199240,23cyclictest23104-21diskmemload09:42:221
2928199240,23cyclictest0-21swapper/107:35:021
2928199240,1cyclictest24120-21ssh09:10:581
2928199240,0cyclictest0-21swapper/110:07:411
29280992424,0cyclictest0-21swapper/009:18:260
29280992423,1cyclictest0-21swapper/009:47:250
29280992422,1cyclictest0-21swapper/011:16:560
2928099240,23cyclictest28377-21ssh11:08:420
2928099240,23cyclictest23104-21diskmemload11:35:070
2928099240,23cyclictest19734-21ssh11:58:170
2928099240,23cyclictest17754-21sh11:27:360
2928099240,23cyclictest0-21swapper/012:10:100
2928099240,23cyclictest0-21swapper/012:07:570
2928099240,23cyclictest0-21swapper/010:30:470
2928099240,0cyclictest0-21swapper/011:01:120
29290992323,0cyclictest23104-21diskmemload12:03:293
29290992323,0cyclictest0-21swapper/312:25:253
29290992322,1cyclictest31800-21ssh09:46:243
29290992321,1cyclictest8330-21idleruntime-cro11:20:013
29290992321,1cyclictest1272-21latency_hist10:45:013
29290992321,1cyclictest0-21swapper/312:10:313
29290992320,2cyclictest8732-21latency_hist08:40:003
29290992320,2cyclictest23104-21diskmemload11:31:303
2929099230,2cyclictest13964-21rm09:58:373
2929099230,23cyclictest0-21swapper/310:27:433
2929099230,23cyclictest0-21swapper/309:40:113
2929099230,22cyclictest4841-21ssh11:45:433
2929099230,22cyclictest29507-21rm11:38:243
2929099230,22cyclictest2718-21rm11:43:183
2929099230,22cyclictest24882-21perf09:40:003
2929099230,22cyclictest23104-21diskmemload10:02:063
2929099230,22cyclictest20369-21ssh10:32:203
2929099230,22cyclictest16404-21ssh11:56:083
2929099230,22cyclictest10299-21ssh11:50:263
2929099230,22cyclictest0-21swapper/309:10:183
2929099230,0cyclictest0-21swapper/311:01:593
2929099230,0cyclictest0-21swapper/309:30:033
29285992323,0cyclictest23104-21diskmemload10:06:322
29285992323,0cyclictest0-21swapper/212:01:242
29285992323,0cyclictest0-21swapper/211:56:042
29285992323,0cyclictest0-21swapper/211:32:482
29285992323,0cyclictest0-21swapper/210:55:282
29285992323,0cyclictest0-21swapper/210:31:142
29285992323,0cyclictest0-21swapper/210:15:152
29285992323,0cyclictest0-21swapper/209:52:222
29285992323,0cyclictest0-21swapper/209:30:232
29285992322,1cyclictest4780-21ssh11:45:392
29285992322,1cyclictest0-21swapper/210:51:362
29285992321,2cyclictest23104-21diskmemload10:13:342
29285992321,1cyclictest10879-21ssh11:51:182
29285992321,1cyclictest0-21swapper/212:37:342
29285992321,1cyclictest0-21swapper/212:13:352
29285992321,1cyclictest0-21swapper/210:21:462
2928599230,23cyclictest0-21swapper/212:29:082
2928599230,23cyclictest0-21swapper/211:40:222
2928599230,23cyclictest0-21swapper/211:37:112
2928599230,23cyclictest0-21swapper/210:04:482
2928599230,23cyclictest0-21swapper/209:22:092
2928599230,22cyclictest6095-21tail11:17:062
2928599230,22cyclictest4462-21awk07:25:012
2928599230,22cyclictest17065-21awk12:25:002
2928599230,1cyclictest26045-21hddtemp_smartct11:06:582
2928599230,0cyclictest0-21swapper/212:19:382
2928599230,0cyclictest0-21swapper/212:07:572
2928599230,0cyclictest0-21swapper/210:40:242
2928599230,0cyclictest0-21swapper/209:55:222
29281992323,0cyclictest23104-21diskmemload09:35:401
29281992323,0cyclictest0-21swapper/112:39:451
29281992323,0cyclictest0-21swapper/112:06:501
29281992321,1cyclictest32485-21kworker/1:109:00:011
29281992321,1cyclictest27782-21rm10:39:381
29281992321,1cyclictest25264-21ssh12:03:051
29281992321,1cyclictest22724-21awk12:30:001
29281992321,1cyclictest2131-21runrttasks10:45:471
29281992321,1cyclictest16558-21rm10:01:541
29281992321,1cyclictest0-21swapper/111:42:281
29281992321,1cyclictest0-21swapper/109:50:311
2928199230,23cyclictest0-21swapper/111:48:191
2928199230,23cyclictest0-21swapper/111:12:371
2928199230,22cyclictest8744-21sendmail-msp08:40:001
2928199230,22cyclictest774-21runrttasks11:00:181
2928199230,22cyclictest6324-21idleruntime-cro08:35:001
2928199230,22cyclictest31655-21apt07:15:001
2928199230,22cyclictest26525-21sh10:10:111
2928199230,22cyclictest17079-21sh10:58:291
2928199230,22cyclictest12809-21ssh12:21:351
2928199230,22cyclictest0-21swapper/109:27:541
2928199230,0cyclictest0-21swapper/110:54:241
2928199230,0cyclictest0-21swapper/110:20:401
29280992323,0cyclictest23104-21diskmemload11:40:390
29280992323,0cyclictest11375-21apt-get11:51:540
29280992323,0cyclictest0-21swapper/012:25:160
29280992323,0cyclictest0-21swapper/010:56:310
29280992322,1cyclictest20118-21ssh09:35:540
2928099230,2cyclictest13979-21ssh09:30:160
2928099230,2cyclictest12360-21diskmemload12:20:540
2928099230,2cyclictest11547-21sh10:25:210
2928099230,23cyclictest0-21swapper/012:03:420
2928099230,23cyclictest0-21swapper/011:49:150
2928099230,23cyclictest0-21swapper/009:55:550
2928099230,23cyclictest0-21swapper/009:40:550
2928099230,22cyclictest9470-21ssh11:21:200
2928099230,22cyclictest4109-21sh09:50:180
2928099230,22cyclictest29085-21sh12:35:070
2928099230,22cyclictest25314-21ssh10:08:510
2928099230,22cyclictest23104-21diskmemload12:15:290
2928099230,22cyclictest11141-21apt10:25:000
2928099230,1cyclictest0-21swapper/011:11:100
2928099230,0cyclictest23104-21diskmemload10:41:140
2928099230,0cyclictest0-21swapper/010:46:490
29290992222,0cyclictest0-21swapper/311:26:143
29290992220,1cyclictest32595-21ssh09:17:383
2929099220,21cyclictest12671-21apt-get07:41:543
2929099220,21cyclictest0-21swapper/310:05:033
2929099220,21cyclictest0-21swapper/308:31:543
2929099220,21cyclictest0-21swapper/308:21:543
2929099220,21cyclictest0-21swapper/307:56:553
2929099220,21cyclictest0-21swapper/307:46:573
2929099220,1cyclictest0-21swapper/307:35:013
2929099220,0cyclictest0-21swapper/310:45:193
29285992220,1cyclictest6917-21perf07:30:012
29285992220,1cyclictest19437-21idleruntime-cro07:55:002
29285992220,1cyclictest13923-21apt-get08:51:542
2928599220,21cyclictest8406-21ssh09:25:172
2928599220,21cyclictest25882-21memory09:12:002
2928599220,21cyclictest22937-21ssh10:35:292
2928599220,21cyclictest19666-21rm11:01:422
2928599220,21cyclictest14815-21ssh11:25:572
2928599220,21cyclictest11530-21apt-get08:46:562
2928599220,21cyclictest0-21swapper/209:45:082
2928599220,21cyclictest0-21swapper/209:40:052
2928599220,0cyclictest0-21swapper/209:16:012
29281992222,0cyclictest0-21swapper/111:18:021
29281992221,1cyclictest29141-21ssh09:15:121
29281992221,0cyclictest18736-21apt-get09:01:541
29281992220,1cyclictest6334-21rm12:15:531
29281992220,1cyclictest28915-21sh10:40:491
29281992220,1cyclictest0-21swapper/108:00:001
2928199220,22cyclictest0-21swapper/107:55:001
2928199220,21cyclictest0-21swapper/110:27:311
2928199220,21cyclictest0-21swapper/108:51:541
2928199220,1cyclictest31928-21ssh09:46:341
2928199220,1cyclictest21756-21ssh10:34:121
2928199220,1cyclictest14347-21sh09:30:441
2928199220,1cyclictest13539-21munin-run08:50:001
2928199220,0cyclictest23104-21diskmemload11:56:571
29280992222,0cyclictest0-21swapper/010:11:440
29280992222,0cyclictest0-21swapper/010:00:020
29280992222,0cyclictest0-21swapper/009:26:190
29280992220,1cyclictest0-21swapper/010:50:220
29280992220,1cyclictest0-21swapper/009:10:080
2928099220,21cyclictest23104-21diskmemload10:15:010
2928099220,1cyclictest4915-21apt-get07:26:530
2928099220,1cyclictest12197-21cron07:40:010
2928099220,0cyclictest23104-21diskmemload10:35:060
29290992120,1cyclictest0-21swapper/309:25:023
29290992119,1cyclictest29070-21munin-run08:15:013
2929099210,21cyclictest0-21swapper/307:21:543
2929099210,20cyclictest16320-21apt-get08:56:563
2929099210,20cyclictest0-21swapper/308:51:543
29285992120,1cyclictest29464-21apt-get08:16:542
29285992120,1cyclictest23128-21perf09:10:012
29285992120,1cyclictest0-21swapper/207:35:022
2928599210,0cyclictest0-21swapper/208:36:542
2928199210,0cyclictest0-21swapper/109:06:551
29280992121,0cyclictest0-21swapper/012:30:090
29280992121,0cyclictest0-21swapper/008:45:000
29280992118,2cyclictest9304-21cron07:35:010
2928099210,20cyclictest21130-21apt-get09:06:540
2928099210,20cyclictest0-21swapper/008:36:540
29290992020,0cyclictest0-21swapper/309:01:543
29290992019,0cyclictest9309-21apt-get07:35:023
29290992018,2cyclictest34-21ksoftirqd/309:10:013
29290992018,1cyclictest1670-21munin-run07:20:013
2929099200,19cyclictest0-21swapper/307:26:533
29285992020,0cyclictest0-21swapper/209:01:552
29285992019,1cyclictest0-21swapper/208:11:552
29285992017,2cyclictest1671-21munin-plugin-st07:20:012
2928599200,0cyclictest0-21swapper/208:21:542
29280992020,0cyclictest27061-21apt-get08:11:550
29280992020,0cyclictest0-21swapper/008:46:560
29280992020,0cyclictest0-21swapper/007:21:540
29280992019,1cyclictest12525-21apt-get07:40:490
29280992018,1cyclictest31884-21apt-get08:21:540
2929099190,1cyclictest9327-21tr08:41:543
29285991919,0cyclictest9132-21apt-get08:41:542
29285991919,0cyclictest0-21swapper/208:31:532
29285991919,0cyclictest0-21swapper/207:11:552
29281991919,0cyclictest0-21swapper/107:40:491
29281991919,0cyclictest0-21swapper/107:26:531
29280991918,0cyclictest24666-21apt-get08:06:540
29290991818,0cyclictest0-21swapper/308:01:533
29285991818,0cyclictest0-21swapper/208:56:562
29281991818,0cyclictest0-21swapper/107:46:561
29281991818,0cyclictest0-21swapper/107:21:541
29281991817,0cyclictest0-21swapper/108:41:541
29280991817,0cyclictest0-21swapper/008:01:530
29290991717,0cyclictest0-21swapper/308:06:543
29290991717,0cyclictest0-21swapper/307:51:553
29290991717,0cyclictest0-21swapper/307:11:563
29285991717,0cyclictest0-21swapper/208:26:542
29285991716,0cyclictest0-21swapper/207:46:572
29281991716,0cyclictest0-21swapper/107:16:551
29280991717,0cyclictest0-21swapper/008:16:540
29280991715,1cyclictest0-21swapper/008:30:000
2929099160,7cyclictest0-21swapper/308:16:543
2928599160,15cyclictest24413-21munin-run08:05:012
29281991616,0cyclictest0-21swapper/108:11:551
2928199160,15cyclictest1466-21awk08:25:011
29280991616,0cyclictest0-21swapper/008:56:560
29280991614,1cyclictest0-21swapper/007:11:570
2928099160,15cyclictest21869-21perf08:00:000
2928099160,15cyclictest20746-21perf09:05:010
2928099160,15cyclictest15684-21gltestperf07:46:590
2928099160,15cyclictest0-21swapper/008:35:000
2928599150,14cyclictest13721-21ntp_states07:42:002
2928099150,1cyclictest14725-21irqstats08:51:580
29290991414,0cyclictest0-21swapper/308:46:543
2929099140,14cyclictest0-21swapper/308:25:013
2928599140,14cyclictest0-21swapper/208:05:402
2928599140,14cyclictest0-21swapper/207:55:482
2928199140,14cyclictest0-21swapper/108:02:021
2928199140,14cyclictest0-21swapper/107:31:531
2928199140,0cyclictest0-21swapper/108:19:541
2928199140,0cyclictest0-21swapper/108:07:341
2928099140,14cyclictest0-21swapper/007:50:400
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional