You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 16:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 10, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32586992725,1cyclictest0-21swapper/310:31:453
3258699250,24cyclictest13010-21ssh12:19:483
32576992525,0cyclictest0-21swapper/107:51:491
32576992523,1cyclictest0-21swapper/109:11:241
32576992522,2cyclictest24702-21sendmail-msp08:00:001
3257699250,24cyclictest0-21swapper/110:01:411
3257699250,24cyclictest0-21swapper/109:18:581
32573992523,1cyclictest26319-21diskmemload12:38:160
32573992523,1cyclictest0-21swapper/009:31:290
32573992523,1cyclictest0-21swapper/009:27:530
3257399250,24cyclictest9086-21awk11:46:580
3257399250,24cyclictest26319-21diskmemload11:21:380
3257399250,24cyclictest0-21swapper/010:58:200
32586992422,1cyclictest19089-21ssh10:57:483
32586992422,1cyclictest0-21swapper/307:55:003
3258699240,23cyclictest9467-21cron10:50:003
3258699240,23cyclictest26319-21diskmemload09:32:423
3258699240,23cyclictest0-21swapper/312:09:303
3258699240,23cyclictest0-21swapper/311:55:193
3258699240,1cyclictest26319-21diskmemload09:17:233
32581992422,1cyclictest5914-21ssh09:20:072
32581992422,1cyclictest0-21swapper/210:41:582
3258199241,22cyclictest0-21swapper/211:06:232
3258199240,24cyclictest0-21swapper/210:08:202
3258199240,23cyclictest16282-21sh09:57:452
3258199240,23cyclictest0-21swapper/210:55:422
3258199240,23cyclictest0-21swapper/209:34:292
3258199240,1cyclictest0-21swapper/211:41:312
3258199240,1cyclictest0-21swapper/211:31:592
32576992424,0cyclictest0-21swapper/111:49:371
32576992423,0cyclictest26319-21diskmemload09:45:441
3257699241,1cyclictest0-21swapper/109:51:501
3257699240,24cyclictest0-21swapper/112:37:221
3257699240,23cyclictest3157-21ssh10:15:541
3257699240,1cyclictest28758-21apt-get11:36:491
3257699240,1cyclictest17209-21ssh09:59:021
3257699240,0cyclictest26319-21diskmemload11:22:521
32573992423,1cyclictest7227-21ssh09:50:260
32573992421,2cyclictest29400-21ssh12:33:590
3257399241,22cyclictest606-21dbus-daemon10:10:000
3257399241,22cyclictest30900-21sh09:41:570
3257399241,22cyclictest30900-21sh09:41:570
3257399240,2cyclictest26823-21ssh09:10:200
3257399240,23cyclictest26319-21diskmemload09:59:280
3257399240,23cyclictest0-21swapper/010:42:250
3257399240,22cyclictest24385-21cut11:31:560
3257399240,1cyclictest4295-21ssh10:45:160
3257399240,1cyclictest16840-21sh11:25:510
32586992323,0cyclictest26319-21diskmemload11:40:243
32586992323,0cyclictest11398-21ssh10:22:103
32586992323,0cyclictest0-21swapper/311:04:323
32586992323,0cyclictest0-21swapper/310:38:103
32586992323,0cyclictest0-21swapper/310:27:483
32586992323,0cyclictest0-21swapper/310:02:173
32586992322,1cyclictest0-21swapper/309:38:413
32586992320,2cyclictest26319-21diskmemload12:31:543
32586992320,2cyclictest14004-21ssh12:20:433
3258699230,23cyclictest0-21swapper/312:02:013
3258699230,23cyclictest0-21swapper/311:26:563
3258699230,23cyclictest0-21swapper/309:53:353
3258699230,23cyclictest0-21swapper/309:28:273
3258699230,22cyclictest6756-21sh10:18:263
3258699230,22cyclictest5254-21ssh11:15:043
3258699230,22cyclictest389-21perf11:40:003
3258699230,22cyclictest3881-21ssh11:13:303
3258699230,22cyclictest26701-21ssh11:05:203
3258699230,22cyclictest26319-21diskmemload10:12:373
3258699230,22cyclictest26319-21diskmemload09:56:413
3258699230,1cyclictest4764-21sh09:47:213
3258699230,1cyclictest0-21swapper/312:25:363
3258699230,0cyclictest0-21swapper/311:32:443
3258699230,0cyclictest0-21swapper/310:51:223
3258699230,0cyclictest0-21swapper/310:05:023
32581992323,0cyclictest0-21swapper/210:47:302
32581992323,0cyclictest0-21swapper/209:53:482
32581992322,1cyclictest0-21swapper/212:11:582
32581992321,1cyclictest622-21gdbus08:20:012
32581992321,1cyclictest0-21swapper/212:21:472
32581992321,1cyclictest0-21swapper/211:36:592
32581992320,2cyclictest31893-21munin-plugin-st08:15:012
32581992320,2cyclictest18121-21ssh10:28:452
32581992320,2cyclictest13659-21ssh10:53:032
3258199231,21cyclictest4933-21perf07:20:002
3258199231,21cyclictest0-21swapper/212:31:502
3258199230,2cyclictest22496-21ssh09:35:012
3258199230,23cyclictest26319-21diskmemload09:12:532
3258199230,23cyclictest0-21swapper/212:00:352
3258199230,23cyclictest0-21swapper/211:59:102
3258199230,22cyclictest26319-21diskmemload12:36:242
3258199230,22cyclictest25574-21ssh11:04:022
3258199230,22cyclictest2501-21awk07:15:002
3258199230,22cyclictest0-21swapper/209:45:272
3258199230,1cyclictest0-21swapper/212:05:012
3258199230,0cyclictest0-21swapper/210:03:332
3258199230,0cyclictest0-21swapper/209:16:242
32576992323,0cyclictest0-21swapper/111:55:101
32576992323,0cyclictest0-21swapper/111:32:031
32576992323,0cyclictest0-21swapper/111:16:521
32576992321,1cyclictest0-21swapper/112:30:381
32576992321,1cyclictest0-21swapper/111:05:001
32576992321,1cyclictest0-21swapper/110:26:481
32576992321,1cyclictest0-21swapper/110:10:271
3257699230,23cyclictest21247-21sh09:33:381
3257699230,23cyclictest0-21swapper/112:17:331
3257699230,23cyclictest0-21swapper/110:46:241
3257699230,23cyclictest0-21swapper/110:36:211
3257699230,22cyclictest8810-21sh10:20:581
3257699230,22cyclictest783-21snmpd10:05:061
3257699230,22cyclictest31704-21ssh10:41:081
3257699230,22cyclictest26319-21diskmemload11:05:141
3257699230,22cyclictest21340-21sh11:29:401
3257699230,22cyclictest10690-21sh10:51:241
3257699230,1cyclictest0-21swapper/112:28:451
3257699230,0cyclictest0-21swapper/112:21:531
3257699230,0cyclictest0-21swapper/111:50:541
3257699230,0cyclictest0-21swapper/111:41:041
3257699230,0cyclictest0-21swapper/110:30:061
3257699230,0cyclictest0-21swapper/109:35:231
32573992323,0cyclictest26319-21diskmemload09:16:200
32573992323,0cyclictest0-21swapper/012:12:510
32573992323,0cyclictest0-21swapper/011:17:230
32573992323,0cyclictest0-21swapper/011:13:100
32573992323,0cyclictest0-21swapper/010:32:060
32573992323,0cyclictest0-21swapper/010:21:000
32573992321,1cyclictest10140-21sh10:50:430
32573992321,1cyclictest0-21swapper/008:30:000
3257399230,22cyclictest7954-21grep10:20:000
3257399230,22cyclictest4300-21munin-run08:25:010
3257399230,22cyclictest26324-21ssh09:10:010
3257399230,22cyclictest26319-21diskmemload10:10:510
3257399230,22cyclictest20880-21ssh11:00:070
3257399230,22cyclictest17207-21perf11:55:000
3257399230,22cyclictest1113-21ssh12:08:480
3257399230,22cyclictest0-21swapper/009:47:020
3257399230,1cyclictest0-21swapper/012:28:230
3257399230,0cyclictest26319-21diskmemload10:37:400
3257399230,0cyclictest0-21swapper/011:36:260
3257399230,0cyclictest0-21swapper/009:35:210
32586992222,0cyclictest26319-21diskmemload09:10:303
32586992222,0cyclictest0-21swapper/312:11:563
32586992221,1cyclictest9816-21ssh11:47:343
32586992221,1cyclictest11836-21ssh11:21:303
32586992220,1cyclictest29499-21munin-run08:10:013
32586992220,1cyclictest0-21swapper/308:35:003
3258699220,2cyclictest6360-21ssh09:20:493
3258699220,21cyclictest0-21swapper/311:50:293
3258699220,21cyclictest0-21swapper/308:36:493
3258699220,1cyclictest31408-21ssh12:36:323
3258699220,1cyclictest29477-21apt-get09:41:493
3258699220,1cyclictest29477-21apt-get09:41:493
3258699220,1cyclictest12916-21apt-get07:36:493
32581992222,0cyclictest0-21swapper/212:19:002
32581992222,0cyclictest0-21swapper/211:20:532
32581992222,0cyclictest0-21swapper/211:10:562
32581992222,0cyclictest0-21swapper/210:35:402
32581992220,1cyclictest0-21swapper/211:53:062
32581992220,1cyclictest0-21swapper/207:30:012
3258199220,2cyclictest11269-21ssh10:22:002
3258199220,22cyclictest0-21swapper/210:16:382
3258199220,21cyclictest29441-21ssh10:10:042
3258199220,21cyclictest27486-21apt-get08:06:502
3258199220,21cyclictest0-21swapper/211:25:402
3258199220,21cyclictest0-21swapper/210:31:542
3258199220,21cyclictest0-21swapper/209:25:232
3258199220,21cyclictest0-21swapper/207:36:492
3258199220,1cyclictest0-21swapper/212:25:212
3258199220,1cyclictest0-21swapper/211:17:512
3258199220,0cyclictest0-21swapper/211:46:112
32576992222,0cyclictest0-21swapper/109:41:301
32576992222,0cyclictest0-21swapper/109:41:301
32576992222,0cyclictest0-21swapper/109:25:261
32576992222,0cyclictest0-21swapper/109:20:261
32576992221,0cyclictest4685-21apt-get08:26:511
32576992221,0cyclictest15439-21apt-get07:41:491
32576992220,2cyclictest19481-21apt-get08:56:501
32576992220,1cyclictest0-21swapper/110:55:371
3257699220,21cyclictest9713-21cron07:30:011
3257699220,21cyclictest23783-21sh12:00:241
3257699220,21cyclictest0-21swapper/112:10:441
3257699220,1cyclictest5330-21apt-get07:21:501
3257699220,1cyclictest11468-21apt08:40:001
32573992222,0cyclictest0-21swapper/009:24:500
32573992220,1cyclictest26829-21sh11:05:300
3257399220,22cyclictest62550irq/127-eno111:56:010
3257399220,21cyclictest13538-21ssh12:20:080
3257399220,21cyclictest0-21swapper/012:01:510
3257399220,21cyclictest0-21swapper/010:25:350
3257399220,21cyclictest0-21swapper/007:35:020
3257399220,1cyclictest0-21swapper/011:40:590
3257399220,0cyclictest0-21swapper/010:02:570
3258699210,1cyclictest26350-21perf09:10:013
32581992120,1cyclictest24342-21apt-get09:06:492
32581992119,1cyclictest10125-21apt-get07:31:512
3258199210,1cyclictest7084-21apt-get08:31:512
32576992121,0cyclictest0-21swapper/108:31:511
32576992121,0cyclictest0-21swapper/108:01:491
32576992120,0cyclictest0-21swapper/107:36:491
32576992119,1cyclictest16694-21latency_hist08:50:001
3257699210,20cyclictest606-21dbus-daemon07:50:001
3257699210,0cyclictest0-21swapper/107:11:491
32573992121,0cyclictest0-21swapper/008:11:520
3257399210,0cyclictest0-21swapper/008:01:490
32586992020,0cyclictest0-21swapper/307:56:503
3258699200,0cyclictest0-21swapper/308:21:503
32581992020,0cyclictest0-21swapper/207:41:492
3258199200,20cyclictest0-21swapper/208:46:492
3258199200,0cyclictest22622-21apt-get07:56:502
3258199200,0cyclictest0-21swapper/209:01:502
3258199200,0cyclictest0-21swapper/208:41:502
32576992019,1cyclictest12292-21apt-get08:41:491
32576992018,1cyclictest4286-21wc08:25:011
32573992020,0cyclictest0-21swapper/008:40:020
32573992018,1cyclictest11485-21basename08:40:000
32573992018,1cyclictest0-21swapper/008:00:000
3257399200,0cyclictest0-21swapper/007:41:500
32586991919,0cyclictest7728-21apt-get07:26:513
32586991919,0cyclictest0-21swapper/307:16:493
32581991919,0cyclictest0-21swapper/208:56:502
32581991919,0cyclictest0-21swapper/207:51:492
32576991919,0cyclictest0-21swapper/109:06:491
32576991919,0cyclictest0-21swapper/108:16:501
32576991919,0cyclictest0-21swapper/108:06:501
32576991918,1cyclictest2910-21apt-get07:16:491
32573991919,0cyclictest0-21swapper/008:51:490
32573991919,0cyclictest0-21swapper/007:11:490
32586991818,0cyclictest0-21swapper/308:51:493
32586991818,0cyclictest0-21swapper/308:16:503
32586991818,0cyclictest0-21swapper/307:31:513
3258699180,17cyclictest0-21swapper/308:26:513
32573991816,1cyclictest606-21dbus-daemon07:20:000
32586991717,0cyclictest0-21swapper/307:41:493
32586991715,1cyclictest313-21systemd-journal07:50:003
3258699170,16cyclictest29881-21apt-get08:11:513
32573991717,0cyclictest0-21swapper/008:16:500
32573991715,1cyclictest0-21swapper/007:35:010
32586991616,0cyclictest0-21swapper/308:46:503
32586991616,0cyclictest0-21swapper/307:21:503
32586991616,0cyclictest0-21swapper/307:11:493
32581991616,0cyclictest0-21swapper/208:26:512
32581991614,1cyclictest0-21swapper/208:40:002
32573991616,0cyclictest0-21swapper/008:46:490
32586991514,1cyclictest0-21swapper/308:56:503
32581991515,0cyclictest0-21swapper/208:51:492
32581991515,0cyclictest0-21swapper/207:21:502
32581991514,1cyclictest27093-21dump-pmu-power08:05:002
32576991515,0cyclictest0-21swapper/107:31:511
32576991514,1cyclictest17083-21apt-get08:51:491
32573991513,1cyclictest20226-21apt-get07:51:490
32586991414,0cyclictest0-21swapper/308:40:023
3258699140,14cyclictest0-21swapper/309:00:343
3258699140,14cyclictest0-21swapper/308:01:263
32581991414,0cyclictest0-21swapper/208:20:212
3257699140,14cyclictest0-21swapper/108:10:471
32573991412,1cyclictest7596-21chrt07:25:320
3257399140,14cyclictest0-21swapper/009:00:050
3257399140,0cyclictest0-21swapper/008:55:500
3257399140,0cyclictest0-21swapper/008:05:210
3257399140,0cyclictest0-21swapper/007:45:530
3257399140,0cyclictest0-21swapper/007:22:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional