You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 21:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Mar 12, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2721599260,25cyclictest32380-21idleruntime-cro07:20:013
2721599250,24cyclictest20538-21diskmemload10:11:243
2721599250,24cyclictest0-21swapper/309:41:203
2721099250,24cyclictest20538-21diskmemload11:00:572
2721099250,22cyclictest17586-21rm10:07:402
2720899250,24cyclictest16100-21sh11:07:451
2720699250,24cyclictest20538-21diskmemload10:37:540
27215992422,1cyclictest0-21swapper/308:55:013
2721599240,23cyclictest20538-21diskmemload09:48:473
2721599240,23cyclictest10100-21apt-get07:41:473
2721599240,23cyclictest0-21swapper/311:36:543
2721599240,1cyclictest20538-21diskmemload11:52:443
27210992421,2cyclictest3197-21ssh09:54:372
27210992419,5cyclictest19616-21ssh10:40:562
2721099240,23cyclictest20538-21diskmemload12:26:062
2721099240,23cyclictest20538-21diskmemload10:11:522
2721099240,23cyclictest13737-21apt-get11:06:482
2721099240,23cyclictest13594-21ntp_states11:36:532
2721099240,23cyclictest10089-21wc12:05:012
2721099240,23cyclictest0-21swapper/211:16:052
2721099240,23cyclictest0-21swapper/209:43:372
2721099240,23cyclictest0-21swapper/209:31:562
2721099240,1cyclictest0-21swapper/210:31:532
2721099240,0cyclictest20538-21diskmemload11:20:112
27208992422,2cyclictest18439-21ssh10:09:061
2720899240,23cyclictest31745-21ssh09:51:211
2720899240,23cyclictest24292-21sh10:45:131
2720899240,23cyclictest0-21swapper/111:25:291
2720899240,0cyclictest0-21swapper/109:32:491
27206992424,0cyclictest20538-21diskmemload10:49:020
27206992421,2cyclictest6122-21rm10:27:140
27206992421,2cyclictest20538-21diskmemload10:22:390
27206992421,2cyclictest11407-21ssh10:32:180
2720699240,23cyclictest20538-21diskmemload12:15:300
2720699240,23cyclictest20538-21diskmemload11:57:250
2720699240,23cyclictest20538-21diskmemload10:50:310
2720699240,23cyclictest20538-21diskmemload09:26:400
2720699240,0cyclictest20538-21diskmemload11:26:370
27215992323,0cyclictest0-21swapper/312:25:563
27215992323,0cyclictest0-21swapper/312:10:133
27215992323,0cyclictest0-21swapper/312:05:343
27215992323,0cyclictest0-21swapper/311:21:133
27215992323,0cyclictest0-21swapper/311:13:283
27215992323,0cyclictest0-21swapper/311:08:533
27215992323,0cyclictest0-21swapper/310:40:183
27215992323,0cyclictest0-21swapper/309:22:073
27215992321,1cyclictest20538-21diskmemload09:16:333
27215992321,1cyclictest0-21swapper/311:56:323
27215992321,1cyclictest0-21swapper/311:46:053
27215992321,1cyclictest0-21swapper/311:16:013
27215992320,0cyclictest151rcu_preempt09:33:553
2721599230,23cyclictest20538-21diskmemload10:46:443
2721599230,23cyclictest0-21swapper/310:08:183
2721599230,23cyclictest0-21swapper/309:26:073
2721599230,22cyclictest29532-21dump-pmu-power10:20:013
2721599230,22cyclictest20538-21diskmemload11:40:143
2721599230,22cyclictest20538-21diskmemload09:37:293
2721599230,22cyclictest13505-21ssh10:35:103
2721599230,22cyclictest0-21swapper/312:00:303
2721599230,22cyclictest0-21swapper/310:57:043
2721599230,22cyclictest0-21swapper/310:50:183
2721599230,22cyclictest0-21swapper/310:30:113
2721599230,22cyclictest0-21swapper/310:25:553
2721599230,1cyclictest0-21swapper/311:04:373
2721599230,1cyclictest0-21swapper/308:01:483
2721599230,0cyclictest0-21swapper/312:21:533
2721599230,0cyclictest0-21swapper/311:33:433
27210992323,0cyclictest20538-21diskmemload11:50:252
27210992323,0cyclictest0-21swapper/210:27:402
27210992323,0cyclictest0-21swapper/210:15:552
27210992322,1cyclictest29341-21ssh12:22:382
27210992322,1cyclictest26740-21ssh09:15:362
27210992321,1cyclictest11912-21kworker/u8:111:56:492
27210992321,1cyclictest0-21swapper/209:12:172
27210992320,3cyclictest0-21swapper/211:25:012
27210992320,2cyclictest32402-21perf07:20:012
2721099230,23cyclictest0-21swapper/212:34:052
2721099230,23cyclictest0-21swapper/212:15:212
2721099230,23cyclictest0-21swapper/210:24:272
2721099230,22cyclictest20538-21diskmemload11:41:102
2721099230,22cyclictest0-21swapper/209:45:042
2721099230,22cyclictest0-21swapper/209:35:382
2721099230,0cyclictest20538-21diskmemload10:01:132
2721099230,0cyclictest0-21swapper/211:45:192
2721099230,0cyclictest0-21swapper/210:37:412
2721099230,0cyclictest0-21swapper/209:56:162
27208992323,0cyclictest20538-21diskmemload09:11:161
27208992323,0cyclictest0-21swapper/112:20:311
27208992323,0cyclictest0-21swapper/111:00:091
27208992323,0cyclictest0-21swapper/110:26:191
27208992321,1cyclictest0-21swapper/110:40:021
27208992320,2cyclictest31274-21ssh11:22:081
2720899230,23cyclictest16944-21ssh11:40:341
2720899230,23cyclictest0-21swapper/111:46:081
2720899230,23cyclictest0-21swapper/111:38:471
2720899230,23cyclictest0-21swapper/111:30:411
2720899230,23cyclictest0-21swapper/109:25:561
2720899230,22cyclictest32469-21ssh10:52:141
2720899230,22cyclictest30252-21ssh09:18:171
2720899230,22cyclictest20958-21sh09:41:261
2720899230,22cyclictest20538-21diskmemload09:48:341
2720899230,22cyclictest12079-21/usr/sbin/munin12:06:511
2720899230,22cyclictest0-21swapper/110:58:091
2720899230,22cyclictest0-21swapper/110:20:021
2720899230,1cyclictest0-21swapper/110:16:021
2720899230,0cyclictest20538-21diskmemload11:50:221
2720899230,0cyclictest0-21swapper/111:56:181
2720899230,0cyclictest0-21swapper/109:21:241
27206992323,0cyclictest20538-21diskmemload11:35:060
27206992323,0cyclictest20538-21diskmemload11:15:280
27206992323,0cyclictest0-21swapper/012:28:140
27206992323,0cyclictest0-21swapper/011:46:290
27206992323,0cyclictest0-21swapper/009:48:330
27206992323,0cyclictest0-21swapper/009:32:160
27206992322,1cyclictest62550irq/127-eno112:12:110
27206992321,1cyclictest0-21swapper/012:35:020
27206992320,2cyclictest783-21snmpd12:05:530
27206992320,2cyclictest27292-21ssh11:50:230
27206992320,1cyclictest8693-21sh10:00:000
2720699230,2cyclictest5118-21sh10:57:320
2720699230,2cyclictest19357-21sh09:39:200
2720699230,23cyclictest0-21swapper/011:02:130
2720699230,23cyclictest0-21swapper/010:42:290
2720699230,22cyclictest6433-21sh11:30:260
2720699230,22cyclictest2391-21perf07:25:000
2720699230,22cyclictest16727-21sh11:08:510
2720699230,22cyclictest0-21swapper/011:22:530
2720699230,22cyclictest0-21swapper/009:17:330
2720699230,1cyclictest0-21swapper/010:16:260
2720699230,0cyclictest20538-21diskmemload10:10:320
2720699230,0cyclictest0-21swapper/010:06:310
2720699230,0cyclictest0-21swapper/008:16:490
27215992221,1cyclictest20538-21diskmemload12:15:073
27215992220,1cyclictest0-21swapper/312:31:513
2721599220,21cyclictest29535-21apt-get10:20:023
2721599220,21cyclictest20538-21diskmemload09:50:523
2721599220,21cyclictest0-21swapper/311:25:223
2721599220,21cyclictest0-21swapper/310:00:533
2721599220,21cyclictest0-21swapper/307:35:003
2721599220,1cyclictest15776-21sendmail-msp09:00:013
2721599220,1cyclictest0-21swapper/312:36:483
2721599220,1cyclictest0-21swapper/309:56:583
27210992222,0cyclictest0-21swapper/212:07:222
27210992222,0cyclictest0-21swapper/209:25:052
27210992221,1cyclictest0-21swapper/212:35:552
27210992220,1cyclictest2399-21ssh10:56:052
27210992220,1cyclictest13745-21apt-get08:56:482
27210992220,1cyclictest0-21swapper/207:30:002
2721099220,21cyclictest7683-21apt-get07:36:482
2721099220,21cyclictest29441-21ssh10:50:022
2721099220,21cyclictest29307-21apt-get08:21:462
2721099220,21cyclictest20538-21diskmemload10:45:052
2721099220,21cyclictest15665-21ssh12:10:172
2721099220,1cyclictest32483-21ssh09:21:162
2721099220,1cyclictest22011-21ssh11:13:532
27208992222,0cyclictest0-21swapper/112:10:481
27208992222,0cyclictest0-21swapper/110:33:091
27208992221,1cyclictest5916-21ssh09:56:531
27208992220,1cyclictest14889-21apt-get07:51:481
27208992220,1cyclictest0-21swapper/110:36:331
27208992220,1cyclictest0-21swapper/110:11:541
2720899220,22cyclictest20538-21diskmemload12:27:421
2720899220,21cyclictest20571-21munin-run09:10:001
2720899220,21cyclictest20538-21diskmemload12:35:401
2720899220,21cyclictest20538-21diskmemload12:15:151
2720899220,21cyclictest20538-21diskmemload10:00:091
2720899220,1cyclictest5628-21sh12:00:511
2720899220,1cyclictest19360-21/usr/sbin/munin11:11:511
2720899220,0cyclictest0-21swapper/112:31:071
27206992222,0cyclictest0-21swapper/011:14:490
27206992220,1cyclictest20646-21ssh09:40:500
27206992220,1cyclictest20538-21diskmemload12:00:050
27206992220,1cyclictest16165-21apt-get09:01:490
27206992220,1cyclictest15729-21sendmail09:00:010
27206992220,1cyclictest0-21swapper/011:40:270
27206992220,1cyclictest0-21swapper/008:15:000
2720699220,22cyclictest0-21swapper/009:10:130
2720699220,21cyclictest32398-21cat07:20:010
2720699220,21cyclictest31785-21ssh09:20:180
2720699220,21cyclictest26156-21ssh12:20:220
2720699220,21cyclictest24110-21munin-plugin-st08:10:010
2720699220,21cyclictest13110-21ssh10:03:500
2720699220,21cyclictest0-21swapper/009:50:320
2720699220,1cyclictest0-21swapper/012:30:140
27215992120,1cyclictest0-21swapper/307:55:013
27215992120,0cyclictest0-21swapper/309:01:493
27215992119,1cyclictest313-21systemd-journal08:00:013
2721599210,20cyclictest21356-21sh09:11:003
2721599210,1cyclictest26884-21apt-get08:16:493
27210992120,1cyclictest5184-21apt-get07:31:472
2721099210,21cyclictest0-21swapper/211:30:332
2721099210,20cyclictest0-21swapper/208:36:502
2721099210,0cyclictest31705-21apt-get08:26:482
27208992121,0cyclictest20538-21diskmemload09:35:181
27208992120,0cyclictest19701-21apt-get08:01:481
27206992121,0cyclictest0-21swapper/007:26:470
27206992120,1cyclictest0-21swapper/007:31:480
2720699210,21cyclictest0-21swapper/007:41:480
27215992020,0cyclictest0-21swapper/307:21:473
27215992020,0cyclictest0-21swapper/307:11:473
2721599200,20cyclictest0-21swapper/308:21:463
27210992020,0cyclictest0-21swapper/208:16:492
27210992020,0cyclictest0-21swapper/207:51:482
27208992017,2cyclictest13367-21munin-run08:55:011
27206992020,0cyclictest0-21swapper/008:01:480
27206992018,1cyclictest0-21swapper/008:35:000
27215991918,1cyclictest24489-21apt-get08:11:473
27210991919,0cyclictest0-21swapper/207:46:482
27210991919,0cyclictest0-21swapper/207:41:472
27210991918,1cyclictest6561-21apt-get08:41:482
27210991918,1cyclictest6561-21apt-get08:41:482
2721099190,17cyclictest313-21systemd-journal08:50:012
27208991919,0cyclictest0-21swapper/108:31:481
27208991919,0cyclictest0-21swapper/107:36:481
27208991919,0cyclictest0-21swapper/107:31:481
27208991919,0cyclictest0-21swapper/107:16:491
27208991918,1cyclictest0-21swapper/107:11:481
27208991917,1cyclictest0-21swapper/107:30:001
2720899190,0cyclictest0-21swapper/108:11:471
27210991817,0cyclictest27933-21apt-get07:11:482
27210991815,2cyclictest345-21systemd-udevd07:24:492
27208991818,0cyclictest0-21swapper/109:01:491
27208991818,0cyclictest0-21swapper/108:21:461
27208991818,0cyclictest0-21swapper/108:16:491
27208991818,0cyclictest0-21swapper/107:21:471
27208991816,1cyclictest19268-21sendmail08:00:011
2720899180,0cyclictest0-21swapper/108:36:501
27206991818,0cyclictest0-21swapper/007:11:480
27215991717,0cyclictest0-21swapper/309:06:473
27215991717,0cyclictest0-21swapper/308:31:483
2721099170,15cyclictest313-21systemd-journal08:10:012
27208991717,0cyclictest0-21swapper/108:56:471
27208991715,1cyclictest12118-21munin-run07:45:001
27206991717,0cyclictest0-21swapper/008:26:480
27206991717,0cyclictest0-21swapper/007:46:480
27215991616,0cyclictest0-21swapper/307:36:483
27210991614,1cyclictest18146-21sh09:05:002
27210991613,2cyclictest20555-21perf09:10:002
27208991616,0cyclictest12494-21apt-get07:46:481
27208991616,0cyclictest0-21swapper/108:26:481
27206991615,0cyclictest0-21swapper/008:46:490
27206991614,1cyclictest6160-21sendmail-msp08:40:010
27206991614,1cyclictest16900-21awk07:55:010
27206991614,1cyclictest0-21swapper/008:41:520
27206991614,1cyclictest0-21swapper/008:41:520
27215991515,0cyclictest0-21swapper/308:46:493
2721599150,1cyclictest6410-21sendmail-mta08:40:163
2721599150,1cyclictest6410-21sendmail-mta08:40:163
2721099152,13cyclictest610-21wpa_supplicant08:12:472
27210991515,0cyclictest0-21swapper/208:51:482
27210991515,0cyclictest0-21swapper/207:56:482
27210991513,1cyclictest0-21swapper/208:01:562
27208991513,1cyclictest8578-21munin-run08:45:011
27208991513,1cyclictest8578-21munin-run08:45:011
27206991514,0cyclictest17286-21apt-get07:56:480
27215991414,0cyclictest0-21swapper/308:35:023
2721599140,14cyclictest0-21swapper/308:05:423
2721599140,14cyclictest0-21swapper/307:25:253
2721599140,0cyclictest0-21swapper/308:26:083
2721599140,0cyclictest0-21swapper/307:45:223
2721099140,0cyclictest0-21swapper/208:30:472
27208991414,0cyclictest0-21swapper/108:05:231
2720899140,0cyclictest0-21swapper/108:45:221
27206991414,0cyclictest0-21swapper/008:50:120
27206991414,0cyclictest0-21swapper/008:20:560
2720699140,14cyclictest0-21swapper/009:05:010
2720699140,0cyclictest0-21swapper/007:35:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional