You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 00:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Aug 27, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19785992523,1cyclictest16792-21apt-get11:05:462
1978599250,24cyclictest8101-21irqstats11:25:512
1978599250,24cyclictest14365-21diskmemload12:27:402
1978599250,24cyclictest14365-21diskmemload10:08:152
1978599250,24cyclictest14365-21diskmemload09:24:582
1978599250,1cyclictest0-21swapper/211:36:062
1977699253,1cyclictest62550irq/127-eno112:28:160
19776992523,1cyclictest0-21swapper/011:06:550
1979099240,24cyclictest0-21swapper/311:45:513
1979099240,23cyclictest14365-21diskmemload12:17:573
1979099240,23cyclictest14365-21diskmemload09:23:033
1978599240,24cyclictest12445-21ssh10:32:192
1978599240,24cyclictest0-21swapper/209:47:182
1978599240,23cyclictest0-21swapper/209:30:372
19782992424,0cyclictest0-21swapper/110:49:141
1978299240,2cyclictest313-21systemd-journal11:45:001
1978299240,24cyclictest0-21swapper/110:52:521
1978299240,23cyclictest32507-21sh09:25:191
1978299240,23cyclictest28309-21sh10:17:411
1978299240,23cyclictest0-21swapper/111:32:551
1978299240,23cyclictest0-21swapper/110:25:371
19776992423,1cyclictest14365-21diskmemload10:33:170
1977699240,24cyclictest62550irq/127-eno111:34:570
1977699240,24cyclictest0-21swapper/009:49:510
1977699240,23cyclictest15655-21ssh12:00:540
1977699240,23cyclictest14365-21diskmemload11:41:380
1977699240,23cyclictest0-21swapper/010:15:380
1977699240,23cyclictest0-21swapper/010:07:390
1977699240,1cyclictest21393-21ssh11:37:270
19790992323,0cyclictest14365-21diskmemload10:58:083
19790992323,0cyclictest14365-21diskmemload09:42:003
19790992323,0cyclictest0-21swapper/312:34:293
19790992323,0cyclictest0-21swapper/312:12:043
19790992321,1cyclictest0-21swapper/311:05:273
1979099231,1cyclictest27910-21apt-get11:15:473
1979099230,23cyclictest19943-21ssh12:05:383
1979099230,23cyclictest14365-21diskmemload11:35:243
1979099230,23cyclictest14365-21diskmemload10:11:193
1979099230,22cyclictest19706-21sh10:39:313
1979099230,22cyclictest11932-21ssh10:04:333
1979099230,1cyclictest14365-21diskmemload11:25:193
1979099230,1cyclictest14365-21diskmemload10:07:413
1979099230,0cyclictest0-21swapper/312:21:343
1979099230,0cyclictest0-21swapper/311:41:323
1979099230,0cyclictest0-21swapper/311:02:253
19785992323,0cyclictest14365-21diskmemload10:02:022
19785992323,0cyclictest0-21swapper/212:10:232
19785992323,0cyclictest0-21swapper/210:50:162
19785992323,0cyclictest0-21swapper/209:57:452
19785992323,0cyclictest0-21swapper/209:18:152
19785992323,0cyclictest0-21swapper/209:13:592
19785992322,1cyclictest11061-1kworker/u9:212:22:472
19785992321,1cyclictest0-21swapper/210:21:152
19785992320,2cyclictest27639-21ssh11:15:202
19785992320,2cyclictest16622-21ssh12:01:162
19785992320,2cyclictest10684-21apt-get11:00:042
1978599231,21cyclictest31306-21apt-get12:15:462
1978599230,2cyclictest16707-21perf08:10:002
1978599230,23cyclictest0-21swapper/210:36:342
1978599230,23cyclictest0-21swapper/209:54:052
1978599230,22cyclictest9974-21ntp_states11:55:532
1978599230,22cyclictest25023-21ssh10:15:382
1978599230,22cyclictest22307-21sh11:10:442
1978599230,22cyclictest19516-21ssh12:05:072
1978599230,22cyclictest1649-21cron07:30:012
1978599230,0cyclictest14365-21diskmemload10:25:032
1978599230,0cyclictest0-21swapper/212:36:042
1978599230,0cyclictest0-21swapper/209:35:322
19782992323,0cyclictest0-21swapper/111:21:141
19782992323,0cyclictest0-21swapper/111:21:141
19782992323,0cyclictest0-21swapper/110:59:561
19782992323,0cyclictest0-21swapper/110:44:561
19782992323,0cyclictest0-21swapper/110:37:111
19782992323,0cyclictest0-21swapper/109:51:211
19782992323,0cyclictest0-21swapper/109:38:311
19782992322,1cyclictest19140-21apt-get10:10:481
19782992321,1cyclictest26418-21munin-run09:20:011
19782992321,1cyclictest12035-21perf11:30:011
19782992321,1cyclictest0-21swapper/112:18:211
19782992321,1cyclictest0-21swapper/109:10:561
19782992320,2cyclictest11364-21sh11:56:461
1978299230,2cyclictest27322-21/usr/sbin/munin09:20:471
1978299230,23cyclictest0-21swapper/111:13:011
1978299230,23cyclictest0-21swapper/108:05:471
1978299230,22cyclictest31932-21ls08:40:001
1978299230,22cyclictest18832-21ssh11:06:111
1978299230,22cyclictest17838-21sh12:02:561
1978299230,22cyclictest15435-21ssh10:06:061
1978299230,22cyclictest0-21swapper/112:36:091
1978299230,22cyclictest0-21swapper/110:00:391
1978299230,22cyclictest0-21swapper/107:15:461
1978299230,0cyclictest0-21swapper/112:20:221
1978299230,0cyclictest0-21swapper/111:35:051
1978299230,0cyclictest0-21swapper/111:01:281
19776992323,0cyclictest0-21swapper/012:30:460
19776992323,0cyclictest0-21swapper/009:15:190
19776992321,1cyclictest9504-21cut11:55:500
19776992321,1cyclictest0-21swapper/011:47:410
19776992320,2cyclictest28897-21ssh10:46:490
19776992320,2cyclictest20686-21cron09:15:010
1977699231,22cyclictest62550irq/127-eno109:31:460
1977699230,23cyclictest0-21swapper/010:42:230
1977699230,22cyclictest8387-21sh10:57:500
1977699230,22cyclictest6762-21ssh12:21:330
1977699230,22cyclictest5714-21ssh11:24:310
1977699230,22cyclictest5714-21ssh11:24:310
1977699230,22cyclictest29965-21ssh11:16:120
1977699230,22cyclictest26144-21diskmemload11:13:370
1977699230,22cyclictest21474-21sh10:11:330
1977699230,22cyclictest14076-21ssh09:36:380
1977699230,22cyclictest0-21swapper/011:25:020
1977699230,22cyclictest0-21swapper/011:01:220
1977699230,22cyclictest0-21swapper/010:22:250
1977699230,22cyclictest0-21swapper/008:40:450
1977699230,1cyclictest14365-21diskmemload12:35:420
1977699230,1cyclictest14365-21diskmemload12:11:380
1977699230,1cyclictest0-21swapper/009:40:370
1977699230,0cyclictest0-21swapper/012:15:100
1977699230,0cyclictest0-21swapper/009:20:330
19790992222,0cyclictest0-21swapper/311:58:513
19790992222,0cyclictest0-21swapper/311:30:373
19790992222,0cyclictest0-21swapper/310:25:343
19790992222,0cyclictest0-21swapper/309:36:153
19790992220,1cyclictest23454-21ssh12:36:233
19790992220,1cyclictest0-21swapper/309:56:103
1979099221,0cyclictest20455-21apt-get07:10:453
1979099220,22cyclictest0-21swapper/312:25:483
1979099220,22cyclictest0-21swapper/309:47:203
1979099220,21cyclictest31543-21hddtemp_smartct10:20:493
1979099220,21cyclictest16488-21ssh09:10:503
1979099220,21cyclictest14365-21diskmemload10:50:273
1979099220,21cyclictest1186-21apt-get11:20:473
1979099220,21cyclictest1186-21apt-get11:20:473
1979099220,21cyclictest0-21swapper/310:15:493
1979099220,1cyclictest25402-21ssh10:44:483
1979099220,1cyclictest12567-21ssh10:32:283
1979099220,0cyclictest0-21swapper/309:15:033
19785992222,0cyclictest0-21swapper/210:40:092
19785992221,1cyclictest28202-21ssh10:45:572
19785992221,1cyclictest0-21swapper/209:40:252
19785992220,2cyclictest19047-21ssh12:33:082
19785992220,1cyclictest30642-21ssh11:45:492
19785992220,1cyclictest18832-21rm10:10:192
19785992220,1cyclictest0-21swapper/211:30:582
19785992220,1cyclictest0-21swapper/209:25:312
1978599220,21cyclictest611-21irqbalance08:50:472
1978599220,21cyclictest0-21swapper/210:55:422
1978599220,1cyclictest14392-21wc09:10:012
1978599220,1cyclictest14311-21wc08:05:002
1978599220,1cyclictest1004-21sh11:20:362
1978599220,1cyclictest1004-21sh11:20:362
1978599220,1cyclictest0-21swapper/211:50:302
19782992221,0cyclictest0-21swapper/109:40:461
19782992220,1cyclictest0-21swapper/112:10:271
1978299220,22cyclictest0-21swapper/111:46:371
1978299220,21cyclictest2887-21ssh11:50:151
1978299220,21cyclictest14365-21diskmemload12:30:171
1978299220,21cyclictest0-21swapper/111:15:271
1978299220,21cyclictest0-21swapper/110:20:291
1978299220,21cyclictest0-21swapper/109:58:411
1978299220,1cyclictest6745-21munin-run08:55:001
1978299220,1cyclictest12466-21sh10:32:201
1978299220,1cyclictest0-21swapper/109:47:001
1978299220,1cyclictest0-21swapper/109:31:101
19776992220,1cyclictest0-21swapper/009:26:140
19776992219,2cyclictest19565-21sh12:05:100
1977699220,21cyclictest7148-21sh10:00:190
1977699220,21cyclictest3031-21ssh11:50:260
1977699220,21cyclictest0-21swapper/010:35:560
1977699220,21cyclictest0-21swapper/009:55:030
1977699220,21cyclictest0-21swapper/008:25:020
1977699220,1cyclictest0-21swapper/010:28:110
1977699220,1cyclictest0-21swapper/009:50:250
1977699220,1cyclictest0-21swapper/008:00:470
19790992120,1cyclictest14466-21ssh12:00:463
19790992120,1cyclictest0-21swapper/308:25:463
19790992119,1cyclictest6754-21perf08:55:003
1979099210,21cyclictest0-21swapper/311:50:533
1979099210,21cyclictest0-21swapper/307:55:473
1979099210,20cyclictest32280-21ssh09:25:023
1979099210,20cyclictest22854-21apt-get07:15:463
1979099210,0cyclictest0-21swapper/310:46:443
1979099210,0cyclictest0-21swapper/309:50:483
19785992121,0cyclictest0-21swapper/207:15:462
19785992119,1cyclictest21529-21sendmail-msp08:20:012
19785992119,1cyclictest11897-21latency_hist08:00:002
1978599210,21cyclictest0-21swapper/211:40:422
1978599210,20cyclictest606-21dbus-daemon07:45:012
1978599210,20cyclictest32616-21apt-get07:35:462
1978599210,20cyclictest27369-21munin-run07:25:002
1978599210,1cyclictest24319-21apt-get08:25:022
19782992121,0cyclictest0-21swapper/107:10:011
1978299210,21cyclictest0-21swapper/108:25:461
1978299210,20cyclictest0-21swapper/107:55:471
19776992119,1cyclictest31926-21sendmail08:40:000
19776992119,1cyclictest0-21swapper/008:20:020
1977699210,20cyclictest0-21swapper/009:00:470
1977699210,0cyclictest0-21swapper/007:45:450
1977699210,0cyclictest0-21swapper/007:40:460
19790992018,1cyclictest622-21gdbus09:00:003
1979099200,0cyclictest29809-21apt-get08:35:463
1979099200,0cyclictest0-21swapper/309:00:473
1979099200,0cyclictest0-21swapper/308:05:473
19785992020,0cyclictest24318-21perf08:25:012
19785992018,1cyclictest9122-21apt-get09:00:022
19782992020,0cyclictest0-21swapper/108:20:021
19782992020,0cyclictest0-21swapper/107:20:471
1978299200,0cyclictest0-21swapper/109:00:021
19776992020,0cyclictest0-21swapper/008:50:460
19776992020,0cyclictest0-21swapper/007:50:470
19776992020,0cyclictest0-21swapper/007:35:460
19776992020,0cyclictest0-21swapper/007:10:010
1977699200,0cyclictest0-21swapper/008:15:440
19790991919,0cyclictest0-21swapper/308:10:463
19790991918,1cyclictest29488-21latency_hist08:35:003
19790991917,1cyclictest21510-21munin-run08:20:013
19785991919,0cyclictest5014-21apt-get07:45:452
19785991919,0cyclictest0-21swapper/208:10:462
19785991919,0cyclictest0-21swapper/207:50:472
19785991918,1cyclictest30064-21apt-get07:30:462
19785991917,1cyclictest29503-21munin-run08:35:002
19782991919,0cyclictest27416-21apt-get08:30:471
19782991919,0cyclictest0-21swapper/107:30:471
19782991919,0cyclictest0-21swapper/107:25:461
19776991919,0cyclictest0-21swapper/008:45:470
19776991917,1cyclictest11910-21latency_hist08:00:000
19785991818,0cyclictest0-21swapper/208:55:462
19785991817,0cyclictest0-21swapper/208:40:452
19782991817,0cyclictest0-21swapper/108:15:441
19776991817,0cyclictest0-21swapper/009:05:470
19790991717,0cyclictest0-21swapper/309:05:473
19790991716,1cyclictest22140-21apt-get08:20:023
19782991717,0cyclictest12306-21apt-get09:05:461
19782991717,0cyclictest0-21swapper/107:35:461
19782991715,1cyclictest19098-21perf08:15:011
19776991715,1cyclictest22822-21/usr/sbin/munin07:15:550
19790991616,0cyclictest32276-21apt-get08:40:453
19790991614,1cyclictest9489-21perf07:55:003
19790991613,2cyclictest32207-21perf07:35:013
1979099160,15cyclictest0-21swapper/307:20:473
19785991614,1cyclictest2261-21apt-get08:45:472
1978599160,4cyclictest0-21swapper/207:10:452
19776991616,0cyclictest0-21swapper/008:05:470
1979099150,1cyclictest29754-21perf07:30:013
1979099150,14cyclictest0-21swapper/307:45:483
19782991515,0cyclictest0-21swapper/107:40:461
1978299150,1cyclictest783-21snmpd08:48:041
1978299150,14cyclictest0-21swapper/107:51:421
19776991515,0cyclictest0-21swapper/008:30:460
1979099140,14cyclictest0-21swapper/308:45:473
1979099140,14cyclictest0-21swapper/308:00:533
1979099140,14cyclictest0-21swapper/307:35:133
1979099140,0cyclictest0-21swapper/307:41:253
1978599140,14cyclictest0-21swapper/208:35:022
19782991414,0cyclictest0-21swapper/108:00:391
1978299140,14cyclictest0-21swapper/108:40:021
1978299140,14cyclictest0-21swapper/107:45:261
1978299140,0cyclictest0-21swapper/108:55:011
19776991414,0cyclictest0-21swapper/008:56:020
19776991414,0cyclictest0-21swapper/007:25:110
1977699140,14cyclictest0-21swapper/008:10:030
1977699140,14cyclictest0-21swapper/007:30:210
1977699140,14cyclictest0-21swapper/007:20:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional