You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 05:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Mar 22, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2456699260,1cyclictest20855-21sed22:47:460
2457699250,24cyclictest0-21swapper/323:29:473
2457699250,1cyclictest3160-21sh23:34:303
2457399250,21cyclictest0-21swapper/221:17:382
2457399250,1cyclictest28814-21ssh21:21:012
2456999250,24cyclictest17826-21diskmemload23:52:341
2456699250,2cyclictest30783-21ssh23:29:500
2456699250,24cyclictest17826-21diskmemload23:32:460
2457699240,23cyclictest17826-21diskmemload23:12:423
2457699240,1cyclictest5405-21ssh22:02:273
24573992423,1cyclictest0-21swapper/223:19:392
24573992420,3cyclictest0-21swapper/200:12:382
24573992419,4cyclictest27966-21ssh00:31:322
24573992419,4cyclictest17826-21diskmemload00:08:382
2457399240,23cyclictest5279-21sh23:04:352
2457399240,23cyclictest17826-21diskmemload21:30:532
2457399240,23cyclictest14458-21ssh22:10:452
2457399240,23cyclictest0-21swapper/223:10:312
2457399240,23cyclictest0-21swapper/200:25:012
2457399240,21cyclictest0-21swapper/222:02:442
2457399240,21cyclictest0-21swapper/221:46:172
2457399240,20cyclictest10598-21apt-get22:07:382
2457399240,0cyclictest17826-21diskmemload22:26:042
2457399240,0cyclictest0-21swapper/223:53:322
2457399240,0cyclictest0-21swapper/222:59:492
2456999240,24cyclictest0-21swapper/122:32:381
2456999240,24cyclictest0-21swapper/100:12:451
2456999240,23cyclictest17826-21diskmemload23:34:531
2456999240,23cyclictest17826-21diskmemload21:15:541
2456999240,23cyclictest17039-21ptp4l-jitter22:12:441
2456999240,23cyclictest0-21swapper/122:40:541
2456999240,0cyclictest17826-21diskmemload00:22:531
2456699240,24cyclictest17826-21diskmemload22:22:470
2456699240,24cyclictest0-21swapper/023:57:430
2456699240,24cyclictest0-21swapper/021:27:200
2456699240,23cyclictest0-21swapper/021:42:000
2456699240,23cyclictest0-21swapper/021:31:140
24576992323,0cyclictest30897-21apt-get22:27:393
24576992323,0cyclictest17826-21diskmemload21:53:313
24576992323,0cyclictest17826-21diskmemload21:21:153
24576992323,0cyclictest0-21swapper/323:55:383
24576992323,0cyclictest0-21swapper/323:18:113
24576992322,1cyclictest0-21swapper/321:46:333
24576992321,1cyclictest25232-21fschecks_count21:17:393
2457699230,2cyclictest16727-21awk00:20:013
2457699230,2cyclictest12794-21ssh22:08:283
2457699230,23cyclictest17826-21diskmemload22:50:233
2457699230,23cyclictest0-21swapper/323:54:313
2457699230,23cyclictest0-21swapper/322:33:473
2457699230,23cyclictest0-21swapper/322:24:173
2457699230,23cyclictest0-21swapper/300:31:053
2457699230,23cyclictest0-21swapper/300:11:083
2457699230,22cyclictest7229-21rm23:07:263
2457699230,22cyclictest18470-21diskmemload22:46:373
2457699230,1cyclictest32691-21ssh21:57:213
2457699230,1cyclictest17826-21diskmemload22:10:013
2457699230,0cyclictest3461-21apt-get20:42:353
2457699230,0cyclictest0-21swapper/300:36:083
24573992323,0cyclictest0-21swapper/223:09:132
24573992323,0cyclictest0-21swapper/221:40:252
24573992322,1cyclictest23388-21dump-pmu-power20:15:012
24573992320,3cyclictest17826-21diskmemload23:42:462
24573992320,2cyclictest0-21swapper/223:45:582
24573992320,2cyclictest0-21swapper/200:36:432
24573992319,3cyclictest2707-21ssh22:30:432
24573992319,3cyclictest0-21swapper/222:42:382
24573992319,3cyclictest0-21swapper/222:21:072
2457399231,21cyclictest17826-21diskmemload00:25:422
2457399230,23cyclictest0-21swapper/222:54:592
2457399230,23cyclictest0-21swapper/222:38:142
2457399230,0cyclictest31455-21ssh21:55:222
2457399230,0cyclictest17826-21diskmemload23:57:592
2457399230,0cyclictest0-21swapper/223:32:452
2457399230,0cyclictest0-21swapper/222:15:062
2457399230,0cyclictest0-21swapper/221:50:482
2457399230,0cyclictest0-21swapper/221:35:452
2457399230,0cyclictest0-21swapper/200:18:392
24569992323,0cyclictest17826-21diskmemload22:00:511
24569992323,0cyclictest0-21swapper/123:24:381
24569992323,0cyclictest0-21swapper/123:18:211
24569992323,0cyclictest0-21swapper/122:20:581
24569992323,0cyclictest0-21swapper/121:45:141
24569992323,0cyclictest0-21swapper/100:36:301
24569992323,0cyclictest0-21swapper/100:30:491
24569992323,0cyclictest0-21swapper/100:01:201
24569992322,1cyclictest17826-21diskmemload21:10:181
24569992321,1cyclictest18385-21sh22:46:281
24569992321,1cyclictest0-21swapper/100:18:211
24569992320,2cyclictest17928-21sh23:48:451
2456999230,2cyclictest26947-21apt19:15:001
2456999230,23cyclictest0-21swapper/123:40:351
2456999230,23cyclictest0-21swapper/122:18:301
2456999230,23cyclictest0-21swapper/121:55:111
2456999230,22cyclictest29038-21sh21:21:211
2456999230,22cyclictest0-21swapper/123:14:501
2456999230,22cyclictest0-21swapper/121:26:311
2456999230,0cyclictest0-21swapper/123:27:041
2456999230,0cyclictest0-21swapper/100:25:561
2456999230,0cyclictest0-21swapper/100:06:171
24566992323,0cyclictest0-21swapper/023:40:300
24566992323,0cyclictest0-21swapper/022:05:560
24566992323,0cyclictest0-21swapper/019:47:360
24566992323,0cyclictest0-21swapper/000:11:240
24566992322,1cyclictest62550irq/127-eno100:30:550
24566992322,1cyclictest17826-21diskmemload22:37:510
24566992321,1cyclictest1608-21apt-get22:30:020
24566992321,1cyclictest0-21swapper/021:57:460
24566992321,1cyclictest0-21swapper/000:22:390
24566992321,1cyclictest0-21swapper/000:05:040
24566992320,2cyclictest20957-21pmu-power21:12:440
2456699231,1cyclictest62550irq/127-eno122:16:410
2456699231,1cyclictest62550irq/127-eno100:26:010
2456699230,23cyclictest62550irq/127-eno123:47:150
2456699230,23cyclictest17826-21diskmemload23:51:190
2456699230,23cyclictest0-21swapper/022:55:480
2456699230,23cyclictest0-21swapper/000:16:350
2456699230,22cyclictest27347-21rm21:51:510
2456699230,22cyclictest16030-21munin-run21:40:010
2456699230,22cyclictest14378-21sh22:10:380
2456699230,22cyclictest0-21swapper/023:38:240
2456699230,22cyclictest0-21swapper/023:03:060
2456699230,22cyclictest0-21swapper/000:02:420
2456699230,0cyclictest0-21swapper/022:25:450
2456699230,0cyclictest0-21swapper/020:42:360
24576992222,0cyclictest17826-21diskmemload21:30:033
24576992222,0cyclictest0-21swapper/323:21:383
24576992222,0cyclictest0-21swapper/322:15:053
24576992221,1cyclictest2994-21perf20:40:003
24576992220,1cyclictest5364-21apt-get23:37:383
24576992220,1cyclictest31736-21sh19:25:013
24576992220,1cyclictest27435-21apt-get22:55:023
24576992220,1cyclictest22655-21sh00:26:033
24576992220,1cyclictest17858-21sleep21:10:013
24576992220,1cyclictest10202-21munin-run20:55:003
24576992220,1cyclictest0-21swapper/320:47:373
24576992220,1cyclictest0-21swapper/300:07:253
2457699220,2cyclictest18695-21missed_timers21:42:413
2457699220,22cyclictest19405-21ssh21:12:113
2457699220,22cyclictest17826-21diskmemload23:49:123
2457699220,22cyclictest17826-21diskmemload22:41:343
2457699220,22cyclictest0-21swapper/321:38:373
2457699220,21cyclictest1561-21ssh21:26:153
2457699220,21cyclictest0-21swapper/323:40:083
2457699220,1cyclictest2355-21apt-get23:02:363
2457699220,0cyclictest17826-21diskmemload00:22:443
2457699220,0cyclictest0-21swapper/300:04:243
24573992222,0cyclictest0-21swapper/222:46:562
24573992220,2cyclictest0-21swapper/223:20:122
24573992220,1cyclictest25783-21cron20:20:012
24573992220,1cyclictest1728-21awk19:30:012
24573992219,2cyclictest27642-21rm23:27:372
24573992217,4cyclictest5860-21apt-get20:47:372
2457399220,22cyclictest0-21swapper/221:27:232
2457399220,21cyclictest30611-21munin-plugin-st20:30:012
2457399220,21cyclictest20023-21cstates21:12:382
2457399220,21cyclictest1032-21apt-get20:37:362
2457399220,21cyclictest10167-21cron20:55:002
2457399220,0cyclictest0-21swapper/223:39:332
2457399220,0cyclictest0-21swapper/219:22:362
24569992220,1cyclictest0-21swapper/121:40:021
24569992220,1cyclictest0-21swapper/121:37:421
2456999220,21cyclictest0-21swapper/123:01:001
2456999220,21cyclictest0-21swapper/120:22:361
2456999220,21cyclictest0-21swapper/119:32:361
2456999220,1cyclictest5699-21diskmemload23:05:011
2456999220,1cyclictest16216-21sendmail-msp20:00:001
2456999220,1cyclictest0-21swapper/122:59:271
2456999220,1cyclictest0-21swapper/122:54:181
2456999220,1cyclictest0-21swapper/121:52:061
2456999220,1cyclictest0-21swapper/120:07:361
2456999220,0cyclictest0-21swapper/120:42:351
24566992222,0cyclictest17826-21diskmemload21:45:050
24566992222,0cyclictest0-21swapper/000:39:310
24566992221,1cyclictest550-21awk20:35:000
24566992220,1cyclictest14059-21apt-get22:42:380
2456699220,22cyclictest0-21swapper/021:16:100
2456699220,21cyclictest5860-21apt-get20:47:380
2456699220,21cyclictest32022-21kworker/u8:122:04:090
2456699220,21cyclictest17826-21diskmemload23:20:040
2456699220,21cyclictest0-21swapper/021:07:360
2456699220,21cyclictest0-21swapper/020:37:350
2456699220,1cyclictest0-21swapper/021:21:390
2456699220,1cyclictest0-21swapper/019:12:360
24576992121,0cyclictest19053-21apt-get20:07:363
24576992119,1cyclictest11329-21idleruntime-cro19:50:003
24573992121,0cyclictest0-21swapper/219:57:382
24573992121,0cyclictest0-21swapper/219:37:362
24573992118,2cyclictest20977-21sh20:10:012
2457399210,0cyclictest0-21swapper/219:17:372
24569992120,1cyclictest3014-21sendmail-msp20:40:001
24569992119,1cyclictest25789-21latency_hist20:20:011
2456999210,20cyclictest0-21swapper/120:47:381
2456999210,20cyclictest0-21swapper/119:52:381
2456999210,20cyclictest0-21swapper/119:42:361
24566992121,0cyclictest17826-21diskmemload23:10:060
24566992121,0cyclictest0-21swapper/023:05:300
24566992119,1cyclictest15961-21sh23:15:020
24576992020,0cyclictest0-21swapper/320:12:363
24576992020,0cyclictest0-21swapper/319:52:383
24576992020,0cyclictest0-21swapper/319:27:383
24573992020,0cyclictest0-21swapper/220:57:382
24569992020,0cyclictest21449-21apt-get20:12:361
24569992020,0cyclictest0-21swapper/120:27:371
24569992018,1cyclictest313-21systemd-journal19:40:011
24566992020,0cyclictest0-21swapper/020:52:360
24566992020,0cyclictest0-21swapper/020:07:360
24566992020,0cyclictest0-21swapper/019:57:380
24566992020,0cyclictest0-21swapper/019:42:360
2456699200,0cyclictest0-21swapper/019:22:360
24576991919,0cyclictest7005-21apt-get19:42:363
2457399190,5cyclictest0-21swapper/219:45:012
24569991919,0cyclictest0-21swapper/121:07:361
24569991917,2cyclictest524-21awk20:35:001
24566991918,1cyclictest0-21swapper/021:00:020
2456699190,18cyclictest11794-21apt-get19:52:380
24573991816,1cyclictest11343-21wc19:50:002
24569991818,0cyclictest0-21swapper/121:02:371
24569991816,1cyclictest31726-21cron19:25:011
24566991816,1cyclictest29349-21turbostat19:20:010
24566991815,2cyclictest12607-21latency_hist21:00:010
24573991717,0cyclictest0-21swapper/220:42:362
24576991616,0cyclictest0-21swapper/320:57:383
2457699160,16cyclictest4139-21perf19:35:013
2457699160,15cyclictest0-21swapper/320:35:003
2457399160,0cyclictest0-21swapper/220:31:272
2456999163,12cyclictest313-21systemd-journal20:03:221
2456999160,15cyclictest9581-21cpuspeed_turbos19:47:371
24566991616,0cyclictest0-21swapper/020:27:370
24576991515,0cyclictest0-21swapper/320:17:373
24576991515,0cyclictest0-21swapper/319:57:383
2457699150,14cyclictest17300-21hddtemp_smartct20:02:393
2457399151,1cyclictest12585-21apt-get21:00:022
2457399150,14cyclictest0-21swapper/219:12:362
24569991515,0cyclictest0-21swapper/120:52:361
24569991512,2cyclictest12623-21awk21:00:011
24566991513,1cyclictest0-21swapper/019:35:010
2456699150,1cyclictest966-21grep19:27:450
2456699150,1cyclictest0-21swapper/019:37:370
24576991414,0cyclictest0-21swapper/320:20:143
2457699140,14cyclictest13301-21chrt21:00:573
2457699140,14cyclictest0-21swapper/320:25:133
2457699140,14cyclictest0-21swapper/319:35:203
2457699140,14cyclictest0-21swapper/319:15:303
2457699140,14cyclictest0-21swapper/319:11:353
24573991414,0cyclictest0-21swapper/220:21:182
2457399140,14cyclictest0-21swapper/221:06:322
2457399140,14cyclictest0-21swapper/220:00:562
2457399140,14cyclictest0-21swapper/219:30:092
2457399140,0cyclictest0-21swapper/219:50:322
24569991414,0cyclictest0-21swapper/119:25:121
2456999140,0cyclictest0-21swapper/119:15:331
24566991414,0cyclictest0-21swapper/020:10:140
2456699140,14cyclictest0-21swapper/020:20:250
2456699140,14cyclictest0-21swapper/020:00:090
2456699140,0cyclictest0-21swapper/020:15:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional