You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 14:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon May 11, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
549992920,8cyclictest6562-21sed00:12:000
54999290,1cyclictest29067-21ssh00:32:180
562992624,1cyclictest17715-21sh00:22:042
549992619,6cyclictest13123-21ssh00:18:220
54999260,21cyclictest27550-21ssh22:07:300
54999260,1cyclictest1128-21sh00:07:210
54999260,1cyclictest0-21swapper/022:36:560
54999260,0cyclictest26267-21diskmemload23:02:300
56899250,24cyclictest26267-21diskmemload23:36:423
56299250,24cyclictest26267-21diskmemload23:49:492
56299250,24cyclictest0-21swapper/221:18:582
56299250,1cyclictest0-21swapper/223:33:482
55699250,24cyclictest9997-21ssh21:24:101
55699250,24cyclictest2222-21idleruntime-cro20:20:001
549992522,3cyclictest26267-21diskmemload21:56:250
549992521,4cyclictest26267-21diskmemload23:40:580
549992520,4cyclictest26763-21ssh23:33:180
549992520,4cyclictest26267-21diskmemload21:41:090
549992520,4cyclictest26267-21diskmemload21:26:570
549992520,4cyclictest0-21swapper/021:31:530
54999250,24cyclictest18059-21ssh23:54:570
54999250,21cyclictest30168-21ssh23:07:280
54999250,0cyclictest31728-21irqstats22:11:530
568992423,1cyclictest14121-21ssh22:25:073
568992422,1cyclictest0-21swapper/300:36:273
56899240,23cyclictest28356-21ssh21:40:193
56899240,23cyclictest26267-21diskmemload00:25:523
56899240,23cyclictest26267-21diskmemload00:20:183
56899240,23cyclictest23378-21sh23:31:053
56899240,1cyclictest26267-21diskmemload21:24:043
562992423,1cyclictest0-21swapper/223:40:072
562992421,2cyclictest2963-21sh19:15:012
562992420,4cyclictest0-21swapper/222:44:462
562992419,4cyclictest0-21swapper/222:45:392
56299240,24cyclictest26267-21diskmemload22:54:072
56299240,23cyclictest0-21swapper/221:36:512
56299240,1cyclictest0-21swapper/221:25:202
556992422,1cyclictest0-21swapper/123:51:231
556992422,1cyclictest0-21swapper/100:15:051
556992421,2cyclictest783-21snmpd00:00:031
556992421,1cyclictest0-21swapper/121:30:331
55699241,22cyclictest26267-21diskmemload22:02:001
55699240,23cyclictest32224-21latency_hist20:15:001
55699240,23cyclictest23885-21latency_hist00:00:011
55699240,23cyclictest21124-21ssh23:28:141
55699240,23cyclictest0-21swapper/100:10:511
55699240,1cyclictest26267-21diskmemload23:01:041
55699240,0cyclictest0-21swapper/100:22:571
549992422,1cyclictest0-21swapper/023:56:520
549992420,4cyclictest0-21swapper/021:53:150
549992420,3cyclictest26267-21diskmemload00:22:370
54999240,24cyclictest0-21swapper/023:46:140
54999240,24cyclictest0-21swapper/022:51:560
54999240,24cyclictest0-21swapper/022:48:540
54999240,24cyclictest0-21swapper/022:20:500
54999240,23cyclictest26267-21diskmemload22:55:410
54999240,21cyclictest0-21swapper/022:15:140
54999240,19cyclictest2149-21ssh22:42:370
54999240,0cyclictest26267-21diskmemload21:22:260
54999240,0cyclictest26267-21diskmemload21:16:190
54999240,0cyclictest0-21swapper/023:18:510
54999240,0cyclictest0-21swapper/021:47:050
54999240,0cyclictest0-21swapper/000:38:080
568992323,0cyclictest26267-21diskmemload22:16:313
568992323,0cyclictest0-21swapper/323:50:313
568992323,0cyclictest0-21swapper/322:24:493
568992323,0cyclictest0-21swapper/300:01:043
568992322,1cyclictest26267-21diskmemload21:39:373
568992322,1cyclictest0-21swapper/321:31:543
568992322,0cyclictest0-21swapper/321:25:323
568992321,1cyclictest8197-21threads23:16:583
568992321,1cyclictest1763-21ssh21:16:523
568992321,1cyclictest15392-21perf19:40:003
568992320,2cyclictest4638-21sh22:45:343
568992320,2cyclictest26825-21ssh23:05:233
56899231,21cyclictest0-21swapper/323:42:503
56899230,23cyclictest26267-21diskmemload00:06:133
56899230,23cyclictest0-21swapper/323:04:573
56899230,23cyclictest0-21swapper/322:37:103
56899230,23cyclictest0-21swapper/322:31:573
56899230,22cyclictest25446-21cstates22:06:503
56899230,22cyclictest22221-21sh22:03:063
56899230,22cyclictest0-21swapper/323:21:373
56899230,22cyclictest0-21swapper/300:31:523
56899230,0cyclictest0-21swapper/323:25:543
56899230,0cyclictest0-21swapper/321:10:273
562992323,0cyclictest26267-21diskmemload21:32:192
562992323,0cyclictest26267-21diskmemload00:29:402
562992323,0cyclictest0-21swapper/223:26:172
562992321,1cyclictest0-21swapper/223:53:222
562992321,1cyclictest0-21swapper/223:10:162
562992321,1cyclictest0-21swapper/222:02:422
562992320,2cyclictest4009-21ssh22:16:362
562992320,2cyclictest30102-21ssh22:39:112
562992320,2cyclictest27115-21ssh21:10:542
56299231,22cyclictest2001-1kworker/u9:022:34:122
56299230,23cyclictest0-21swapper/200:31:502
56299230,22cyclictest3970-21sh00:10:542
56299230,22cyclictest26267-21diskmemload22:57:132
56299230,22cyclictest26267-21diskmemload22:10:232
56299230,22cyclictest0-21swapper/223:59:122
56299230,22cyclictest0-21swapper/220:36:492
56299230,0cyclictest26267-21diskmemload23:17:092
56299230,0cyclictest0-21swapper/223:35:012
56299230,0cyclictest0-21swapper/223:22:452
56299230,0cyclictest0-21swapper/221:51:162
556992323,0cyclictest15781-21apt-get19:41:471
556992323,0cyclictest0-21swapper/123:48:081
556992323,0cyclictest0-21swapper/123:38:111
556992323,0cyclictest0-21swapper/122:40:591
556992323,0cyclictest0-21swapper/122:35:161
556992323,0cyclictest0-21swapper/122:30:151
556992323,0cyclictest0-21swapper/122:27:101
556992323,0cyclictest0-21swapper/121:55:061
556992321,1cyclictest0-21swapper/123:17:181
556992321,1cyclictest0-21swapper/121:41:561
556992320,2cyclictest26393-21ssh23:32:511
55699230,2cyclictest3349-21ssh22:15:461
55699230,23cyclictest26267-21diskmemload00:38:031
55699230,23cyclictest0-21swapper/121:13:381
55699230,22cyclictest26267-21diskmemload22:12:471
55699230,22cyclictest1-21systemd21:55:001
55699230,22cyclictest10588-21awk19:30:001
55699230,22cyclictest0-21swapper/123:21:471
55699230,22cyclictest0-21swapper/100:25:371
55699230,0cyclictest0-21swapper/123:10:441
55699230,0cyclictest0-21swapper/122:08:531
55699230,0cyclictest0-21swapper/100:31:581
549992323,0cyclictest26267-21diskmemload23:28:020
549992323,0cyclictest0-21swapper/023:24:410
549992322,1cyclictest499-21sh23:11:030
54999232,1cyclictest62550irq/127-eno122:31:590
54999230,23cyclictest26267-21diskmemload00:26:110
54999230,23cyclictest0-21swapper/022:00:150
54999230,23cyclictest0-21swapper/000:01:050
54999230,22cyclictest32217-21rm23:38:060
54999230,22cyclictest26925-21ssh21:10:380
568992222,0cyclictest0-21swapper/322:55:433
568992220,2cyclictest10322-21ssh22:50:443
568992220,1cyclictest7454-21sh21:50:503
568992219,2cyclictest26304-21idleruntime-cro21:10:003
56899220,22cyclictest26267-21diskmemload21:56:493
56899220,21cyclictest4639-21apt20:25:003
56899220,21cyclictest24977-21turbostat20:00:013
56899220,21cyclictest19478-21apt-get20:56:493
56899220,21cyclictest0-21swapper/323:56:493
56899220,21cyclictest0-21swapper/320:51:483
56899220,1cyclictest9769-21sh00:16:143
56899220,1cyclictest12241-21ssh23:49:383
56899220,1cyclictest1192-21ssh22:13:063
56899220,1cyclictest0-21swapper/321:46:523
56899220,0cyclictest26267-21diskmemload00:14:163
562992222,0cyclictest26267-21diskmemload23:00:022
562992220,1cyclictest0-21swapper/223:06:522
562992219,2cyclictest4649-21munin-plugin-st20:25:002
56299220,22cyclictest0-21swapper/222:25:342
56299220,22cyclictest0-21swapper/222:21:342
56299220,21cyclictest9136-21ssh00:15:122
56299220,21cyclictest0-21swapper/221:55:172
56299220,21cyclictest0-21swapper/221:41:342
56299220,21cyclictest0-21swapper/200:05:022
56299220,21cyclictest0-21swapper/200:02:182
56299220,1cyclictest24143-21ssh22:05:202
56299220,1cyclictest16644-21wc20:50:012
56299220,0cyclictest0-21swapper/221:48:172
556992220,1cyclictest0-21swapper/121:45:271
556992220,1cyclictest0-21swapper/121:35:471
556992219,2cyclictest21503-21grep21:00:011
55699220,22cyclictest0-21swapper/122:52:281
55699220,21cyclictest30369-21ssh00:05:221
55699220,21cyclictest26267-21diskmemload23:00:011
55699220,21cyclictest0-21swapper/123:40:321
55699220,21cyclictest0-21swapper/119:51:491
55699220,21cyclictest0-21swapper/119:21:501
55699220,1cyclictest8496-21rm22:20:031
55699220,1cyclictest0-21swapper/122:45:311
55699220,1cyclictest0-21swapper/121:25:381
549992219,3cyclictest0-21swapper/021:36:470
549992219,2cyclictest2249-21grep20:20:000
54999220,21cyclictest0-21swapper/020:01:480
568992119,1cyclictest2239-21perf20:20:003
56899210,21cyclictest0-21swapper/323:12:063
56899210,21cyclictest0-21swapper/320:15:003
56899210,0cyclictest0-21swapper/319:41:483
562992120,1cyclictest17032-21apt-get20:51:482
562992119,1cyclictest2199-21cron20:20:002
56299210,21cyclictest0-21swapper/200:35:122
56299210,20cyclictest0-21swapper/220:41:502
56299210,20cyclictest0-21swapper/220:41:502
56299210,20cyclictest0-21swapper/219:26:492
56299210,0cyclictest7029-21perf20:30:002
56299210,0cyclictest0-21swapper/219:41:482
556992121,0cyclictest0-21swapper/121:06:481
55699210,0cyclictest0-21swapper/123:05:361
549992121,0cyclictest13365-21apt-get19:36:480
549992120,1cyclictest27830-21apt-get20:06:480
549992120,1cyclictest2639-21apt-get20:21:490
54999210,5cyclictest0-21swapper/019:31:590
568992020,0cyclictest0-21swapper/321:01:503
568992020,0cyclictest0-21swapper/320:31:493
568992020,0cyclictest0-21swapper/319:26:493
568992020,0cyclictest0-21swapper/319:11:483
568992019,0cyclictest0-21swapper/319:16:473
562992020,0cyclictest0-21swapper/220:11:492
562992019,0cyclictest10972-21apt-get19:31:492
562992018,1cyclictest29805-21cron20:10:012
562992018,1cyclictest15387-21munin-run19:40:002
56299200,0cyclictest7430-21apt-get20:31:492
556992020,0cyclictest0-21swapper/120:10:011
556992020,0cyclictest0-21swapper/119:46:471
556992020,0cyclictest0-21swapper/119:36:481
55699200,0cyclictest0-21swapper/120:51:481
549992020,0cyclictest0-21swapper/020:36:490
549992020,0cyclictest0-21swapper/019:16:470
54999200,0cyclictest0-21swapper/020:41:490
54999200,0cyclictest0-21swapper/020:41:490
54999200,0cyclictest0-21swapper/020:31:490
562991919,0cyclictest18177-21apt-get19:46:472
562991919,0cyclictest0-21swapper/220:56:492
562991919,0cyclictest0-21swapper/220:01:492
562991919,0cyclictest0-21swapper/219:16:472
556991919,0cyclictest0-21swapper/120:31:491
556991919,0cyclictest0-21swapper/120:26:481
556991919,0cyclictest0-21swapper/120:01:491
556991919,0cyclictest0-21swapper/119:31:491
556991918,1cyclictest0-21swapper/121:01:511
54999197,11cyclictest18394-21apt-get20:51:560
549991919,0cyclictest0-21swapper/020:46:490
549991919,0cyclictest0-21swapper/019:56:490
549991919,0cyclictest0-21swapper/019:46:470
549991913,5cyclictest0-21swapper/021:06:470
568991818,0cyclictest0-21swapper/319:46:473
562991816,1cyclictest0-21swapper/219:51:492
556991818,0cyclictest0-21swapper/120:41:501
556991818,0cyclictest0-21swapper/120:41:501
549991818,0cyclictest0-21swapper/020:26:480
54999180,0cyclictest0-21swapper/019:41:480
568991717,0cyclictest25384-21apt-get20:01:493
568991717,0cyclictest0-21swapper/320:41:493
568991717,0cyclictest0-21swapper/320:41:493
56899170,14cyclictest313-21systemd-journal20:50:013
556991716,1cyclictest9825-21apt-get20:36:491
549991717,0cyclictest0-21swapper/021:01:510
549991717,0cyclictest0-21swapper/019:51:500
568991616,0cyclictest5033-21apt-get20:26:483
568991616,0cyclictest0-21swapper/320:36:483
568991615,0cyclictest6181-21apt-get19:21:503
562991615,0cyclictest0-21swapper/219:56:492
56299160,15cyclictest22396-21fschecks_time21:01:532
556991616,0cyclictest0-21swapper/120:46:481
556991614,1cyclictest3364-21apt-get19:16:471
54999160,14cyclictest0-21swapper/020:12:500
54999153,11cyclictest13-21ksoftirqd/019:21:500
549991513,1cyclictest0-21swapper/019:11:530
54999150,4cyclictest0-21swapper/019:26:480
568991414,0cyclictest0-21swapper/319:30:383
56899140,14cyclictest0-21swapper/319:50:283
56899140,0cyclictest0-21swapper/320:05:253
56299140,14cyclictest0-21swapper/219:20:162
56299140,0cyclictest0-21swapper/221:09:302
556991414,0cyclictest0-21swapper/120:20:031
55699140,0cyclictest0-21swapper/119:55:401
54999140,0cyclictest0-21swapper/020:55:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional