You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 06:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 17, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12426992523,1cyclictest6000-21diskmemload21:23:203
12422992523,1cyclictest0-21swapper/223:32:112
12422992523,1cyclictest0-21swapper/221:53:142
1242299250,24cyclictest0-21swapper/221:44:412
12420992523,1cyclictest0-21swapper/100:13:021
1242099250,24cyclictest0-21swapper/121:47:341
1242099250,1cyclictest0-21swapper/122:55:011
12426992424,0cyclictest6000-21diskmemload00:30:263
1242699240,3cyclictest2676-21ssh21:35:013
1242699240,1cyclictest6000-21diskmemload23:19:333
12422992423,1cyclictest0-21swapper/200:12:572
12422992423,0cyclictest0-21swapper/222:50:092
1242299240,3cyclictest25518-21cron00:20:012
1242299240,24cyclictest0-21swapper/221:11:552
1242299240,23cyclictest6000-21diskmemload23:40:392
1242299240,23cyclictest1489-21latency_hist23:30:002
1242299240,23cyclictest0-21swapper/223:20:432
1242299240,23cyclictest0-21swapper/222:19:532
1242299240,23cyclictest0-21swapper/222:11:582
1242299240,1cyclictest0-21swapper/221:18:172
1242099240,24cyclictest0-21swapper/122:38:061
1242099240,24cyclictest0-21swapper/122:00:561
1242099240,23cyclictest0-21swapper/100:05:501
1242099240,1cyclictest0-21swapper/121:50:141
1242099240,0cyclictest0-21swapper/121:35:481
12416992423,1cyclictest6000-21diskmemload22:17:360
1241699240,24cyclictest62550irq/127-eno122:49:260
1241699240,24cyclictest0-21swapper/022:39:150
1241699240,23cyclictest6000-21diskmemload23:27:240
1241699240,23cyclictest20786-21ssh21:50:570
1241699240,23cyclictest0-21swapper/023:56:090
1241699240,0cyclictest0-21swapper/000:21:490
12426992323,0cyclictest0-21swapper/323:01:283
12426992323,0cyclictest0-21swapper/300:13:193
12426992322,1cyclictest9207-21ssh22:39:103
12426992322,1cyclictest6000-21diskmemload22:45:113
12426992322,1cyclictest26801-21sh23:23:363
12426992321,1cyclictest32343-21rm22:01:313
1242699231,21cyclictest14073-21cut20:20:003
1242699230,2cyclictest32737-21sh00:25:543
1242699230,2cyclictest23512-21sh00:18:403
1242699230,23cyclictest0-21swapper/323:49:453
1242699230,23cyclictest0-21swapper/321:15:073
1242699230,22cyclictest6000-21diskmemload21:27:293
1242699230,22cyclictest6000-21diskmemload00:05:343
1242699230,22cyclictest31156-21irqstats00:25:013
1242699230,22cyclictest3097-21munin-run00:00:003
1242699230,22cyclictest21195-21chrt21:51:373
1242699230,22cyclictest17230-21sh21:48:473
1242699230,22cyclictest12062-21ssh22:12:263
1242699230,22cyclictest0-21swapper/323:25:593
1242699230,0cyclictest0-21swapper/323:07:193
1242699230,0cyclictest0-21swapper/321:57:423
12422992323,0cyclictest0-21swapper/221:27:152
12422992323,0cyclictest0-21swapper/219:44:552
12422992323,0cyclictest0-21swapper/200:00:502
12422992321,1cyclictest0-21swapper/222:25:222
12422992321,1cyclictest0-21swapper/221:57:432
1242299230,23cyclictest6000-21diskmemload22:49:102
1242299230,23cyclictest0-21swapper/222:56:552
1242299230,22cyclictest6567-21sleep20:05:002
1242299230,22cyclictest6000-21diskmemload22:06:072
1242299230,22cyclictest31417-21apt-get22:30:022
1242299230,22cyclictest17351-21munin-run23:15:002
1242299230,22cyclictest0-21swapper/223:01:362
1242299230,22cyclictest0-21swapper/221:46:252
1242299230,22cyclictest0-21swapper/200:33:382
1242299230,0cyclictest0-21swapper/223:55:382
1242299230,0cyclictest0-21swapper/200:35:462
12420992323,0cyclictest6000-21diskmemload22:26:361
12420992323,0cyclictest0-21swapper/123:38:231
12420992323,0cyclictest0-21swapper/123:08:531
12420992323,0cyclictest0-21swapper/122:51:131
12420992323,0cyclictest0-21swapper/100:25:161
12420992321,1cyclictest4182-21apt-config20:00:011
12420992321,1cyclictest0-21swapper/123:22:191
12420992321,1cyclictest0-21swapper/123:01:151
12420992321,1cyclictest0-21swapper/122:40:381
12420992321,1cyclictest0-21swapper/121:22:471
12420992321,1cyclictest0-21swapper/121:13:101
1242099230,2cyclictest15578-21kworker/u8:100:20:061
1242099230,22cyclictest0-21swapper/119:55:011
1242099230,22cyclictest0-21swapper/100:16:361
1242099230,0cyclictest6000-21diskmemload23:54:451
1242099230,0cyclictest6000-21diskmemload00:33:301
1242099230,0cyclictest0-21swapper/123:41:501
1242099230,0cyclictest0-21swapper/121:25:091
1242099230,0cyclictest0-21swapper/121:19:511
12416992323,0cyclictest62550irq/127-eno121:10:060
12416992323,0cyclictest6000-21diskmemload00:31:090
12416992323,0cyclictest0-21swapper/023:45:350
12416992322,1cyclictest6000-21diskmemload00:39:090
12416992321,1cyclictest606-21dbus-daemon00:20:010
12416992320,2cyclictest823-21ssh00:26:330
12416992320,2cyclictest27108-21sendmail-msp19:40:000
12416992320,2cyclictest0-21swapper/023:00:150
1241699230,2cyclictest27642-21ssh22:25:390
1241699230,23cyclictest0-21swapper/023:34:480
1241699230,23cyclictest0-21swapper/023:12:130
1241699230,23cyclictest0-21swapper/022:00:070
1241699230,22cyclictest3983-21ssh22:34:370
1241699230,22cyclictest23731-21ssh22:23:090
1241699230,1cyclictest6000-21diskmemload22:11:130
1241699230,1cyclictest0-21swapper/022:53:050
1241699230,0cyclictest6000-21diskmemload23:50:230
1241699230,0cyclictest6000-21diskmemload23:43:220
1241699230,0cyclictest6000-21diskmemload23:39:160
1241699230,0cyclictest0-21swapper/022:56:300
1241699230,0cyclictest0-21swapper/021:45:030
12426992222,0cyclictest6000-21diskmemload22:22:163
12426992222,0cyclictest0-21swapper/323:12:363
12426992222,0cyclictest0-21swapper/322:43:483
12426992221,1cyclictest261-21jbd2/nvme0n1p2-20:24:553
12426992220,1cyclictest27123-21munin-run19:40:003
12426992220,1cyclictest2386-21ntp_states23:30:053
1242699220,22cyclictest28897-21turbostat20:50:013
1242699220,22cyclictest0-21swapper/322:55:343
1242699220,22cyclictest0-21swapper/322:53:113
1242699220,22cyclictest0-21swapper/300:01:433
1242699220,21cyclictest25194-21kworker/u8:023:50:043
1242699220,21cyclictest21180-21munin-run20:35:013
1242699220,21cyclictest21180-21munin-run20:35:013
1242699220,21cyclictest18530-21apt-get19:24:563
1242699220,21cyclictest14706-21ssh23:40:513
1242699220,21cyclictest0-21swapper/322:15:153
1242699220,1cyclictest8077-21sh21:11:193
1242699220,1cyclictest27468-21sh22:25:253
1242699220,1cyclictest0-21swapper/321:37:523
1242699220,0cyclictest0-21swapper/323:39:203
1242699220,0cyclictest0-21swapper/322:06:023
12422992222,0cyclictest6000-21diskmemload00:21:182
12422992222,0cyclictest0-21swapper/222:35:132
12422992222,0cyclictest0-21swapper/222:00:072
12422992221,1cyclictest0-21swapper/222:21:292
12422992221,1cyclictest0-21swapper/200:07:442
12422992220,1cyclictest0-21swapper/223:45:072
12422992220,1cyclictest0-21swapper/223:15:072
12422992220,1cyclictest0-21swapper/222:40:032
12422992220,1cyclictest0-21swapper/200:25:232
1242299220,21cyclictest514-21apt-get19:54:542
1242299220,21cyclictest4118-21sh21:36:032
1242299220,21cyclictest30225-21apt-get20:54:542
1242299220,21cyclictest29256-21dump-pmu-power19:49:562
1242299220,21cyclictest25430-21sh23:50:032
1242299220,21cyclictest17778-21apt-get20:29:552
1242299220,21cyclictest10171-21rm23:08:532
1242299220,21cyclictest0-21swapper/220:09:552
1242299220,1cyclictest0-21swapper/223:36:402
1242299220,0cyclictest12967-21apt-get20:19:552
1242299220,0cyclictest0-21swapper/221:32:352
12420992222,0cyclictest0-21swapper/123:27:181
12420992222,0cyclictest0-21swapper/122:48:351
12420992222,0cyclictest0-21swapper/121:33:551
12420992221,1cyclictest6000-21diskmemload22:05:021
12420992221,1cyclictest0-21swapper/123:10:451
12420992220,1cyclictest0-21swapper/100:04:591
1242099220,21cyclictest22595-21sh22:21:361
1242099220,21cyclictest15385-21apt-get20:24:551
1242099220,21cyclictest0-21swapper/123:55:441
1242099220,21cyclictest0-21swapper/122:30:151
1242099220,21cyclictest0-21swapper/121:55:111
1242099220,21cyclictest0-21swapper/120:55:001
1242099220,21cyclictest0-21swapper/120:29:551
1242099220,21cyclictest0-21swapper/100:35:341
1242099220,1cyclictest20178-21apt-get20:34:561
1242099220,1cyclictest20178-21apt-get20:34:561
1242099220,1cyclictest18333-21sed23:15:061
1242099220,1cyclictest0-21swapper/123:45:371
1242099220,1cyclictest0-21swapper/123:32:271
12416992222,0cyclictest6000-21diskmemload23:20:470
12416992222,0cyclictest0-21swapper/023:15:150
12416992222,0cyclictest0-21swapper/023:08:170
12416992222,0cyclictest0-21swapper/000:05:400
12416992221,0cyclictest0-21swapper/021:20:020
12416992221,0cyclictest0-21swapper/020:00:020
12416992220,1cyclictest0-21swapper/021:30:080
1241699220,2cyclictest3588-21tail00:00:040
1241699220,22cyclictest6000-21diskmemload21:58:330
1241699220,22cyclictest6000-21diskmemload21:36:140
1241699220,21cyclictest15234-21ssh00:10:060
1241699220,1cyclictest5658-21ssh22:06:440
1241699220,1cyclictest1067-21basename21:00:000
1241699220,0cyclictest6000-21diskmemload22:43:480
1241699220,0cyclictest6000-21diskmemload21:26:530
12426992121,0cyclictest0-21swapper/322:34:253
1242699210,0cyclictest0-21swapper/319:19:533
12422992120,1cyclictest17496-21cron19:20:012
1242299210,21cyclictest0-21swapper/219:29:562
1242299210,20cyclictest23321-21apt-get19:34:542
1242299210,20cyclictest0-21swapper/221:04:562
12420992121,0cyclictest0-21swapper/121:09:561
12420992121,0cyclictest0-21swapper/120:44:551
12420992119,1cyclictest0-21swapper/120:09:551
1242099210,0cyclictest0-21swapper/121:40:061
12416992121,0cyclictest0-21swapper/020:24:550
1241699210,21cyclictest0-21swapper/019:44:550
1241699210,1cyclictest0-21swapper/021:09:550
12426992020,0cyclictest0-21swapper/319:49:563
12426992018,1cyclictest3442-21cron21:05:003
1242699200,20cyclictest0-21swapper/319:34:543
1242699200,0cyclictest0-21swapper/319:54:543
12422992020,0cyclictest2960-21apt-get19:59:552
12422992020,0cyclictest0-21swapper/219:39:532
12422992019,0cyclictest0-21swapper/219:14:552
12422992018,1cyclictest23673-21latency_hist20:40:012
12420992020,0cyclictest0-21swapper/120:45:021
12420992020,0cyclictest0-21swapper/120:20:001
12420992020,0cyclictest0-21swapper/120:00:021
12420992020,0cyclictest0-21swapper/119:29:561
12420992018,1cyclictest1047-21grep21:00:001
12416992020,0cyclictest23671-21sendmail-msp20:40:010
12416992019,0cyclictest26125-21apt-get20:45:020
1241699200,1cyclictest4043-21grep20:00:010
12426991919,0cyclictest0-21swapper/320:54:543
1242699190,1cyclictest20926-21apt-get19:29:563
1242699190,19cyclictest6000-21diskmemload21:10:003
1242699190,18cyclictest0-21swapper/320:00:013
12422991919,0cyclictest0-21swapper/220:44:552
12422991919,0cyclictest0-21swapper/219:24:562
12422991916,2cyclictest313-21systemd-journal21:10:002
12420991919,0cyclictest0-21swapper/119:44:551
12416991919,0cyclictest0-21swapper/020:19:550
12416991919,0cyclictest0-21swapper/020:14:550
12426991818,0cyclictest0-21swapper/320:39:553
12422991818,0cyclictest0-21swapper/220:30:012
12422991818,0cyclictest0-21swapper/220:30:012
12420991818,0cyclictest2630-21apt-get21:04:561
12416991818,0cyclictest8167-21apt-get20:09:550
12416991818,0cyclictest0-21swapper/019:19:530
12422991715,1cyclictest0-21swapper/220:49:552
12420991717,0cyclictest0-21swapper/119:49:561
12416991716,1cyclictest1702-21perf19:55:010
1241699170,0cyclictest0-21swapper/021:04:560
12426991616,0cyclictest13715-21apt-get19:14:553
12426991616,0cyclictest10563-21apt-get20:14:563
12422991615,1cyclictest32623-21apt-get20:59:562
12420991616,0cyclictest0-21swapper/119:14:551
12416991616,0cyclictest0-21swapper/020:29:550
12416991616,0cyclictest0-21swapper/019:29:560
1241699160,15cyclictest29645-21proc_pri19:45:020
12426991515,0cyclictest0-21swapper/320:59:563
12420991515,0cyclictest0-21swapper/119:34:541
1241699159,6cyclictest13260-21munin-node20:51:410
1241699150,14cyclictest0-21swapper/019:30:040
12426991414,0cyclictest0-21swapper/320:02:143
1242699140,14cyclictest0-21swapper/320:26:423
1242699140,14cyclictest0-21swapper/319:40:413
1242299140,14cyclictest0-21swapper/220:20:172
1242299140,14cyclictest0-21swapper/220:10:452
12420991414,0cyclictest0-21swapper/119:21:091
12420991414,0cyclictest0-21swapper/119:15:371
1242099140,14cyclictest0-21swapper/120:35:541
12416991414,0cyclictest0-21swapper/020:41:050
1241699140,14cyclictest0-21swapper/019:20:290
1241699140,0cyclictest0-21swapper/020:30:370
1241699140,0cyclictest0-21swapper/020:30:370
1241699140,0cyclictest0-21swapper/019:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional