You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 07:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 09, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24160992827,1cyclictest34-21ksoftirqd/321:25:323
24160992726,1cyclictest34-21ksoftirqd/323:18:103
24160992724,2cyclictest34-21ksoftirqd/323:40:003
24159992623,3cyclictest0-21swapper/222:46:082
24160992523,1cyclictest0-21swapper/322:34:333
2416099250,24cyclictest34-21ksoftirqd/322:45:513
2415799253,1cyclictest62550irq/127-eno122:54:070
2415799250,2cyclictest9679-21sendmail_mailst23:39:160
24160992423,0cyclictest0-21swapper/321:15:473
2416099240,23cyclictest0-21swapper/323:24:223
2416099240,23cyclictest0-21swapper/321:22:123
2416099240,0cyclictest0-21swapper/321:54:233
24159992422,1cyclictest0-21swapper/222:35:002
24159992419,1cyclictest281ksoftirqd/219:40:002
2415999240,1cyclictest18335-21ssh21:42:472
24158992424,0cyclictest17371-21diskmemload23:24:291
24158992424,0cyclictest17371-21diskmemload23:05:321
24158992423,1cyclictest31961-21ssh00:00:391
2415899240,24cyclictest0-21swapper/123:38:341
2415899240,24cyclictest0-21swapper/123:25:201
2415899240,24cyclictest0-21swapper/122:36:151
24157992422,2cyclictest8250-21rm00:39:520
2415799242,21cyclictest62550irq/127-eno121:55:100
24157992422,1cyclictest20449-21df_inode23:19:090
24157992422,1cyclictest20242-21turbostat22:15:010
24157992422,1cyclictest0-21swapper/021:19:300
24157992422,1cyclictest0-21swapper/000:27:340
2415799240,23cyclictest32354-21ssh00:32:270
2415799240,23cyclictest17371-21diskmemload00:10:050
2415799240,23cyclictest0-21swapper/023:09:060
24160992323,0cyclictest17371-21diskmemload22:56:543
24160992323,0cyclictest0-21swapper/323:56:013
24160992323,0cyclictest0-21swapper/323:05:213
24160992323,0cyclictest0-21swapper/300:23:063
24160992323,0cyclictest0-21swapper/300:13:413
24160992322,1cyclictest34-21ksoftirqd/321:40:013
24160992321,1cyclictest0-21swapper/300:35:593
24160992321,1cyclictest0-21swapper/300:19:373
2416099231,21cyclictest151rcu_preempt23:33:583
2416099230,2cyclictest30869-21kworker/u8:100:00:353
2416099230,23cyclictest0-21swapper/322:28:533
2416099230,22cyclictest17371-21diskmemload23:52:223
2416099230,22cyclictest17371-21diskmemload21:57:323
2416099230,22cyclictest17371-21diskmemload00:05:333
2416099230,22cyclictest15252-21ssh23:14:093
2416099230,22cyclictest11322-21cron19:50:013
2416099230,22cyclictest0-21swapper/322:50:443
2416099230,0cyclictest17371-21diskmemload23:27:513
2416099230,0cyclictest17371-21diskmemload21:13:353
2416099230,0cyclictest0-21swapper/322:22:013
2416099230,0cyclictest0-21swapper/321:40:323
2416099230,0cyclictest0-21swapper/300:32:463
24159992323,0cyclictest0-21swapper/223:03:432
24159992323,0cyclictest0-21swapper/222:35:442
24159992323,0cyclictest0-21swapper/200:07:312
24159992321,1cyclictest16203-21ssh23:45:232
24159992321,1cyclictest0-21swapper/221:27:042
24159992320,2cyclictest11040-21sh00:11:572
2415999230,2cyclictest26676-21latency_hist21:50:002
2415999230,23cyclictest0-21swapper/223:36:132
2415999230,22cyclictest606-21dbus-daemon23:55:012
2415999230,22cyclictest22425-21sh00:23:032
2415999230,22cyclictest19207-21chrt21:11:512
2415999230,22cyclictest17371-21diskmemload00:28:042
2415999230,22cyclictest17371-21diskmemload00:03:422
2415999230,22cyclictest0-21swapper/221:23:012
2415999230,0cyclictest0-21swapper/223:26:142
2415999230,0cyclictest0-21swapper/222:57:192
2415999230,0cyclictest0-21swapper/222:51:402
2415999230,0cyclictest0-21swapper/222:09:492
2415999230,0cyclictest0-21swapper/222:02:182
2415999230,0cyclictest0-21swapper/221:57:102
24158992323,0cyclictest17371-21diskmemload00:34:121
24158992323,0cyclictest0-21swapper/123:31:551
24158992323,0cyclictest0-21swapper/122:57:301
24158992323,0cyclictest0-21swapper/122:15:181
24158992323,0cyclictest0-21swapper/122:04:031
24158992323,0cyclictest0-21swapper/121:59:011
24158992323,0cyclictest0-21swapper/121:53:581
24158992323,0cyclictest0-21swapper/121:46:271
24158992323,0cyclictest0-21swapper/121:41:461
24158992322,1cyclictest6550-21ssh23:04:271
2415899230,23cyclictest0-21swapper/123:11:391
2415899230,23cyclictest0-21swapper/122:30:111
2415899230,23cyclictest0-21swapper/122:11:191
2415899230,23cyclictest0-21swapper/100:38:231
2415899230,23cyclictest0-21swapper/100:05:181
2415899230,22cyclictest29456-21runrttasks23:59:101
2415899230,22cyclictest28191-21cron20:25:001
2415899230,22cyclictest24240-21ssh21:16:311
2415899230,22cyclictest23920-21rm00:24:131
2415899230,22cyclictest20934-21latency_hist23:50:011
2415899230,22cyclictest12063-21ssh00:13:361
2415899230,0cyclictest0-21swapper/100:17:231
24157992323,0cyclictest17371-21diskmemload23:32:240
24157992323,0cyclictest0-21swapper/022:55:110
24157992323,0cyclictest0-21swapper/022:08:200
24157992323,0cyclictest0-21swapper/021:51:300
24157992323,0cyclictest0-21swapper/021:10:360
24157992323,0cyclictest0-21swapper/000:01:080
24157992321,1cyclictest0-21swapper/023:55:350
24157992321,1cyclictest0-21swapper/022:47:550
24157992320,2cyclictest0-21swapper/022:22:580
2415799230,2cyclictest0-21swapper/021:42:520
2415799230,23cyclictest0-21swapper/023:50:240
2415799230,23cyclictest0-21swapper/022:31:300
2415799230,23cyclictest0-21swapper/021:34:100
2415799230,23cyclictest0-21swapper/000:23:480
2415799230,22cyclictest0-21swapper/022:42:230
2415799230,0cyclictest17371-21diskmemload22:15:320
2415799230,0cyclictest0-21swapper/023:29:320
2415799230,0cyclictest0-21swapper/000:06:470
24160992222,0cyclictest0-21swapper/322:15:053
24160992222,0cyclictest0-21swapper/300:25:173
24160992220,1cyclictest7805-21perf20:50:013
24160992220,1cyclictest0-21swapper/321:31:033
2416099220,22cyclictest0-21swapper/322:41:493
2416099220,21cyclictest6144-21perf19:40:003
2416099220,21cyclictest17371-21diskmemload22:12:153
2416099220,21cyclictest0-21swapper/323:41:353
2416099220,21cyclictest0-21swapper/323:01:273
2416099220,21cyclictest0-21swapper/322:08:193
2416099220,21cyclictest0-21swapper/322:00:093
2416099220,21cyclictest0-21swapper/320:39:063
2416099220,21cyclictest0-21swapper/320:19:093
2416099220,21cyclictest0-21swapper/319:54:073
2416099220,1cyclictest16936-21ssh23:46:283
2416099220,1cyclictest0-21swapper/321:45:273
2416099220,0cyclictest0-21swapper/322:35:123
24159992222,0cyclictest0-21swapper/222:40:402
24159992222,0cyclictest0-21swapper/200:17:322
24159992221,1cyclictest17498-21ssh23:15:122
24159992220,2cyclictest26997-21ssh23:56:102
24159992220,1cyclictest0-21swapper/221:36:022
24159992219,2cyclictest25814-21lockfile-create20:20:002
2415999220,22cyclictest0-21swapper/222:29:462
2415999220,21cyclictest28778-21apt-get20:29:072
2415999220,21cyclictest26018-21ssh22:20:322
2415999220,21cyclictest22724-21ssh23:20:092
2415999220,21cyclictest21323-21ssh22:16:172
2415999220,21cyclictest11183-21ssh23:40:292
2415999220,21cyclictest0-21swapper/223:10:162
2415999220,21cyclictest0-21swapper/223:05:352
2415999220,1cyclictest5376-21cron20:45:012
2415999220,1cyclictest0-21swapper/222:12:222
2415999220,1cyclictest0-21swapper/221:54:092
2415999220,0cyclictest0-21swapper/200:36:072
24158992222,0cyclictest17371-21diskmemload22:26:521
24158992222,0cyclictest0-21swapper/123:50:321
24158992222,0cyclictest0-21swapper/123:15:271
24158992222,0cyclictest0-21swapper/121:28:301
24158992222,0cyclictest0-21swapper/120:34:071
24158992222,0cyclictest0-21swapper/100:26:521
24158992221,1cyclictest30569-21ssh21:23:261
24158992221,1cyclictest0-21swapper/122:41:581
24158992221,0cyclictest22-21ksoftirqd/120:44:071
2415899220,22cyclictest17371-21diskmemload21:10:421
2415899220,21cyclictest19565-21ssh22:45:561
2415899220,21cyclictest11182-21ssh22:06:321
2415899220,21cyclictest0-21swapper/122:51:201
2415899220,1cyclictest8761-21ssh21:34:051
2415899220,1cyclictest313-21systemd-journal21:10:001
2415899220,1cyclictest11949-21ssh23:41:461
2415899220,0cyclictest0-21swapper/122:23:091
24157992222,0cyclictest0-21swapper/022:00:070
24157992222,0cyclictest0-21swapper/021:25:160
24157992222,0cyclictest0-21swapper/021:21:500
24157992221,1cyclictest0-21swapper/023:12:080
24157992220,1cyclictest9320-21sh22:36:000
24157992220,1cyclictest774-21runrttasks23:20:340
24157992220,1cyclictest0-21swapper/020:54:070
24157992219,2cyclictest541-21dump-pmu-power20:35:010
2415799220,22cyclictest16013-21sh00:16:010
2415799220,22cyclictest0-21swapper/022:27:150
2415799220,22cyclictest0-21swapper/021:46:370
2415799220,21cyclictest0-21swapper/019:24:060
2415799220,1cyclictest28962-21sendmail19:20:000
2415799220,1cyclictest16315-21perf21:40:010
2415799220,0cyclictest0-21swapper/023:48:040
24160992120,0cyclictest21508-21apt-get20:14:073
24160992120,0cyclictest0-21swapper/319:34:063
2416099210,20cyclictest0-21swapper/319:29:073
2416099210,1cyclictest17373-21ssh21:10:003
24159992120,1cyclictest23220-21sh21:15:052
24159992120,1cyclictest19114-21apt-get20:09:072
24159992119,1cyclictest28197-21cron20:25:002
24159992119,1cyclictest17369-21cron21:10:002
24159992119,1cyclictest14995-21basename21:05:002
2415999210,21cyclictest0-21swapper/223:30:552
2415999210,21cyclictest0-21swapper/221:33:232
2415999210,20cyclictest8368-21apt-get20:54:082
24158992121,0cyclictest0-21swapper/120:39:061
24158992121,0cyclictest0-21swapper/119:19:071
24158992120,1cyclictest13178-21apt-get21:04:071
24158992120,0cyclictest0-21swapper/120:09:071
24158992119,1cyclictest22-21ksoftirqd/120:04:071
2415899210,0cyclictest11909-21apt-get19:54:071
24157992121,0cyclictest0-21swapper/019:44:060
2415799210,21cyclictest0-21swapper/020:04:070
2415799210,21cyclictest0-21swapper/019:54:070
24160992020,0cyclictest0-21swapper/319:59:073
24160992019,1cyclictest0-21swapper/320:44:073
24159992019,0cyclictest14304-21apt-get19:59:072
24159992019,0cyclictest1145-21apt-get20:39:062
24158992020,0cyclictest0-21swapper/120:14:071
24158992019,1cyclictest22-21ksoftirqd/119:40:001
2415899200,0cyclictest0-21swapper/120:59:061
2415799200,0cyclictest0-21swapper/020:39:060
24160991919,0cyclictest0-21swapper/321:04:073
24160991919,0cyclictest0-21swapper/320:54:083
24160991919,0cyclictest0-21swapper/320:04:073
24159991919,0cyclictest0-21swapper/220:14:072
24159991917,1cyclictest31177-21apt-get20:34:072
24158991919,0cyclictest0-21swapper/120:29:071
24158991919,0cyclictest0-21swapper/119:24:061
24158991917,1cyclictest8552-21perf19:45:011
24157991918,1cyclictest3729-21turbostat19:35:000
24160991818,0cyclictest0-21swapper/320:59:063
24159991818,0cyclictest0-21swapper/219:54:072
24159991817,0cyclictest10760-21apt-get20:59:062
24158991818,0cyclictest0-21swapper/119:29:071
24157991817,1cyclictest24716-21apt-get19:14:070
24157991816,1cyclictest7806-21munin-plugin-st20:50:010
24160991715,1cyclictest549-21perf20:35:013
24160991714,2cyclictest606-21dbus-daemon20:10:003
24159991717,0cyclictest31924-21apt-get19:29:082
2415999170,16cyclictest7789-21turbostat20:50:012
24158991717,0cyclictest8542-21apt-get19:45:021
2415899170,16cyclictest0-21swapper/120:49:081
24157991716,1cyclictest26382-21apt-get20:24:070
24157991715,1cyclictest0-21swapper/021:00:000
24160991616,0cyclictest27115-21apt-get19:19:073
24159991616,0cyclictest0-21swapper/220:04:072
24159991616,0cyclictest0-21swapper/219:14:072
24158991616,0cyclictest0-21swapper/120:19:081
24157991616,0cyclictest0-21swapper/020:14:100
24157991614,1cyclictest0-21swapper/019:49:070
24160991515,0cyclictest0-21swapper/319:44:063
24160991513,1cyclictest24905-21tr19:14:073
24159991515,0cyclictest0-21swapper/219:19:072
24157991515,0cyclictest0-21swapper/021:04:070
24157991515,0cyclictest0-21swapper/020:44:070
24157991515,0cyclictest0-21swapper/020:19:090
24157991515,0cyclictest0-21swapper/019:59:080
2416099140,14cyclictest0-21swapper/319:20:303
2416099140,0cyclictest0-21swapper/320:26:463
2416099140,0cyclictest0-21swapper/320:20:543
24159991414,0cyclictest0-21swapper/219:40:542
24159991414,0cyclictest0-21swapper/219:20:012
2415999140,14cyclictest0-21swapper/219:46:082
2415999140,14cyclictest0-21swapper/219:32:162
24158991414,0cyclictest0-21swapper/120:51:081
24158991414,0cyclictest0-21swapper/119:30:391
2415799140,14cyclictest0-21swapper/020:05:150
2415799140,14cyclictest0-21swapper/019:36:570
2415799140,14cyclictest0-21swapper/019:25:220
2415799140,0cyclictest0-21swapper/021:06:020
2415799140,0cyclictest0-21swapper/020:25:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional