You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 23:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 01, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12820992623,2cyclictest20644-21apt-get10:20:013
12815992519,1cyclictest27826-21ssh11:23:232
1281599250,0cyclictest0-21swapper/212:05:472
12811992522,2cyclictest774-21runrttasks12:07:391
1281199250,24cyclictest0-21swapper/111:50:451
1281199250,24cyclictest0-21swapper/110:31:531
1281199250,1cyclictest0-21swapper/111:31:561
1281199250,1cyclictest0-21swapper/109:34:321
1281099253,21cyclictest62550irq/127-eno111:11:370
12810992523,1cyclictest0-21swapper/010:39:500
12810992522,2cyclictest12383-21ssh09:43:110
1281099250,24cyclictest6535-21diskmemload12:39:570
1281099250,24cyclictest19118-21rm09:49:410
1281099250,24cyclictest0-21swapper/011:35:160
1281099250,1cyclictest2873-21ssh12:27:130
12820992421,2cyclictest23240-21ssh09:52:383
1282099240,24cyclictest6535-21diskmemload09:58:023
1282099240,23cyclictest16230-21latency_hist12:40:013
1282099240,1cyclictest6535-21diskmemload11:47:203
1282099240,1cyclictest6535-21diskmemload10:52:203
1282099240,0cyclictest0-21swapper/309:13:543
1281599240,2cyclictest313-21systemd-journal09:45:012
1281599240,24cyclictest0-21swapper/209:25:352
1281599240,23cyclictest6535-21diskmemload09:31:452
1281599240,23cyclictest16232-21latency_hist12:40:012
1281599240,23cyclictest0-21swapper/212:20:382
1281599240,23cyclictest0-21swapper/209:19:122
1281599240,1cyclictest6535-21diskmemload11:09:322
12811992422,1cyclictest20136-21sed11:16:121
12811992422,1cyclictest0-21swapper/110:57:201
12811992422,1cyclictest0-21swapper/110:16:051
1281199240,24cyclictest0-21swapper/112:03:271
1281199240,24cyclictest0-21swapper/111:21:311
1281199240,23cyclictest6535-21diskmemload12:27:101
1281199240,23cyclictest0-21swapper/111:55:241
1281199240,23cyclictest0-21swapper/110:48:291
1281199240,0cyclictest0-21swapper/111:41:051
12810992424,0cyclictest0-21swapper/011:40:400
1281099242,21cyclictest62550irq/127-eno112:32:440
12810992422,1cyclictest0-21swapper/009:20:340
1281099240,24cyclictest0-21swapper/010:04:000
1281099240,23cyclictest4920-21awk08:00:010
1281099240,23cyclictest4920-21awk08:00:010
1281099240,23cyclictest31209-21sh10:56:560
1281099240,23cyclictest13984-21ssh10:41:180
1281099240,23cyclictest0-21swapper/010:20:370
1281099240,1cyclictest0-21swapper/009:10:490
1281099240,0cyclictest0-21swapper/011:21:530
12820992321,1cyclictest14982-21sed11:11:143
12820992320,2cyclictest609-21rs:main3
12820992320,2cyclictest11979-21ssh10:40:593
1282099230,2cyclictest9583-21ssh10:38:053
1282099230,23cyclictest0-21swapper/312:20:383
1282099230,23cyclictest0-21swapper/311:52:483
1282099230,23cyclictest0-21swapper/310:05:383
1282099230,23cyclictest0-21swapper/309:25:353
1282099230,22cyclictest6535-21diskmemload12:02:083
1282099230,22cyclictest3847-21ssh10:05:003
1282099230,22cyclictest3704-21ssh11:31:063
1282099230,22cyclictest16188-21grep11:41:143
1282099230,0cyclictest0-21swapper/311:20:543
1282099230,0cyclictest0-21swapper/309:19:123
12815992322,1cyclictest6535-21diskmemload09:47:362
12815992321,1cyclictest14980-21grep11:11:142
12815992320,2cyclictest21769-21grep08:35:002
12815992320,2cyclictest15912-21ssh10:16:002
12815992319,3cyclictest313-21systemd-journal10:35:012
1281599230,23cyclictest0-21swapper/210:05:382
1281599230,23cyclictest0-21swapper/209:58:022
1281599230,22cyclictest5256-21taskset08:01:052
1281599230,22cyclictest32044-21ssh10:58:092
1281599230,22cyclictest29459-21ssh11:25:172
1281599230,22cyclictest19979-21rm11:16:102
1281599230,22cyclictest16525-21ssh11:41:332
1281599230,21cyclictest0-21swapper/210:45:172
1281599230,0cyclictest0-21swapper/211:31:022
1281599230,0cyclictest0-21swapper/209:13:542
12811992323,0cyclictest6535-21diskmemload10:12:091
12811992323,0cyclictest0-21swapper/109:15:211
12811992323,0cyclictest0-21swapper/107:56:051
12811992323,0cyclictest0-21swapper/107:56:051
12811992321,1cyclictest0-21swapper/109:55:181
12811992321,1cyclictest0-21swapper/107:25:021
12811992320,2cyclictest11129-21sh11:36:481
1281199230,2cyclictest15537-21diskmemload12:10:581
1281199230,23cyclictest0-21swapper/111:11:051
1281199230,23cyclictest0-21swapper/110:26:451
1281199230,23cyclictest0-21swapper/109:39:401
1281199230,23cyclictest0-21swapper/109:14:001
1281199230,22cyclictest23143-21rm10:50:561
1281199230,22cyclictest18035-21sshd09:20:031
1281199230,22cyclictest13591-21diskmemload09:44:501
1281199230,0cyclictest6535-21diskmemload12:23:561
1281199230,0cyclictest0-21swapper/111:28:481
1281199230,0cyclictest0-21swapper/110:05:171
12810992323,0cyclictest0-21swapper/012:17:520
12810992323,0cyclictest0-21swapper/012:07:370
12810992323,0cyclictest0-21swapper/011:26:210
12810992323,0cyclictest0-21swapper/011:00:550
12810992323,0cyclictest0-21swapper/010:46:060
12810992323,0cyclictest0-21swapper/009:17:380
12810992322,0cyclictest0-21swapper/012:01:330
12810992321,1cyclictest31987-21apt-get08:55:020
12810992321,1cyclictest0-21swapper/010:26:140
12810992321,1cyclictest0-21swapper/009:54:560
12810992321,1cyclictest0-21swapper/009:38:120
12810992321,1cyclictest0-21swapper/009:26:070
1281099230,23cyclictest0-21swapper/011:50:120
1281099230,23cyclictest0-21swapper/011:30:220
1281099230,23cyclictest0-21swapper/009:56:030
1281099230,22cyclictest0-21swapper/012:10:360
1281099230,22cyclictest0-21swapper/011:55:370
1281099230,22cyclictest0-21swapper/010:50:190
1281099230,21cyclictest0-21swapper/011:15:390
1281099230,0cyclictest0-21swapper/009:30:360
12820992222,0cyclictest6535-21diskmemload12:13:453
12820992222,0cyclictest0-21swapper/312:05:463
12820992222,0cyclictest0-21swapper/311:15:413
12820992222,0cyclictest0-21swapper/310:55:203
12820992222,0cyclictest0-21swapper/310:26:183
12820992222,0cyclictest0-21swapper/310:20:263
12820992220,1cyclictest3604-21rm10:32:313
12820992220,1cyclictest29312-21apt-get08:51:063
12820992220,1cyclictest21770-21latency_hist08:35:003
12820992219,2cyclictest6535-21diskmemload11:25:393
1282099220,22cyclictest6535-21diskmemload09:30:403
1282099220,22cyclictest0-21swapper/311:02:453
1282099220,21cyclictest7985-21sh12:31:253
1282099220,21cyclictest6535-21diskmemload09:45:263
1282099220,21cyclictest32378-21ssh12:25:383
1282099220,21cyclictest2768-21sh09:35:083
1282099220,21cyclictest12684-21ssh10:11:483
1282099220,21cyclictest0-21swapper/309:41:353
1282099220,21cyclictest0-21swapper/308:46:053
1282099220,21cyclictest0-21swapper/308:01:053
1282099220,1cyclictest0-21swapper/311:56:063
12815992222,0cyclictest6535-21diskmemload10:20:262
12815992222,0cyclictest0-21swapper/212:29:552
12815992220,1cyclictest0-21swapper/211:35:202
1281599220,2cyclictest6630-21ssh12:01:452
1281599220,22cyclictest6535-21diskmemload12:31:222
1281599220,22cyclictest13668-21ssh10:13:142
1281599220,21cyclictest5717-21ssh10:35:092
1281599220,21cyclictest3365-21dump-pmu-power12:00:012
1281599220,21cyclictest24522-21apt-get08:41:062
1281599220,21cyclictest23200-21ssh10:51:002
1281599220,21cyclictest22833-21sh11:47:372
1281599220,21cyclictest12063-21apt-get10:41:032
1281599220,21cyclictest0-21swapper/212:15:052
1281599220,21cyclictest0-21swapper/211:50:492
1281599220,21cyclictest0-21swapper/211:01:042
1281599220,21cyclictest0-21swapper/210:00:072
1281599220,21cyclictest0-21swapper/209:35:082
1281599220,1cyclictest28801-21ssh10:26:132
1281599220,1cyclictest18890-21ssh12:13:212
12811992222,0cyclictest6535-21diskmemload11:07:171
12811992221,1cyclictest21832-21ssh10:20:511
12811992220,1cyclictest0-21swapper/111:00:191
12811992220,1cyclictest0-21swapper/110:40:161
1281199220,21cyclictest31377-21ssh10:00:471
1281199220,21cyclictest0-21swapper/112:15:101
1281199220,21cyclictest0-21swapper/109:45:241
1281199220,21cyclictest0-21swapper/109:25:031
1281199220,21cyclictest0-21swapper/108:05:011
1281199220,1cyclictest5794-21ssh12:30:521
12810992222,0cyclictest6535-21diskmemload10:10:270
12810992221,1cyclictest4501-21apt-get09:06:050
1281099220,21cyclictest7430-21ssh11:05:570
1281099220,21cyclictest606-21dbus-daemon08:20:000
1281099220,21cyclictest0-21swapper/012:20:150
1281099220,21cyclictest0-21swapper/010:05:140
1281099220,1cyclictest16978-21perf08:25:000
1281099220,1cyclictest0-21swapper/009:05:000
12820992119,1cyclictest31362-21apt-get08:55:023
1282099210,0cyclictest20741-21apt-get07:26:063
1282099210,0cyclictest0-21swapper/311:05:213
1282099210,0cyclictest0-21swapper/309:20:453
12815992120,0cyclictest32106-21apt-get08:56:072
1281599210,21cyclictest0-21swapper/209:50:262
1281599210,21cyclictest0-21swapper/209:20:452
1281599210,0cyclictest0-21swapper/207:26:062
12811992120,1cyclictest0-21swapper/107:31:041
12811992119,1cyclictest354-21/usr/sbin/munin07:51:051
12811992119,1cyclictest25534-21apt-get07:36:061
1281199210,21cyclictest6535-21diskmemload11:45:541
1281199210,1cyclictest0-21swapper/107:11:051
12810992121,0cyclictest0-21swapper/008:41:060
1281099210,21cyclictest0-21swapper/011:45:030
1281099210,20cyclictest0-21swapper/007:51:050
12820992019,1cyclictest0-21swapper/308:15:013
12820992019,0cyclictest0-21swapper/308:21:063
1282099200,20cyclictest0-21swapper/308:06:073
1282099200,0cyclictest13135-21apt-get07:11:053
12815992020,0cyclictest0-21swapper/208:51:062
12815992020,0cyclictest0-21swapper/208:21:062
12815992019,1cyclictest12155-21perf08:15:012
1281599200,20cyclictest26914-21apt-get08:46:052
1281599200,20cyclictest0-21swapper/208:06:072
1281599200,0cyclictest0-21swapper/207:11:052
12811992020,0cyclictest0-21swapper/109:10:001
12811992020,0cyclictest0-21swapper/108:16:031
12811992020,0cyclictest0-21swapper/107:41:051
12811992019,0cyclictest14916-21apt-get08:21:051
12811992019,0cyclictest0-21swapper/107:46:051
12811992018,1cyclictest15529-21apt-get07:16:051
1281199200,0cyclictest0-21swapper/108:06:071
1281099200,0cyclictest0-21swapper/008:46:050
1281099200,0cyclictest0-21swapper/007:41:050
1281099200,0cyclictest0-21swapper/007:11:040
12820991919,0cyclictest0-21swapper/307:56:053
12820991919,0cyclictest0-21swapper/307:56:053
12820991917,2cyclictest24194-21idleruntime-cro08:40:003
12815991919,0cyclictest0-21swapper/207:56:052
12815991919,0cyclictest0-21swapper/207:56:052
12815991918,1cyclictest17310-21apt-get08:26:062
12815991917,1cyclictest24181-21munin-run08:40:002
12815991917,1cyclictest12484-21apt-get08:16:032
12811991919,0cyclictest0-21swapper/108:11:051
12810991919,0cyclictest0-21swapper/008:11:050
12810991919,0cyclictest0-21swapper/008:06:070
12810991919,0cyclictest0-21swapper/008:01:050
12810991919,0cyclictest0-21swapper/007:16:050
12820991818,0cyclictest0-21swapper/308:41:063
12820991818,0cyclictest0-21swapper/308:26:063
12820991817,1cyclictest17947-21apt-get07:21:043
12811991818,0cyclictest0-21swapper/107:21:041
1281099180,0cyclictest0-21swapper/007:21:050
1282099178,8cyclictest25164-21cron07:35:003
12820991717,0cyclictest0-21swapper/308:16:033
12820991717,0cyclictest0-21swapper/307:46:053
12815991717,0cyclictest0-21swapper/207:21:042
1281199170,16cyclictest1751-21perf09:00:011
12810991717,0cyclictest0-21swapper/007:46:040
12810991715,1cyclictest23136-21apt-get07:31:040
12810991715,1cyclictest0-21swapper/008:30:000
12810991715,1cyclictest0-21swapper/007:25:020
12815991616,0cyclictest30455-21apt-get07:46:052
12815991615,1cyclictest0-21swapper/207:31:042
1281099160,1cyclictest24172-21perf08:40:000
12820991513,1cyclictest4687-21cut09:06:063
1282099150,14cyclictest0-21swapper/309:01:053
12815991513,1cyclictest4684-21grep09:06:062
12811991515,0cyclictest0-21swapper/108:46:051
12811991514,1cyclictest0-21swapper/108:42:291
1281199150,8cyclictest29312-21apt-get08:51:061
12810991513,1cyclictest30930-21sed08:51:150
12820991414,0cyclictest0-21swapper/307:52:133
1282099140,14cyclictest0-21swapper/307:40:253
1282099140,14cyclictest0-21swapper/307:35:353
1282099140,0cyclictest0-21swapper/307:16:593
12815991414,0cyclictest0-21swapper/209:00:102
1281599140,14cyclictest0-21swapper/207:52:462
1281599140,14cyclictest0-21swapper/207:40:252
1281599140,0cyclictest0-21swapper/207:36:062
1281599140,0cyclictest0-21swapper/207:16:592
1281199140,0cyclictest0-21swapper/108:35:341
1281199140,0cyclictest0-21swapper/108:25:231
12810991414,0cyclictest0-21swapper/007:35:150
1281099140,0cyclictest0-21swapper/008:30:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional