You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 14:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Apr 08, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2759523624,0sleep00-21swapper/006:59:000
2712223525,0sleep30-21swapper/306:54:273
2739523324,0sleep10-21swapper/106:56:411
2745922824,0sleep20-21swapper/206:57:302
35160,0ktimersoftd/30-21swapper/307:19:243
339960,0migration/37225-21sh11:48:143
339960,0migration/36785-21sh11:25:443
339960,0migration/35670-21sh12:04:543
339960,0migration/332555-21sh09:00:443
339960,0migration/332108-21munin-node12:24:163
339960,0migration/332102-21sh10:42:033
339960,0migration/324950-21sh09:36:433
339960,0migration/315966-21sh10:10:403
339960,0migration/315601-21timerandwakeup09:49:253
29725060,0irq/27-eth0-tx-3047-21munin-node07:29:230
29715060,0irq/26-eth0-rx-23517-21vmstat10:14:273
276679960,0cyclictest25723-21diskmemload10:33:010
276679960,0cyclictest25723-21diskmemload09:17:580
27160,0ktimersoftd/20-21swapper/207:19:242
149960,0migration/06476-21sh12:07:170
149960,0migration/031757-21sh09:59:250
149960,0migration/031585-21sh10:19:370
149960,0migration/02084-21aten_r1power_vo09:24:160
8215050,0irq/24-0000:00:12386-21munin-run08:49:042
4150,0ktimersoftd/00-21swapper/009:29:090
339950,0migration/39776-21switchtime07:54:253
339950,0migration/38042-21runrttasks09:44:493
339950,0migration/36746-21kthreadcore09:24:223
339950,0migration/34857-21kthreadcore09:04:193
339950,0migration/34857-21kthreadcore09:04:193
339950,0migration/3398-21kthreadcore07:24:183
339950,0migration/331603-21kthreadcore07:49:193
339950,0migration/330611-21sh08:34:253
339950,0migration/330245-21kthreadcore06:59:203
339950,0migration/326665-21df_inode09:19:153
339950,0migration/323685-21needreboot08:29:213
339950,0migration/321601-21kthreadcore08:04:203
339950,0migration/316783-21taskset09:11:253
339950,0migration/313011-21kthreadcore07:59:203
339950,0migration/312342-21kthreadcore11:49:173
339950,0migration/310455-21munin-node08:19:213
29725050,0irq/27-eth0-tx-9774-21munin-node07:34:230
29725050,0irq/27-eth0-tx-5903-21munin-node08:44:130
29725050,0irq/27-eth0-tx-23518-21python09:54:242
29725050,0irq/27-eth0-tx-22821-21sendmail_mailqu10:34:232
29725050,0irq/27-eth0-tx-0-21swapper/210:46:272
29725050,0irq/27-eth0-tx-0-21swapper/008:59:080
29725050,0irq/27-eth0-tx-0-21swapper/006:59:260
29715050,0irq/26-eth0-rx-760-21runrttasks11:04:153
29715050,0irq/26-eth0-rx-32576-21ssh09:40:333
29715050,0irq/26-eth0-rx-31550-21python09:59:243
29715050,0irq/26-eth0-rx-30639-21sed10:59:253
29715050,0irq/26-eth0-rx-28624-21grep11:39:193
29715050,0irq/26-eth0-rx-2162-21aten_r1power_cu07:04:143
29715050,0irq/26-eth0-rx-18938-21kthreadcore11:54:203
29715050,0irq/26-eth0-rx-18112-21rm09:14:133
29715050,0irq/26-eth0-rx-17808-21grep08:49:213
29715050,0irq/26-eth0-rx-15893-21taskset10:52:163
29715050,0irq/26-eth0-rx-0-21swapper/312:18:523
29715050,0irq/26-eth0-rx-0-21swapper/312:13:453
29715050,0irq/26-eth0-rx-0-21swapper/312:00:063
29715050,0irq/26-eth0-rx-0-21swapper/311:34:193
29715050,0irq/26-eth0-rx-0-21swapper/311:32:003
29715050,0irq/26-eth0-rx-0-21swapper/311:19:233
29715050,0irq/26-eth0-rx-0-21swapper/310:58:103
29715050,0irq/26-eth0-rx-0-21swapper/310:46:483
29715050,0irq/26-eth0-rx-0-21swapper/310:37:453
29715050,0irq/26-eth0-rx-0-21swapper/310:29:183
29715050,0irq/26-eth0-rx-0-21swapper/310:24:563
29715050,0irq/26-eth0-rx-0-21swapper/310:08:403
29715050,0irq/26-eth0-rx-0-21swapper/309:54:373
276709955,0cyclictest0-21swapper/211:37:112
276709954,0cyclictest17397-21sh09:32:572
276709950,0cyclictest0-21swapper/212:10:462
276709950,0cyclictest0-21swapper/209:51:152
276699950,0cyclictest0-21swapper/110:37:081
276699950,0cyclictest0-21swapper/109:38:291
276679955,0cyclictest0-21swapper/012:24:280
276679955,0cyclictest0-21swapper/011:08:480
276679955,0cyclictest0-21swapper/011:00:360
276679950,0cyclictest0-21swapper/012:00:490
276679950,0cyclictest0-21swapper/010:07:090
276679950,0cyclictest0-21swapper/009:43:110
27150,0ktimersoftd/20-21swapper/211:52:482
259950,0migration/219998-21kthreadcore08:04:202
249950,0watchdog/20-21swapper/212:26:052
179950,0migration/16682-21latency_hist12:29:021
179950,0migration/124448-21munin-node08:09:161
179950,0migration/116257-21diskmemload11:14:031
179950,0migration/112329-21kthreadcore10:09:201
149950,0migration/07211-21missed_timers09:44:210
149950,0migration/06976-21kthreadcore07:54:190
149950,0migration/06890-21taskset11:26:020
149950,0migration/06865-21taskset11:47:090
149950,0migration/04543-21mdstat08:39:200
149950,0migration/031621-21sh11:22:120
149950,0migration/031592-21taskset11:43:160
149950,0migration/031078-21taskset08:35:480
149950,0migration/030254-21taskset08:11:460
149950,0migration/030183-21kthreadcore09:19:200
149950,0migration/029188-21df_abs07:24:140
149950,0migration/029177-21switchtime12:19:240
149950,0migration/024896-21kthreadcore07:44:190
149950,0migration/022935-21kthreadcore09:34:210
149950,0migration/021648-21kthreadcore08:29:200
149950,0migration/021497-21kthreadcore09:54:200
149950,0migration/020375-21kthreadcore10:14:200
149950,0migration/019719-21kthreadcore10:34:190
149950,0migration/01942-21kernelversion10:44:180
149950,0migration/018016-21taskset08:28:270
149950,0migration/016191-21sh10:11:200
149950,0migration/015293-21taskset10:50:300
149950,0migration/014955-21kthreadcore09:49:200
149950,0migration/014155-21sh11:50:030
149950,0migration/012228-21kthreadcore07:09:200
149950,0migration/010006-21kthreadcore11:09:190
339940,0migration/37984-21kthreadcore07:29:213
339940,0migration/327252-21kthreadcore07:44:203
339940,0migration/318736-21kthreadcore07:39:193
29725040,0irq/27-eth0-tx-6624-21ssh09:24:222
29725040,0irq/27-eth0-tx-6398-21ssh11:24:392
29725040,0irq/27-eth0-tx-26022-21ssh09:39:122
29725040,0irq/27-eth0-tx-25723-21diskmemload10:20:092
29725040,0irq/27-eth0-tx-24455-21ssh10:17:102
29725040,0irq/27-eth0-tx-24433-21ssh09:15:002
29725040,0irq/27-eth0-tx-10252-21grep11:29:192
29725040,0irq/27-eth0-tx-0-21swapper/212:19:052
29725040,0irq/27-eth0-tx-0-21swapper/211:54:202
29725040,0irq/27-eth0-tx-0-21swapper/211:44:182
29725040,0irq/27-eth0-tx-0-21swapper/211:15:222
29725040,0irq/27-eth0-tx-0-21swapper/211:04:462
29725040,0irq/27-eth0-tx-0-21swapper/210:59:412
29725040,0irq/27-eth0-tx-0-21swapper/210:54:332
29725040,0irq/27-eth0-tx-0-21swapper/210:29:272
29725040,0irq/27-eth0-tx-0-21swapper/210:04:312
29725040,0irq/27-eth0-tx-0-21swapper/209:59:092
29725040,0irq/27-eth0-tx-0-21swapper/209:34:252
29725040,0irq/27-eth0-tx-0-21swapper/008:21:050
29725040,0irq/27-eth0-tx-0-21swapper/008:14:260
29725040,0irq/27-eth0-tx-0-21swapper/008:04:210
29725040,0irq/27-eth0-tx-0-21swapper/007:39:230
29715040,0irq/26-eth0-rx-0-21swapper/312:19:143
29715040,0irq/26-eth0-rx-0-21swapper/311:17:493
29715040,0irq/26-eth0-rx-0-21swapper/311:09:283
29715040,0irq/26-eth0-rx-0-21swapper/310:19:573
29715040,0irq/26-eth0-rx-0-21swapper/309:33:253
29715040,0irq/26-eth0-rx-0-21swapper/308:09:143
276709944,0cyclictest0-21swapper/212:14:242
276709944,0cyclictest0-21swapper/211:59:062
276709943,0cyclictest9706-21awk07:09:172
276709943,0cyclictest3514-21snmpd07:08:312
276709943,0cyclictest3241-21irqbalance11:39:212
276709943,0cyclictest3241-21irqbalance10:24:312
276709943,0cyclictest3241-21irqbalance08:49:122
276709943,0cyclictest3241-21irqbalance08:40:022
276709943,0cyclictest3241-21irqbalance08:25:022
276709943,0cyclictest3241-21irqbalance08:19:222
276709943,0cyclictest3241-21irqbalance08:14:122
276709943,0cyclictest3241-21irqbalance08:09:122
276709943,0cyclictest3241-21irqbalance08:02:522
276709943,0cyclictest3241-21irqbalance07:45:022
276709943,0cyclictest3241-21irqbalance07:41:222
276709943,0cyclictest3241-21irqbalance07:35:122
276709943,0cyclictest3241-21irqbalance07:25:022
276709943,0cyclictest3241-21irqbalance07:15:122
276709943,0cyclictest30627-21awk07:49:182
276709943,0cyclictest28858-21awk06:59:182
276709943,0cyclictest26931-21awk08:59:182
276709943,0cyclictest2553-21awk09:44:172
276709943,0cyclictest25424-21awk11:19:182
276709943,0cyclictest20266-21awk08:54:182
276709943,0cyclictest10748-21awk09:09:172
276699944,0cyclictest0-21swapper/111:06:281
276699944,0cyclictest0-21swapper/110:51:101
276699944,0cyclictest0-21swapper/107:29:221
276699943,0cyclictest9823-21awk07:09:181
276699943,0cyclictest3556-21lldpd12:15:061
276699943,0cyclictest3556-21lldpd11:59:351
276699943,0cyclictest3556-21lldpd11:29:061
276699943,0cyclictest3556-21lldpd11:19:061
276699943,0cyclictest3556-21lldpd10:22:061
276699943,0cyclictest3556-21lldpd08:47:351
276699943,0cyclictest3556-21lldpd08:14:051
276699943,0cyclictest3556-21lldpd07:53:351
276699943,0cyclictest3556-21lldpd07:45:351
276699943,0cyclictest3556-21lldpd07:26:361
276699943,0cyclictest3514-21snmpd12:09:171
276699943,0cyclictest3514-21snmpd11:52:471
276699943,0cyclictest3514-21snmpd11:45:021
276699943,0cyclictest3514-21snmpd08:32:461
276699943,0cyclictest3241-21irqbalance10:55:011
276699943,0cyclictest27069-21kthreadcore09:59:191
276699943,0cyclictest26955-21awk08:59:181
276699943,0cyclictest18288-21awk08:04:181
276699943,0cyclictest1017-21awk11:24:171
276679944,0cyclictest0-21swapper/011:31:300
276679944,0cyclictest0-21swapper/011:16:120
276679944,0cyclictest0-21swapper/010:28:450
276679943,0cyclictest8225-21awk12:09:160
276679943,0cyclictest3514-21snmpd10:39:160
276679943,0cyclictest3115-21awk07:04:190
276679943,0cyclictest25719-21sadc08:59:040
276679943,0cyclictest16343-21awk12:14:180
259940,0migration/28400-21sh11:09:052
259940,0migration/26493-21kthreadcore07:29:212
259940,0migration/25667-21kthreadcore07:54:192
259940,0migration/24192-21kthreadcore09:04:192
259940,0migration/24192-21kthreadcore09:04:192
259940,0migration/227821-21kthreadcore09:19:192
259940,0migration/227510-21kthreadcore10:39:182
259940,0migration/223150-21kthreadcore08:29:202
259940,0migration/212447-21kthreadcore10:09:202
249940,0watchdog/29713-21if_eth1.310:49:172
249940,0watchdog/20-21swapper/212:04:132
249940,0watchdog/20-21swapper/208:34:262
19140,0ktimersoftd/10-21swapper/110:29:061
179940,0migration/19708-21latency_hist07:34:041
179940,0migration/15039-21kthreadcore07:04:201
179940,0migration/128378-21kthreadcore12:19:191
179940,0migration/127811-21latency_hist06:59:041
179940,0migration/125968-21kthreadcore11:39:191
179940,0migration/12425-21kthreadcore12:04:191
179940,0migration/12269-21munin-node09:24:161
179940,0migration/119050-21kthreadcore11:14:201
179940,0migration/118097-21aten_r1power_cu09:14:131
179940,0migration/116787-21kthreadcore08:49:211
179940,0migration/114168-21kthreadcore08:24:201
179940,0migration/113587-21kthreadcore09:29:191
179940,0migration/112988-21kthreadcore09:49:191
169940,0watchdog/1989-21ssh09:22:141
169940,0watchdog/19062-21ssh09:07:301
169940,0watchdog/19062-21ssh09:07:301
169940,0watchdog/15251-21kthreadcore10:24:211
169940,0watchdog/132596-21iostat08:39:181
169940,0watchdog/131571-21ssh10:40:291
169940,0watchdog/130860-21sed08:34:261
169940,0watchdog/10-21swapper/111:56:411
169940,0watchdog/10-21swapper/110:06:051
169940,0watchdog/10-21swapper/109:39:251
149940,0migration/06552-21kthreadcore09:04:200
149940,0migration/06552-21kthreadcore09:04:200
149940,0migration/023163-21runrttasks10:55:120
149940,0migration/014495-21kthreadcore08:49:200
35130,0ktimersoftd/30-21swapper/307:16:183
29715030,0irq/26-eth0-rx-0-21swapper/308:48:413
29715030,0irq/26-eth0-rx-0-21swapper/308:40:413
29715030,0irq/26-eth0-rx-0-21swapper/308:24:453
29715030,0irq/26-eth0-rx-0-21swapper/308:14:163
29715030,0irq/26-eth0-rx-0-21swapper/307:34:143
29715030,0irq/26-eth0-rx-0-21swapper/307:11:533
276699933,0cyclictest3556-21lldpd07:55:051
276699932,0cyclictest3556-21lldpd09:54:061
276699932,0cyclictest3556-21lldpd08:19:051
276699932,0cyclictest3556-21lldpd08:00:361
276699932,0cyclictest3556-21lldpd07:14:061
276699932,0cyclictest3514-21snmpd11:35:471
276699932,0cyclictest2631-21awk09:44:181
276699932,0cyclictest25716-21awk10:59:181
276699932,0cyclictest20146-21kthreadcore10:14:201
276699932,0cyclictest17283-21awk07:39:171
276699930,0cyclictest27686-21port_sshpriv07:19:231
276679933,0cyclictest26526-21kworker/0:211:54:060
276679933,0cyclictest26526-21kworker/0:211:34:060
276679933,0cyclictest21982-21kworker/0:109:09:070
276679933,0cyclictest21982-21kworker/0:107:59:090
276679933,0cyclictest21982-21kworker/0:107:19:050
276679933,0cyclictest21982-21kworker/0:107:14:050
276679932,0cyclictest30587-21awk07:49:180
179930,0migration/14990-21kthreadcore10:44:191
179930,0migration/122182-21kthreadcore08:54:201
169930,0watchdog/10-21swapper/109:09:141
339920,0migration/319707-21diskstats08:54:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional