You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 19:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Apr 26, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1885423826,0sleep20-21swapper/206:54:042
304450350,0irq/25-eth10-21swapper/306:52:423
1888723423,0sleep10-21swapper/106:54:271
1277023228,0sleep00-21swapper/006:52:300
339960,0migration/39236-21sh09:30:383
339960,0migration/38093-21sh10:08:453
339960,0migration/3487-21sh10:05:293
339960,0migration/332361-21sh10:45:163
339960,0migration/331755-21sh11:03:593
339960,0migration/323053-21munin-node08:57:403
339960,0migration/315218-21sh11:54:413
29725060,0irq/27-eth0-tx-14602-21munin-node07:42:410
29715060,0irq/26-eth0-rx-23198-21ssh11:59:373
29715060,0irq/26-eth0-rx-21292-21ssh10:17:383
29715060,0irq/26-eth0-rx-19443-21ps09:37:383
192219966,0cyclictest0-21swapper/209:48:532
192219966,0cyclictest0-21swapper/209:10:252
192219960,0cyclictest0-21swapper/211:00:462
192109966,0cyclictest17331-21diskmemload09:50:511
19160,0ktimersoftd/117331-21diskmemload09:59:311
149960,0migration/031715-21unixbench_singl10:22:450
149960,0migration/031558-21taskset11:44:510
149960,0migration/025133-21sh09:20:000
149960,0migration/023738-21sh10:59:030
149960,0migration/022368-21munin-node11:17:400
149960,0migration/015680-21sh10:33:320
4150,0ktimersoftd/00-21swapper/010:53:370
339950,0migration/39697-21munin-node10:32:353
339950,0migration/38224-21latency_hist11:52:213
339950,0migration/35306-21munin-node08:47:353
339950,0migration/34277-21kthreadcore07:32:393
339950,0migration/329323-21kthreadcore09:02:403
339950,0migration/328322-21kthreadcore07:27:393
339950,0migration/326192-21latency_hist09:22:213
339950,0migration/325004-21munin-node11:42:333
339950,0migration/323454-21sh11:39:393
339950,0migration/31636-21taskset07:54:133
339950,0migration/315278-21taskset08:06:583
339950,0migration/314500-21kthreadcore09:32:403
339950,0migration/314480-21hwlatdetect07:17:353
339950,0migration/312499-21munin-node07:12:433
339950,0migration/311766-21munin-node08:52:363
339950,0migration/310660-21runrttasks09:52:363
29725050,0irq/27-eth0-tx-9008-21tune2fs11:52:342
29725050,0irq/27-eth0-tx-8898-21munin-node08:02:390
29725050,0irq/27-eth0-tx-22347-21ssh12:18:042
29725050,0irq/27-eth0-tx-17557-21ssh08:57:270
29725050,0irq/27-eth0-tx-17333-21ssh09:56:342
29725050,0irq/27-eth0-tx-14681-21ssh12:14:042
29725050,0irq/27-eth0-tx-1373-21entropy10:47:342
29725050,0irq/27-eth0-tx-0-21swapper/211:59:372
29725050,0irq/27-eth0-tx-0-21swapper/211:39:572
29725050,0irq/27-eth0-tx-0-21swapper/210:44:162
29725050,0irq/27-eth0-tx-0-21swapper/008:48:570
29725050,0irq/27-eth0-tx-0-21swapper/008:17:570
29715050,0irq/26-eth0-rx-4598-21kthreadcore09:47:373
29715050,0irq/26-eth0-rx-3831-21kthreadcore10:27:373
29715050,0irq/26-eth0-rx-30706-21which11:22:433
29715050,0irq/26-eth0-rx-21627-21kthreadcore07:22:383
29715050,0irq/26-eth0-rx-18761-21cut11:17:393
29715050,0irq/26-eth0-rx-17182-21ssh10:57:323
29715050,0irq/26-eth0-rx-1206-21cpuspeed_turbos10:47:333
29715050,0irq/26-eth0-rx-10700-21basename09:12:353
29715050,0irq/26-eth0-rx-0-21swapper/312:11:193
29715050,0irq/26-eth0-rx-0-21swapper/312:05:283
29715050,0irq/26-eth0-rx-0-21swapper/311:12:353
29715050,0irq/26-eth0-rx-0-21swapper/311:08:303
29715050,0irq/26-eth0-rx-0-21swapper/310:39:003
29715050,0irq/26-eth0-rx-0-21swapper/310:14:063
29715050,0irq/26-eth0-rx-0-21swapper/310:01:563
29715050,0irq/26-eth0-rx-0-21swapper/309:17:383
29715050,0irq/26-eth0-rx-0-21swapper/309:07:433
29715050,0irq/26-eth0-rx-0-21swapper/307:10:573
259950,0migration/218883-21sh09:17:352
192219955,0cyclictest0-21swapper/212:26:232
192219955,0cyclictest0-21swapper/212:06:122
192219955,0cyclictest0-21swapper/210:52:252
192219955,0cyclictest0-21swapper/210:26:052
192219955,0cyclictest0-21swapper/207:32:402
192219952,0cyclictest17295-21sadc10:17:212
192219950,0cyclictest0-21swapper/211:30:532
192219950,0cyclictest0-21swapper/211:23:382
192219950,0cyclictest0-21swapper/210:33:112
192219950,0cyclictest0-21swapper/208:27:412
192219950,0cyclictest0-21swapper/207:37:422
192109955,0cyclictest0-21swapper/111:38:121
192109955,0cyclictest0-21swapper/109:39:291
192109955,0cyclictest0-21swapper/109:36:491
192109955,0cyclictest0-21swapper/109:07:011
192109950,0cyclictest0-21swapper/110:07:241
192099955,0cyclictest0-21swapper/009:42:400
192099950,0cyclictest0-21swapper/011:38:230
192099950,0cyclictest0-21swapper/011:33:020
192099950,0cyclictest0-21swapper/011:06:130
192099950,0cyclictest0-21swapper/009:33:030
149950,0migration/09422-21latency_hist10:12:210
149950,0migration/08448-21aten_r1power_fr11:52:320
149950,0migration/07491-21proc_pri09:47:410
149950,0migration/05711-21kthreadcore07:32:390
149950,0migration/04847-21kthreadcore08:22:380
149950,0migration/04741-21kthreadcore11:27:380
149950,0migration/03891-21kthreadcore10:47:380
149950,0migration/032702-21latency_hist07:07:220
149950,0migration/031442-21unixbench_singl10:42:460
149950,0migration/028441-21runrttasks08:37:410
149950,0migration/028053-21aten_r1power_vo07:52:340
149950,0migration/027210-21cpuspeed_turbos07:27:350
149950,0migration/026909-21munin-node07:02:370
149950,0migration/025099-21kthreadcore07:47:390
149950,0migration/019069-21kthreadcore10:37:390
149950,0migration/017834-21kthreadcore11:57:380
149950,0migration/015193-21latency09:52:390
149950,0migration/013516-21munin-node07:37:430
149950,0migration/01187-21taskset10:27:300
149950,0migration/011405-21fschecks_count08:52:340
149950,0migration/010157-21cpuspeed_turbos09:12:330
8215040,0irq/24-0000:00:0-21swapper/207:02:352
4140,0ktimersoftd/00-21swapper/010:17:490
339940,0migration/33484-21kernelversion07:57:383
339940,0migration/330832-21diskmemload12:24:273
339940,0migration/323961-21kthreadcore08:12:383
339940,0migration/319724-21cpuspeed_turbos06:57:343
339940,0migration/319069-21kthreadcore07:42:393
339940,0migration/313984-21kthreadcore08:27:393
339940,0migration/310118-21kthreadcore07:37:393
29725040,0irq/27-eth0-tx-335-21sed12:07:342
29725040,0irq/27-eth0-tx-21056-21kthreadcore10:17:382
29725040,0irq/27-eth0-tx-17874-21ssh09:57:282
29725040,0irq/27-eth0-tx-15081-21ssh11:33:352
29725040,0irq/27-eth0-tx-0-21swapper/211:02:382
29725040,0irq/27-eth0-tx-0-21swapper/210:27:342
29725040,0irq/27-eth0-tx-0-21swapper/210:07:302
29725040,0irq/27-eth0-tx-0-21swapper/209:43:102
29725040,0irq/27-eth0-tx-0-21swapper/209:38:032
29725040,0irq/27-eth0-tx-0-21swapper/209:27:482
29725040,0irq/27-eth0-tx-0-21swapper/209:22:312
29725040,0irq/27-eth0-tx-0-21swapper/209:12:532
29725040,0irq/27-eth0-tx-0-21swapper/209:02:352
29725040,0irq/27-eth0-tx-0-21swapper/008:09:100
29715040,0irq/26-eth0-rx-0-21swapper/312:18:263
29715040,0irq/26-eth0-rx-0-21swapper/312:12:363
29715040,0irq/26-eth0-rx-0-21swapper/311:32:443
29715040,0irq/26-eth0-rx-0-21swapper/311:28:103
29715040,0irq/26-eth0-rx-0-21swapper/310:52:543
29715040,0irq/26-eth0-rx-0-21swapper/310:22:313
29715040,0irq/26-eth0-rx-0-21swapper/309:42:383
29715040,0irq/26-eth0-rx-0-21swapper/308:35:183
29715040,0irq/26-eth0-rx-0-21swapper/307:02:403
259940,0migration/22828-21munin-node08:42:402
259940,0migration/22828-21munin-node08:42:402
259940,0migration/226598-21fschecks_time10:02:352
259940,0migration/225418-21runrttasks06:57:452
259940,0migration/221818-21runrttasks08:10:542
259940,0migration/221076-21latency_hist07:47:222
259940,0migration/219346-21munin-node07:17:432
259940,0migration/219064-21kthreadcore10:37:392
259940,0migration/215116-21kthreadcore08:52:382
259940,0migration/213510-21kthreadcore09:32:392
259940,0migration/21099-21hwlatdetect11:47:362
259940,0migration/210830-21kthreadcore11:12:382
249940,0watchdog/2718-21ssh11:07:272
249940,0watchdog/224903-21cut08:37:402
249940,0watchdog/217557-21fschecks_time11:17:352
249940,0watchdog/20-21swapper/211:42:352
249940,0watchdog/20-21swapper/208:57:362
249940,0watchdog/20-21swapper/208:47:322
249940,0watchdog/20-21swapper/208:02:402
249940,0watchdog/20-21swapper/207:07:442
192219943,0cyclictest7996-21awk07:12:392
192219943,0cyclictest3556-21lldpd08:01:572
192219943,0cyclictest27959-21awk07:27:382
192219943,0cyclictest1916-21sadc07:57:222
192109944,0cyclictest17331-21diskmemload10:26:091
192109944,0cyclictest0-21swapper/109:07:481
192109943,0cyclictest3556-21lldpd10:19:571
192109943,0cyclictest3556-21lldpd07:40:271
192109943,0cyclictest3514-21snmpd09:28:161
192109943,0cyclictest3514-21snmpd09:12:461
192109943,0cyclictest3514-21snmpd07:49:161
192109943,0cyclictest3514-21snmpd07:34:461
192109943,0cyclictest3241-21irqbalance11:57:291
192109943,0cyclictest3241-21irqbalance11:14:391
192109943,0cyclictest3241-21irqbalance11:04:091
192109943,0cyclictest3241-21irqbalance10:52:391
192109943,0cyclictest3241-21irqbalance10:47:591
192109943,0cyclictest3241-21irqbalance09:44:201
192109943,0cyclictest3241-21irqbalance09:17:301
192109943,0cyclictest3241-21irqbalance08:52:501
192109943,0cyclictest3241-21irqbalance07:22:301
192109943,0cyclictest3241-21irqbalance07:12:301
192109943,0cyclictest3241-21irqbalance07:02:301
192109943,0cyclictest30797-21awk08:42:371
192109943,0cyclictest30797-21awk08:42:371
192109943,0cyclictest25897-21awk11:22:361
192109943,0cyclictest24040-21awk08:37:381
192109943,0cyclictest23201-21ps08:12:381
192109943,0cyclictest2076-21awk10:27:341
192109943,0cyclictest20302-21awk06:57:371
192109943,0cyclictest18513-21awk08:57:371
192109943,0cyclictest1797-21awk11:07:371
192109943,0cyclictest17435-21awk08:32:371
192109943,0cyclictest15484-21awk07:42:361
192109943,0cyclictest14546-21awk07:17:361
192099944,0cyclictest27670-21kworker/0:209:57:390
192099943,0cyclictest8984-21awk12:12:350
192099943,0cyclictest3514-21snmpd11:08:320
192099943,0cyclictest3241-21irqbalance12:22:290
192099943,0cyclictest3241-21irqbalance12:17:290
192099943,0cyclictest3241-21irqbalance11:13:490
192099943,0cyclictest3241-21irqbalance10:04:000
192099943,0cyclictest32131-21sadc12:07:210
192099943,0cyclictest30723-21awk08:42:360
192099943,0cyclictest30723-21awk08:42:360
192099943,0cyclictest25969-21awk11:22:370
192099943,0cyclictest19108-21awk09:37:370
192099943,0cyclictest10484-21awk10:12:360
179940,0migration/19340-21aten_r1power_en10:32:331
179940,0migration/18782-21munin-node11:52:341
179940,0migration/13273-21aten_r1power_vo08:22:331
179940,0migration/130243-21switchtime12:02:431
179940,0migration/124690-21fschecks_time12:22:341
179940,0migration/123113-21sensors_fan10:37:431
179940,0migration/12262-21kthreadcore07:07:381
179940,0migration/121576-21taskset08:08:051
179940,0migration/119443-21kthreadcore10:57:381
179940,0migration/114628-21kthreadcore08:27:391
169940,0watchdog/1798-21ssh10:06:191
169940,0watchdog/14471-21df08:47:321
169940,0watchdog/129991-21cat07:27:401
169940,0watchdog/11749-21memory08:17:401
169940,0watchdog/113870-21cut11:32:391
169940,0watchdog/113530-21missed_timers12:12:391
169940,0watchdog/10-21swapper/112:07:391
169940,0watchdog/10-21swapper/111:47:351
169940,0watchdog/10-21swapper/111:42:351
169940,0watchdog/10-21swapper/111:17:351
169940,0watchdog/10-21swapper/109:22:441
149940,0migration/09996-21kthreadcore07:12:400
149940,0migration/06710-21sh12:09:100
149940,0migration/04859-21kthreadcore11:47:390
149940,0migration/04303-21kthreadcore09:27:380
149940,0migration/028514-21runrttasks08:16:270
149940,0migration/027034-21gltestperf09:22:350
149940,0migration/023824-21kthreadcore06:57:390
149940,0migration/017061-21fschecks_count08:32:350
339930,0migration/324100-21kthreadcore07:47:383
29715030,0irq/26-eth0-rx-0-21swapper/308:42:333
29715030,0irq/26-eth0-rx-0-21swapper/308:42:333
29715030,0irq/26-eth0-rx-0-21swapper/308:22:323
29715030,0irq/26-eth0-rx-0-21swapper/308:17:333
29715030,0irq/26-eth0-rx-0-21swapper/308:07:333
259930,0migration/29533-21runrttasks08:26:282
249930,0watchdog/20-21swapper/208:32:402
192219932,0cyclictest3556-21lldpd07:47:282
192219932,0cyclictest23019-21awk08:12:362
192219932,0cyclictest20097-21latency_hist07:22:222
192219930,0cyclictest29443-21perl08:17:352
192109933,0cyclictest3556-21lldpd09:52:271
192109932,0cyclictest9780-21awk08:02:371
192109932,0cyclictest3144-21awk07:57:371
192109932,0cyclictest26161-21cat10:42:351
192099933,0cyclictest27670-21kworker/0:209:02:390
192099933,0cyclictest27670-21kworker/0:208:27:250
192099933,0cyclictest27670-21kworker/0:207:57:290
192099933,0cyclictest27670-21kworker/0:207:22:250
192099933,0cyclictest27670-21kworker/0:207:17:230
192099932,0cyclictest1889-21cpuspeed_turbos09:07:340
169930,0watchdog/10-21swapper/112:18:431
169930,0watchdog/10-21swapper/111:27:231
169930,0watchdog/10-21swapper/110:12:391
169930,0watchdog/10-21swapper/107:52:401
29715020,0irq/26-eth0-rx-0-21swapper/308:39:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional