You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 16:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Jun 17, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/306:47:403
2410823425,0sleep20-21swapper/206:51:402
2409623221,0sleep00-21swapper/006:51:300
2384022622,0sleep10-21swapper/106:48:311
29715070,0irq/26-eth0-rx-31343-21chrt09:59:203
339960,0migration/37987-21sh09:06:363
339960,0migration/36660-21sh10:44:023
339960,0migration/36620-21sh10:03:043
339960,0migration/331267-21sh09:38:443
339960,0migration/316244-21sh10:32:293
339960,0migration/315449-21sh09:29:283
339960,0migration/314431-21sh11:49:583
29725060,0irq/27-eth0-tx-0-21swapper/007:47:470
29715060,0irq/26-eth0-rx-25585-21iostat_ios10:17:423
29715060,0irq/26-eth0-rx-10907-21kthreadcore11:07:403
242499960,0cyclictest0-21swapper/211:34:332
242489966,0cyclictest22667-21ssh11:14:261
242479960,0cyclictest0-21swapper/011:45:040
149960,0migration/07973-21aten_r1power_en11:07:340
149960,0migration/06287-21sh11:03:330
149960,0migration/05472-21aten2.4-expect07:02:370
149960,0migration/030718-21kthreadcore08:37:400
149960,0migration/030188-21munin-node10:17:470
149960,0migration/014732-21sh10:08:120
35150,0ktimersoftd/30-21swapper/310:58:163
35150,0ktimersoftd/30-21swapper/308:37:383
339950,0migration/36397-21taskset10:22:563
339950,0migration/34290-21kthreadcore09:42:423
339950,0migration/332071-21sendmail_mailtr07:42:463
339950,0migration/329579-21munin-node11:37:473
339950,0migration/329524-21kthreadcore08:07:443
339950,0migration/32915-21kthreadcore07:22:423
339950,0migration/325164-21idleruntime-cro07:17:263
339950,0migration/319769-21munin-node07:37:363
339950,0migration/31904-21kthreadcore09:22:393
339950,0migration/318773-21kthreadcore11:12:423
339950,0migration/318001-21kthreadcore09:52:403
339950,0migration/316082-21munin-node08:27:413
339950,0migration/313954-21latency_hist07:57:263
29725050,0irq/27-eth0-tx-16638-21kernelversion12:12:392
29725050,0irq/27-eth0-tx-0-21swapper/211:09:092
29715050,0irq/26-eth0-rx-9260-21fschecks_time09:07:373
29715050,0irq/26-eth0-rx-5801-21timerwakeupswit11:02:463
29715050,0irq/26-eth0-rx-3853-21kthreadcore12:02:433
29715050,0irq/26-eth0-rx-31588-21ssh09:00:063
29715050,0irq/26-eth0-rx-2766-21kthreadcore11:42:423
29715050,0irq/26-eth0-rx-0-21swapper/312:19:323
29715050,0irq/26-eth0-rx-0-21swapper/312:12:243
29715050,0irq/26-eth0-rx-0-21swapper/312:07:413
29715050,0irq/26-eth0-rx-0-21swapper/311:59:513
29715050,0irq/26-eth0-rx-0-21swapper/311:37:143
29715050,0irq/26-eth0-rx-0-21swapper/311:20:273
29715050,0irq/26-eth0-rx-0-21swapper/310:32:083
29715050,0irq/26-eth0-rx-0-21swapper/309:32:423
29715050,0irq/26-eth0-rx-0-21swapper/309:32:423
29715050,0irq/26-eth0-rx-0-21swapper/309:12:453
27150,0ktimersoftd/20-21swapper/211:23:212
259950,0migration/26040-21fschecks_time07:02:392
259950,0migration/228810-21kthreadcore08:07:442
259950,0migration/217579-21munin-node10:32:412
259950,0migration/212125-21aten_r1power_en07:07:372
242499950,0cyclictest0-21swapper/211:00:292
242499950,0cyclictest0-21swapper/209:34:062
242499950,0cyclictest0-21swapper/209:34:062
242499950,0cyclictest0-21swapper/208:53:162
242489955,0cyclictest0-21swapper/110:18:561
242489955,0cyclictest0-21swapper/109:09:051
242489955,0cyclictest0-21swapper/108:56:481
242489950,0cyclictest0-21swapper/111:06:231
242489950,0cyclictest0-21swapper/110:23:301
242489950,0cyclictest0-21swapper/110:00:201
242489950,0cyclictest0-21swapper/109:45:591
242489950,0cyclictest0-21swapper/107:00:451
242479955,0cyclictest0-21swapper/010:52:060
242479955,0cyclictest0-21swapper/010:15:500
242479955,0cyclictest0-21swapper/009:43:120
242479955,0cyclictest0-21swapper/008:59:220
242479955,0cyclictest0-21swapper/006:57:400
242479954,0cyclictest21660-21sed10:32:420
242479950,0cyclictest0-21swapper/012:20:140
242479950,0cyclictest0-21swapper/012:01:280
242479950,0cyclictest0-21swapper/011:23:380
242479950,0cyclictest0-21swapper/009:24:450
242479950,0cyclictest0-21swapper/007:52:510
249950,0watchdog/211175-21kthreadcore07:52:442
179950,0migration/19231-21unixbench-2d08:42:491
179950,0migration/19059-21kthreadcore07:02:421
179950,0migration/1736-21munin-node09:02:381
179950,0migration/130824-21munin-node09:37:471
179950,0migration/125439-21kthreadcore11:37:411
179950,0migration/125301-21proc_pri07:37:461
179950,0migration/122713-21sh10:53:561
179950,0migration/11065-21kthreadcore11:42:411
169950,0watchdog/15684-21unixbench_singl07:22:481
149950,0migration/09220-21munin-node08:42:490
149950,0migration/08357-21hddtemp_smartct11:47:380
149950,0migration/07785-21fschecks_count12:07:370
149950,0migration/05149-21sh10:22:400
149950,0migration/031104-21sh11:41:100
149950,0migration/02981-21kthreadcore09:02:430
149950,0migration/029766-21kthreadcore09:57:420
149950,0migration/027402-21kthreadcore10:57:430
149950,0migration/025334-21munin-node10:37:380
149950,0migration/024434-21fschecks_count11:17:380
149950,0migration/023734-21taskset09:35:070
149950,0migration/023734-21taskset09:35:070
149950,0migration/02333-21kthreadcore10:42:420
149950,0migration/022813-21sh08:53:080
149950,0migration/021997-21kthreadcore07:12:430
149950,0migration/021233-21kthreadcore07:37:410
149950,0migration/018716-21kthreadcore07:57:430
149950,0migration/016797-21idleruntime11:12:390
149950,0migration/016096-21taskset08:48:470
149950,0migration/016088-21latency_hist10:32:250
149950,0migration/012851-21hwlatdetect07:07:400
149950,0migration/011074-21kthreadcore11:27:410
8215040,0irq/24-0000:00:31546-21latency_hist11:42:252
339940,0migration/319970-21unixbench_multi07:57:493
339940,0migration/319900-21kthreadcore10:52:433
339940,0migration/312029-21kthreadcore08:47:423
29725040,0irq/27-eth0-tx-6976-21ssh10:04:022
29725040,0irq/27-eth0-tx-32330-21ssh10:42:282
29725040,0irq/27-eth0-tx-31587-21munin-node12:02:372
29725040,0irq/27-eth0-tx-29813-21ssh11:58:112
29725040,0irq/27-eth0-tx-23877-21telnet11:37:362
29725040,0irq/27-eth0-tx-13689-21ssh11:47:482
29725040,0irq/27-eth0-tx-0-21swapper/212:07:322
29725040,0irq/27-eth0-tx-0-21swapper/211:52:372
29725040,0irq/27-eth0-tx-0-21swapper/211:12:382
29725040,0irq/27-eth0-tx-0-21swapper/210:30:572
29725040,0irq/27-eth0-tx-0-21swapper/210:22:362
29725040,0irq/27-eth0-tx-0-21swapper/210:19:422
29725040,0irq/27-eth0-tx-0-21swapper/209:57:282
29725040,0irq/27-eth0-tx-0-21swapper/209:52:312
29725040,0irq/27-eth0-tx-0-21swapper/209:49:052
29725040,0irq/27-eth0-tx-0-21swapper/209:37:262
29725040,0irq/27-eth0-tx-0-21swapper/209:17:362
29725040,0irq/27-eth0-tx-0-21swapper/209:02:262
29725040,0irq/27-eth0-tx-0-21swapper/008:17:450
29725040,0irq/27-eth0-tx-0-21swapper/007:42:450
29725040,0irq/27-eth0-tx-0-21swapper/007:34:090
29725040,0irq/27-eth0-tx-0-21swapper/007:22:450
29715040,0irq/26-eth0-rx-30098-21python06:52:483
29715040,0irq/26-eth0-rx-13831-21smartctl07:32:383
29715040,0irq/26-eth0-rx-13376-21port_sshpriv11:27:443
29715040,0irq/26-eth0-rx-0-21swapper/311:52:343
29715040,0irq/26-eth0-rx-0-21swapper/311:23:183
29715040,0irq/26-eth0-rx-0-21swapper/310:47:283
29715040,0irq/26-eth0-rx-0-21swapper/310:37:333
29715040,0irq/26-eth0-rx-0-21swapper/310:12:253
29715040,0irq/26-eth0-rx-0-21swapper/310:09:153
29715040,0irq/26-eth0-rx-0-21swapper/309:48:153
29715040,0irq/26-eth0-rx-0-21swapper/309:17:443
29715040,0irq/26-eth0-rx-0-21swapper/308:53:293
29715040,0irq/26-eth0-rx-0-21swapper/308:17:413
29715040,0irq/26-eth0-rx-0-21swapper/307:30:073
29715040,0irq/26-eth0-rx-0-21swapper/307:08:193
259940,0migration/28072-21kthreadcore08:42:442
259940,0migration/229850-21kthreadcore07:42:422
259940,0migration/228977-21munin-node12:17:452
259940,0migration/228976-21latency_hist08:37:262
259940,0migration/228849-21kthreadcore10:37:402
259940,0migration/219777-21switchtime07:57:482
259940,0migration/216671-21munin-node08:27:432
259940,0migration/216454-21sh10:12:292
259940,0migration/214915-21taskset09:08:062
259940,0migration/214332-21munin-node07:32:412
259940,0migration/213130-21kthreadcore10:47:422
259940,0migration/212869-21kthreadcore10:07:432
242499944,0cyclictest0-21swapper/207:22:462
242499943,0cyclictest9702-21awk09:27:402
242499943,0cyclictest7727-21munin-node11:27:372
242499943,0cyclictest3556-21lldpd07:22:062
242499943,0cyclictest3556-21lldpd06:59:372
242499943,0cyclictest3241-21irqbalance08:22:542
242499943,0cyclictest3241-21irqbalance08:14:442
242499943,0cyclictest25341-21awk06:52:412
242499943,0cyclictest21590-21awk08:02:412
242499943,0cyclictest17755-21awk09:12:432
242499943,0cyclictest1633-21awk07:47:432
242499943,0cyclictest10894-21awk08:47:402
242489944,0cyclictest0-21swapper/112:03:281
242489944,0cyclictest0-21swapper/111:28:281
242489943,0cyclictest9449-21awk09:47:401
242489943,0cyclictest3556-21lldpd10:42:391
242489943,0cyclictest3556-21lldpd09:26:391
242489943,0cyclictest3556-21lldpd09:14:391
242489943,0cyclictest3514-21snmpd10:08:561
242489943,0cyclictest3514-21snmpd09:33:401
242489943,0cyclictest3514-21snmpd09:33:401
242479944,0cyclictest0-21swapper/011:53:070
242479943,0cyclictest3556-21lldpd09:07:390
242479943,0cyclictest3514-21snmpd09:17:400
242479943,0cyclictest3241-21irqbalance12:15:130
242479943,0cyclictest28213-21awk08:07:420
242479943,0cyclictest26338-21awk07:17:420
242479943,0cyclictest15819-21basename08:27:400
249940,0watchdog/2995-21fschecks_count09:22:362
249940,0watchdog/29280-21if_eth1.208:17:402
249940,0watchdog/25980-21ssh09:42:432
249940,0watchdog/227506-21kthreadcore11:17:432
249940,0watchdog/226077-21kthreadcore08:57:402
249940,0watchdog/20-21swapper/211:02:392
249940,0watchdog/20-21swapper/210:52:432
249940,0watchdog/20-21swapper/208:32:402
249940,0watchdog/20-21swapper/207:27:482
179940,0migration/132226-21kthreadcore08:37:411
179940,0migration/129989-21kthreadcore09:17:441
179940,0migration/127703-21kthreadcore10:57:431
179940,0migration/12404-21kthreadcore11:22:411
179940,0migration/123156-21kthreadcore08:02:431
179940,0migration/120901-21kthreadcore10:12:421
179940,0migration/119304-21kthreadcore11:32:421
179940,0migration/118040-21kthreadcore10:32:411
179940,0migration/116970-21kthreadcore07:07:431
179940,0migration/111525-21kthreadcore08:17:421
169940,0watchdog/16646-21ssh10:03:071
169940,0watchdog/128438-21cut07:17:441
169940,0watchdog/127134-21kthreadcore11:17:431
169940,0watchdog/116674-21sed11:52:391
169940,0watchdog/115518-21ssh11:11:551
169940,0watchdog/115200-21ssh11:52:111
169940,0watchdog/115164-21ssh09:28:391
169940,0watchdog/114017-21if_eth1.307:32:401
169940,0watchdog/113900-21ssh12:09:071
169940,0watchdog/110023-21aten_r1power_cu08:47:361
169940,0watchdog/10-21swapper/110:37:391
169940,0watchdog/10-21swapper/109:52:391
169940,0watchdog/10-21swapper/108:57:441
169940,0watchdog/10-21swapper/108:32:401
169940,0watchdog/10-21swapper/107:47:441
169940,0watchdog/10-21swapper/107:27:481
149940,0migration/05705-21runrttasks12:03:470
149940,0migration/031537-21sh09:39:310
149940,0migration/018630-21kthreadcore10:52:420
149940,0migration/016322-21sh09:31:570
29715030,0irq/26-eth0-rx-0-21swapper/308:42:373
29715030,0irq/26-eth0-rx-0-21swapper/308:32:373
29715030,0irq/26-eth0-rx-0-21swapper/308:04:063
29715030,0irq/26-eth0-rx-0-21swapper/307:50:203
29715030,0irq/26-eth0-rx-0-21swapper/307:17:383
29715030,0irq/26-eth0-rx-0-21swapper/307:01:423
242499933,0cyclictest3556-21lldpd07:12:362
242499932,0cyclictest20663-21awk07:37:402
242489933,0cyclictest0-21swapper/110:49:121
242489932,0cyclictest8335-21awk07:52:421
242489932,0cyclictest8239-21ssh10:27:291
242489932,0cyclictest6355-21iceccd07:12:401
242489932,0cyclictest4722-21kthreadcore08:12:431
242489932,0cyclictest26257-21grep11:57:411
242489932,0cyclictest25468-21tail06:52:421
242489932,0cyclictest24393-21awk12:17:401
242489932,0cyclictest19690-21sensors07:57:471
242489932,0cyclictest15448-21aten_r1power_vo12:12:341
242479933,0cyclictest4714-21kworker/0:206:52:270
242479933,0cyclictest26156-21kworker/0:010:02:270
242479933,0cyclictest26156-21kworker/0:009:52:270
242479933,0cyclictest26156-21kworker/0:009:47:270
242479933,0cyclictest26156-21kworker/0:009:12:290
242479933,0cyclictest26156-21kworker/0:008:32:330
242479933,0cyclictest26156-21kworker/0:008:22:290
242479933,0cyclictest26156-21kworker/0:008:12:310
242479933,0cyclictest26156-21kworker/0:008:02:290
242479933,0cyclictest26156-21kworker/0:007:27:270
242479930,0cyclictest15700-21ssh11:32:250
179930,0migration/130607-21kthreadcore07:42:431
169930,0watchdog/10-21swapper/108:07:441
29715020,0irq/26-eth0-rx-0-21swapper/308:22:293
29715020,0irq/26-eth0-rx-0-21swapper/308:12:383
29715020,0irq/26-eth0-rx-0-21swapper/307:02:373
242489920,0cyclictest0-21swapper/108:27:411
169920,0watchdog/10-21swapper/108:22:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional