You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 00:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 08, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1621927473,0sleep30-21swapper/306:43:393
1622323525,0sleep20-21swapper/206:43:422
1650523425,0sleep10-21swapper/106:46:571
1640823423,0sleep00-21swapper/006:45:480
35160,0ktimersoftd/30-21swapper/311:52:303
339960,0migration/36558-21munin-node07:27:433
339960,0migration/332503-21kthreadcore09:57:453
339960,0migration/324306-21sh11:33:193
339960,0migration/322828-21aten_r1power_en09:12:383
339960,0migration/315749-21sh11:48:083
339960,0migration/31543-21sh11:21:393
339960,0migration/312234-21sh10:06:263
339960,0migration/312225-21gltestperf10:47:413
29725060,0irq/27-eth0-tx-31045-21munin-node07:22:470
29715060,0irq/26-eth0-rx-30537-21munin-run08:57:273
29715060,0irq/26-eth0-rx-27933-21perl10:57:413
29715060,0irq/26-eth0-rx-12821-21vmstat09:02:493
29715060,0irq/26-eth0-rx-11645-21munin-node09:22:453
29715060,0irq/26-eth0-rx-11645-21munin-node09:22:453
166229966,0cyclictest0-21swapper/206:47:512
166229960,0cyclictest0-21swapper/209:53:252
166219960,0cyclictest0-21swapper/107:57:461
149960,0migration/09036-21sh11:25:030
149960,0migration/017141-21sh11:52:240
149960,0migration/011724-21sh10:04:520
8215050,0irq/24-0000:00:20326-21sa108:27:272
4150,0ktimersoftd/00-21swapper/011:08:380
4150,0ktimersoftd/00-21swapper/010:13:370
339950,0migration/39860-21runrttasks10:43:163
339950,0migration/37296-21aten_r1power_en08:17:383
339950,0migration/37116-21munin-node07:52:433
339950,0migration/3387-21sendmail_mailqu08:32:493
339950,0migration/332462-21kthreadcore08:57:443
339950,0migration/331607-21kthreadcore10:37:453
339950,0migration/330412-21kthreadcore11:37:453
339950,0migration/326170-21latency10:12:473
339950,0migration/324309-21idleruntime06:52:433
339950,0migration/323042-21taskset06:50:083
339950,0migration/322338-21idleruntime09:52:453
339950,0migration/321158-21fschecks_time08:27:403
339950,0migration/319567-21kthreadcore08:47:463
339950,0migration/315252-21kthreadcore09:47:443
339950,0migration/315102-21cpuspeed_turbos09:07:403
339950,0migration/313439-21fschecks_count07:57:413
339950,0migration/312700-21munin-node07:32:413
29725050,0irq/27-eth0-tx-3551-21munin-node10:42:452
29725050,0irq/27-eth0-tx-3514-21snmpd07:40:100
29725050,0irq/27-eth0-tx-2828-21munin-node11:02:492
29725050,0irq/27-eth0-tx-2738-21fschecks_time11:22:402
29725050,0irq/27-eth0-tx-27000-21diskstats11:17:392
29725050,0irq/27-eth0-tx-25907-21munin-node11:37:492
29725050,0irq/27-eth0-tx-20795-21grep09:07:512
29725050,0irq/27-eth0-tx-19987-21cut12:12:452
29725050,0irq/27-eth0-tx-13971-21ssh09:05:552
29725050,0irq/27-eth0-tx-12064-21munin-node07:32:470
29725050,0irq/27-eth0-tx-0-21swapper/211:55:122
29725050,0irq/27-eth0-tx-0-21swapper/211:43:232
29725050,0irq/27-eth0-tx-0-21swapper/211:27:402
29725050,0irq/27-eth0-tx-0-21swapper/209:32:382
29725050,0irq/27-eth0-tx-0-21swapper/209:29:582
29725050,0irq/27-eth0-tx-0-21swapper/007:42:410
29725050,0irq/27-eth0-tx-0-21swapper/007:30:090
29725050,0irq/27-eth0-tx-0-21swapper/007:12:480
29725050,0irq/27-eth0-tx-0-21swapper/007:05:040
29715050,0irq/26-eth0-rx-4987-21kthreadcore12:02:453
29715050,0irq/26-eth0-rx-4417-21unixbench_multi09:17:513
29715050,0irq/26-eth0-rx-17972-21kthreadcore12:12:453
29715050,0irq/26-eth0-rx-12816-21kthreadcore12:07:453
29715050,0irq/26-eth0-rx-0-21swapper/311:28:283
29715050,0irq/26-eth0-rx-0-21swapper/311:12:363
29715050,0irq/26-eth0-rx-0-21swapper/310:52:403
29715050,0irq/26-eth0-rx-0-21swapper/310:27:493
29715050,0irq/26-eth0-rx-0-21swapper/310:09:183
29715050,0irq/26-eth0-rx-0-21swapper/309:43:543
29715050,0irq/26-eth0-rx-0-21swapper/309:32:383
29715050,0irq/26-eth0-rx-0-21swapper/309:28:063
259950,0migration/26404-21aten_r1power_fr07:52:402
259950,0migration/229597-21munin-node10:17:422
259950,0migration/229572-21kthreadcore10:37:442
259950,0migration/226897-21kthreadcore06:52:462
259950,0migration/219445-21kthreadcore11:32:462
259950,0migration/21319-21latency_hist08:37:282
259950,0migration/212366-21kthreadcore11:07:452
259950,0migration/21085-21kthreadcore07:47:452
249950,0watchdog/25582-21kthreadcore10:22:452
179950,0migration/19051-21kthreadcore10:22:461
179950,0migration/17184-21latency_hist08:17:281
179950,0migration/130316-21cpuspeed_turbos09:37:381
179950,0migration/125593-21turbostat.cron11:37:211
179950,0migration/115688-21runrttasks12:10:261
179950,0migration/112587-21munin-node10:27:401
166229955,0cyclictest0-21swapper/211:48:592
166229955,0cyclictest0-21swapper/210:56:482
166229955,0cyclictest0-21swapper/210:50:582
166229955,0cyclictest0-21swapper/209:43:292
166229955,0cyclictest0-21swapper/209:13:412
166229955,0cyclictest0-21swapper/208:51:182
166229955,0cyclictest0-21swapper/208:27:392
166229955,0cyclictest0-21swapper/207:22:422
166229950,0cyclictest0-21swapper/209:47:442
166219955,0cyclictest13299-21fschecks_count10:07:411
166219955,0cyclictest0-21swapper/110:54:491
166219955,0cyclictest0-21swapper/110:42:221
166219950,0cyclictest0-21swapper/111:11:411
166219950,0cyclictest0-21swapper/110:20:171
166209955,0cyclictest0-21swapper/010:37:350
166209955,0cyclictest0-21swapper/009:30:060
166209954,0cyclictest23622-21awk08:52:420
166209950,0cyclictest0-21swapper/012:05:430
166209950,0cyclictest0-21swapper/010:45:370
166209950,0cyclictest0-21swapper/009:14:580
169950,0watchdog/15311-21diskstats10:02:411
169950,0watchdog/118813-21tr08:22:461
169950,0watchdog/11620-21kthreadcore06:57:461
169950,0watchdog/112546-21kthreadcore08:42:451
149950,0migration/07835-21kthreadcore11:02:450
149950,0migration/06421-21gltestperf09:42:410
149950,0migration/06301-21switchtime08:12:500
149950,0migration/05009-21sh08:58:480
149950,0migration/030850-21gltestperf06:57:420
149950,0migration/030526-21kthreadcore10:17:440
149950,0migration/028080-21kthreadcore07:17:470
149950,0migration/027374-21sh10:36:270
149950,0migration/024786-21missed_timers10:52:470
149950,0migration/022627-21kthreadcore08:02:450
149950,0migration/01624-21aten_r1power_vo08:37:400
149950,0migration/011010-21kthreadcore07:52:470
149950,0migration/010922-21kthreadcore08:42:450
149950,0migration/010626-21fschecks_count11:27:410
339940,0migration/38369-21kthreadcore07:02:453
339940,0migration/32838-21kthreadcore08:12:453
339940,0migration/327742-21kthreadcore07:42:453
339940,0migration/326794-21kthreadcore07:17:463
339940,0migration/325208-21latency_hist11:57:263
339940,0migration/324223-21pmu-power07:37:483
339940,0migration/311304-21diskmemload10:25:393
29725040,0irq/27-eth0-tx-7369-21telnet08:17:380
29725040,0irq/27-eth0-tx-6332-21munin-node09:22:432
29725040,0irq/27-eth0-tx-6332-21munin-node09:22:432
29725040,0irq/27-eth0-tx-29346-21ssh09:57:362
29725040,0irq/27-eth0-tx-24423-21ssh11:12:482
29725040,0irq/27-eth0-tx-1406-21ssh10:59:002
29725040,0irq/27-eth0-tx-0-21swapper/212:07:402
29725040,0irq/27-eth0-tx-0-21swapper/210:12:472
29725040,0irq/27-eth0-tx-0-21swapper/209:37:392
29725040,0irq/27-eth0-tx-0-21swapper/209:18:022
29725040,0irq/27-eth0-tx-0-21swapper/208:58:162
29725040,0irq/27-eth0-tx-0-21swapper/208:52:312
29725040,0irq/27-eth0-tx-0-21swapper/008:47:330
29725040,0irq/27-eth0-tx-0-21swapper/007:07:400
29715040,0irq/26-eth0-rx-31337-21kthreadcore08:07:453
29715040,0irq/26-eth0-rx-0-21swapper/311:43:423
29715040,0irq/26-eth0-rx-0-21swapper/311:24:313
29715040,0irq/26-eth0-rx-0-21swapper/311:12:263
29715040,0irq/26-eth0-rx-0-21swapper/311:04:173
29715040,0irq/26-eth0-rx-0-21swapper/310:34:063
29715040,0irq/26-eth0-rx-0-21swapper/310:17:413
29715040,0irq/26-eth0-rx-0-21swapper/309:37:493
259940,0migration/28872-21kthreadcore07:02:452
259940,0migration/25540-21kthreadcore08:12:452
259940,0migration/24616-21kthreadcore08:37:452
259940,0migration/213917-21munin-node07:57:432
259940,0migration/212944-21kthreadcore07:07:452
259940,0migration/212907-21munin-node10:07:392
259940,0migration/212231-21cpu07:32:392
249940,0watchdog/27317-21kthreadcore10:02:452
249940,0watchdog/225488-21ssh11:57:412
249940,0watchdog/20-21swapper/212:02:452
179940,0migration/19161-21kthreadcore09:42:451
179940,0migration/19140-21kthreadcore07:52:461
179940,0migration/18079-21latency_hist08:42:281
179940,0migration/14829-21munin-node07:02:401
179940,0migration/13945-21irqcore11:02:431
179940,0migration/132562-21kthreadcore09:17:451
179940,0migration/127170-21latency_hist08:32:281
179940,0migration/125635-21kthreadcore06:52:451
179940,0migration/123882-21irqcore08:52:431
179940,0migration/123789-21runrttasks12:15:581
179940,0migration/123645-21taskset11:53:141
179940,0migration/122804-21aten_r1power_cu09:12:381
179940,0migration/121445-21kthreadcore06:47:451
179940,0migration/115269-21kthreadcore10:47:451
179940,0migration/114943-21kthreadcore07:07:461
166229944,0cyclictest0-21swapper/207:19:042
166229943,0cyclictest3514-21snmpd08:44:082
166229943,0cyclictest3514-21snmpd07:14:082
166229943,0cyclictest31072-21awk06:57:442
166229943,0cyclictest20572-21awk08:02:432
166229943,0cyclictest20116-21munin-node10:32:502
166229943,0cyclictest13065-21awk10:27:422
166219944,0cyclictest0-21swapper/109:55:511
166219943,0cyclictest528-21awk07:47:441
166219943,0cyclictest3514-21snmpd09:03:081
166219943,0cyclictest3514-21snmpd08:12:381
166219943,0cyclictest3514-21snmpd08:02:381
166219943,0cyclictest3241-21irqbalance12:03:251
166219943,0cyclictest30360-21awk09:57:431
166219943,0cyclictest26364-21awk07:42:431
166219943,0cyclictest26219-21awk11:57:441
166219943,0cyclictest14488-21awk09:47:421
166219940,0cyclictest0-21swapper/110:15:051
166209944,0cyclictest0-21swapper/012:13:450
166209944,0cyclictest0-21swapper/011:52:570
166209943,0cyclictest3514-21snmpd10:30:390
166209943,0cyclictest3514-21snmpd09:48:390
166209943,0cyclictest3241-21irqbalance11:59:250
166209943,0cyclictest3241-21irqbalance11:21:250
166209943,0cyclictest3241-21irqbalance10:58:350
166209943,0cyclictest3241-21irqbalance10:48:250
166209943,0cyclictest3241-21irqbalance10:07:450
166209943,0cyclictest3241-21irqbalance09:59:350
166209943,0cyclictest3241-21irqbalance09:39:350
166209943,0cyclictest3241-21irqbalance09:22:350
166209943,0cyclictest3241-21irqbalance09:22:350
166209943,0cyclictest3241-21irqbalance09:19:050
166209943,0cyclictest3241-21irqbalance09:09:260
166209943,0cyclictest3241-21irqbalance06:52:460
166209943,0cyclictest27149-21awk08:07:420
166209943,0cyclictest14503-21sadc09:07:270
169940,0watchdog/15466-21kthreadcore11:42:451
169940,0watchdog/129436-21kthreadcore10:57:451
169940,0watchdog/127931-21swap09:32:491
169940,0watchdog/125845-21cut07:17:461
169940,0watchdog/125075-21ssh11:13:371
169940,0watchdog/121132-21interrupts10:32:451
169940,0watchdog/115364-21perl09:07:411
169940,0watchdog/114203-21ssh09:27:291
169940,0watchdog/113798-21kthreadcore11:47:451
169940,0watchdog/111353-21sed07:27:501
169940,0watchdog/10-21swapper/111:37:411
169940,0watchdog/10-21swapper/110:42:451
149940,0migration/08761-21kthreadcore10:22:460
149940,0migration/022035-21kthreadcore06:47:450
8215030,0irq/24-0000:00:0-21swapper/207:42:302
29715030,0irq/26-eth0-rx-0-21swapper/308:38:323
29715030,0irq/26-eth0-rx-0-21swapper/308:02:563
29715030,0irq/26-eth0-rx-0-21swapper/307:47:393
29715030,0irq/26-eth0-rx-0-21swapper/307:22:393
29715030,0irq/26-eth0-rx-0-21swapper/307:07:403
29715030,0irq/26-eth0-rx-0-21swapper/306:57:393
249930,0watchdog/20-21swapper/208:17:502
179930,0migration/130191-21kthreadcore11:17:431
166229932,0cyclictest6236-21awk07:27:422
166229932,0cyclictest30330-21kthreadcore08:07:452
166229932,0cyclictest19584-21awk07:37:432
166219932,0cyclictest7134-21hddtemp_smartct09:22:411
166219932,0cyclictest7134-21hddtemp_smartct09:22:411
166219932,0cyclictest2995-21awk11:22:421
166219932,0cyclictest21539-21awk08:27:431
166219932,0cyclictest18640-21awk07:12:431
166219932,0cyclictest1737-21kthreadcore07:22:441
166219932,0cyclictest13730-21kthreadcore07:32:441
166209933,0cyclictest27683-21kworker/0:008:32:290
166209933,0cyclictest27683-21kworker/0:008:27:290
166209933,0cyclictest27683-21kworker/0:008:22:290
166209933,0cyclictest27683-21kworker/0:007:57:290
166209933,0cyclictest27683-21kworker/0:007:48:070
166209933,0cyclictest26292-21kworker/0:012:07:300
166209933,0cyclictest26292-21kworker/0:011:42:280
166209933,0cyclictest26292-21kworker/0:011:37:280
166209933,0cyclictest26292-21kworker/0:011:32:280
166209933,0cyclictest23542-21kworker/0:211:12:360
166209933,0cyclictest23542-21kworker/0:209:32:360
166209932,0cyclictest22464-21awk09:52:460
169930,0watchdog/13775-21kthreadcore08:57:451
169930,0watchdog/119497-21smartctl07:37:421
169930,0watchdog/10-21swapper/111:27:451
169930,0watchdog/10-21swapper/108:47:451
339920,0migration/39241-21iostat_ios08:42:443
29715020,0irq/26-eth0-rx-0-21swapper/308:23:293
29715020,0irq/26-eth0-rx-0-21swapper/307:12:373
166219920,0cyclictest26058-21latency_hist08:07:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional