You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 17:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Apr 24, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450560,0irq/25-eth10-21swapper/306:57:183
1049423829,0sleep10-21swapper/106:56:141
1034323625,0sleep00-21swapper/006:54:240
1052123324,0sleep20-21swapper/206:56:312
339960,0migration/37830-21sh10:14:403
339960,0migration/325298-21sh09:47:193
339960,0migration/322644-21sh11:44:163
339960,0migration/318130-21munin-node10:22:493
339960,0migration/315370-21sh10:39:073
339960,0migration/314938-21sh11:40:013
339960,0migration/310902-21irqrtprio09:17:483
339960,0migration/31039-21sh09:31:503
29715060,0irq/26-eth0-rx-7740-21ssh11:57:373
29715060,0irq/26-eth0-rx-1739-21irqcore10:32:473
29715060,0irq/26-eth0-rx-0-21swapper/311:16:193
149960,0migration/06316-21timerwakeupswit08:02:560
149960,0migration/031966-21timerwakeupswit07:57:550
149960,0migration/026912-21kthreadcore10:07:480
149960,0migration/017998-21munin-node09:22:440
149960,0migration/016081-21sh10:41:090
149960,0migration/014225-21kthreadcore10:17:480
149960,0migration/012497-21kthreadcore11:17:480
106839966,0cyclictest8832-21diskmemload10:17:142
106839960,0cyclictest0-21swapper/209:03:552
106829960,0cyclictest0-21swapper/111:29:281
8215050,0irq/24-0000:00:9410-21latency_hist09:37:322
8215050,0irq/24-0000:00:1115-21sa108:27:332
339950,0migration/37517-21kthreadcore07:17:493
339950,0migration/35671-21munin-node11:32:533
339950,0migration/331887-21aten_r1power_po12:12:423
339950,0migration/329811-21munin-node11:27:503
339950,0migration/326980-21kthreadcore09:07:483
339950,0migration/32572-21irqrtprio08:27:493
339950,0migration/325010-21munin-node11:07:443
339950,0migration/324735-21latency07:52:513
339950,0migration/323834-21taskset07:06:403
339950,0migration/319080-21kthreadcore09:02:493
339950,0migration/318154-21kthreadcore08:37:473
339950,0migration/314298-21kthreadcore07:47:493
29725050,0irq/27-eth0-tx-8581-21munin-node10:57:462
29725050,0irq/27-eth0-tx-667-21munin-node10:32:532
29725050,0irq/27-eth0-tx-30654-21unixbench_multi11:07:542
29725050,0irq/27-eth0-tx-25873-21ssh10:47:472
29725050,0irq/27-eth0-tx-25374-21ssh10:07:432
29725050,0irq/27-eth0-tx-24399-21munin-node11:27:462
29725050,0irq/27-eth0-tx-19265-21tr10:42:482
29725050,0irq/27-eth0-tx-11980-21kthreadcore11:37:492
29725050,0irq/27-eth0-tx-10890-21munin-node06:57:470
29725050,0irq/27-eth0-tx-0-21swapper/210:28:212
29725050,0irq/27-eth0-tx-0-21swapper/209:48:342
29725050,0irq/27-eth0-tx-0-21swapper/209:19:152
29725050,0irq/27-eth0-tx-0-21swapper/209:00:582
29725050,0irq/27-eth0-tx-0-21swapper/008:44:550
29725050,0irq/27-eth0-tx-0-21swapper/008:44:550
29725050,0irq/27-eth0-tx-0-21swapper/007:29:420
29715050,0irq/26-eth0-rx-3639-21grep09:32:493
29715050,0irq/26-eth0-rx-30958-21open_files10:07:523
29715050,0irq/26-eth0-rx-29551-21python12:07:543
29715050,0irq/26-eth0-rx-18378-21grep12:22:493
29715050,0irq/26-eth0-rx-16505-21sh10:00:523
29715050,0irq/26-eth0-rx-14473-21sh12:20:183
29715050,0irq/26-eth0-rx-1118-21taskset08:02:463
29715050,0irq/26-eth0-rx-0-21swapper/311:47:433
29715050,0irq/26-eth0-rx-0-21swapper/311:22:493
29715050,0irq/26-eth0-rx-0-21swapper/311:22:123
29715050,0irq/26-eth0-rx-0-21swapper/310:57:493
29715050,0irq/26-eth0-rx-0-21swapper/310:17:543
29715050,0irq/26-eth0-rx-0-21swapper/310:02:473
29715050,0irq/26-eth0-rx-0-21swapper/309:52:463
29715050,0irq/26-eth0-rx-0-21swapper/309:37:433
29715050,0irq/26-eth0-rx-0-21swapper/309:12:503
29715050,0irq/26-eth0-rx-0-21swapper/309:00:013
29715050,0irq/26-eth0-rx-0-21swapper/307:22:493
259950,0migration/27019-21munin-node09:12:532
259950,0migration/231897-21aten2.4-expect07:37:432
259950,0migration/23009-21kthreadcore11:32:502
259950,0migration/223607-21sh11:26:062
259950,0migration/223422-21ntp_offset09:22:522
259950,0migration/217316-21open_files07:22:522
249950,0watchdog/26319-21python10:52:552
249950,0watchdog/212085-21grep07:42:552
19150,0ktimersoftd/10-21swapper/109:03:211
179950,0migration/129535-21needreboot07:07:521
179950,0migration/123337-21sh10:43:591
179950,0migration/122719-21latency10:02:481
179950,0migration/117771-21kthreadcore07:47:501
179950,0migration/117185-21sh09:21:361
169950,0watchdog/116382-21if_err_eth012:22:461
149950,0migration/09854-21kthreadcore08:32:500
149950,0migration/08482-21kthreadcore08:07:480
149950,0migration/06949-21kthreadcore07:17:490
149950,0migration/06418-21unixbench_singl11:12:550
149950,0migration/05865-21taskset12:13:490
149950,0migration/05831-21kthreadcore08:52:500
149950,0migration/04140-21kthreadcore10:52:500
149950,0migration/03425-21kthreadcore07:37:490
149950,0migration/032165-21sh10:51:200
149950,0migration/030691-21sh12:10:130
149950,0migration/025954-21idleruntime07:32:470
149950,0migration/025221-21fschecks_time11:07:450
149950,0migration/022120-21kthreadcore08:17:480
149950,0migration/020129-21fschecks_time07:52:470
149950,0migration/019036-21kthreadcore11:22:490
149950,0migration/01885-21fschecks_time09:12:460
149950,0migration/018180-21kthreadcore08:12:500
149950,0migration/018150-21taskset07:26:200
149950,0migration/016330-21munin-node12:22:460
149950,0migration/01547-21kthreadcore07:12:490
149950,0migration/015309-21kthreadcore07:47:500
149950,0migration/015228-21timerandwakeup09:57:550
149950,0migration/012202-21kthreadcore09:37:490
106839955,0cyclictest0-21swapper/212:18:282
106839955,0cyclictest0-21swapper/211:49:182
106839955,0cyclictest0-21swapper/211:44:442
106839955,0cyclictest0-21swapper/209:09:452
106839954,0cyclictest10350-21awk09:57:482
106839950,0cyclictest0-21swapper/212:07:172
106829955,0cyclictest0-21swapper/111:55:481
106829955,0cyclictest0-21swapper/111:48:321
106829955,0cyclictest0-21swapper/110:52:441
106829955,0cyclictest0-21swapper/107:52:501
106829950,0cyclictest0-21swapper/110:39:481
106819955,0cyclictest0-21swapper/010:58:260
106819955,0cyclictest0-21swapper/009:32:120
106819950,0cyclictest0-21swapper/010:44:250
106819950,0cyclictest0-21swapper/010:30:230
106819950,0cyclictest0-21swapper/010:14:270
8215040,0irq/24-0000:00:7497-21latency_hist11:57:322
339940,0migration/39810-21kthreadcore07:42:503
339940,0migration/33925-21kthreadcore08:52:503
339940,0migration/328806-21kthreadcore07:32:493
339940,0migration/326206-21aten_r1power_fr07:57:433
339940,0migration/325915-21irqcore10:47:473
339940,0migration/323934-21kthreadcore08:42:483
339940,0migration/323934-21kthreadcore08:42:483
339940,0migration/322573-21kthreadcore08:17:483
339940,0migration/319456-21if_eth1.207:27:493
339940,0migration/312933-21kthreadcore06:57:493
339940,0migration/312155-21kthreadcore08:32:513
29725040,0irq/27-eth0-tx-4620-21cut11:12:502
29725040,0irq/27-eth0-tx-23337-21ssh10:23:102
29725040,0irq/27-eth0-tx-17641-21ssh09:42:342
29725040,0irq/27-eth0-tx-0-21swapper/212:13:032
29725040,0irq/27-eth0-tx-0-21swapper/212:07:482
29725040,0irq/27-eth0-tx-0-21swapper/209:27:412
29725040,0irq/27-eth0-tx-0-21swapper/008:57:470
29725040,0irq/27-eth0-tx-0-21swapper/008:47:520
29725040,0irq/27-eth0-tx-0-21swapper/007:04:390
29715040,0irq/26-eth0-rx-0-21swapper/312:02:493
29715040,0irq/26-eth0-rx-0-21swapper/311:52:413
29715040,0irq/26-eth0-rx-0-21swapper/311:03:253
29715040,0irq/26-eth0-rx-0-21swapper/310:52:503
29715040,0irq/26-eth0-rx-0-21swapper/310:42:453
29715040,0irq/26-eth0-rx-0-21swapper/310:28:423
29715040,0irq/26-eth0-rx-0-21swapper/309:47:463
29715040,0irq/26-eth0-rx-0-21swapper/309:23:333
259940,0migration/2983-21missed_timers08:47:502
259940,0migration/29224-21aten_r1power_po10:17:422
259940,0migration/28809-21munin-node11:17:442
259940,0migration/28410-21cpuspeed_turbos08:32:452
259940,0migration/27115-21latency_hist08:07:332
259940,0migration/26191-21switchtime08:02:552
259940,0migration/226881-21pmu-power08:42:512
259940,0migration/226881-21pmu-power08:42:512
259940,0migration/224588-21fschecks_count07:07:472
259940,0migration/222026-21needreboot11:02:502
259940,0migration/220107-21kthreadcore12:22:492
259940,0migration/217305-21latency_hist10:02:322
259940,0migration/212914-21kthreadcore06:57:492
249940,0watchdog/28797-21ssh10:37:392
249940,0watchdog/26015-21if_err_eth1.307:17:472
179940,0migration/19228-21latency_hist09:57:321
179940,0migration/19051-21irqrtprio11:57:491
179940,0migration/15526-21taskset07:38:181
179940,0migration/13489-21irqcore08:52:491
179940,0migration/132066-21runrttasks09:48:421
179940,0migration/131124-21taskset10:48:201
179940,0migration/130487-21kthreadcore08:47:491
179940,0migration/13047-21kthreadcore08:02:491
179940,0migration/127778-21fschecks_time08:22:451
179940,0migration/127738-21taskset08:46:541
179940,0migration/127738-21taskset08:46:541
179940,0migration/127618-21kthreadcore09:07:481
179940,0migration/125947-21taskset09:27:381
179940,0migration/119770-21munin-node07:27:501
179940,0migration/118844-21irqcore09:42:461
179940,0migration/116787-21sh11:02:431
179940,0migration/116360-21fschecks_time12:02:441
179940,0migration/116019-21irqrtprio08:37:461
179940,0migration/115593-21kthreadcore08:12:491
179940,0migration/111538-21taskset07:21:441
179940,0migration/110273-21kthreadcore08:32:501
169940,0watchdog/18460-21basename11:17:421
169940,0watchdog/123614-21ssh11:26:061
169940,0watchdog/123269-21mdstat09:22:511
169940,0watchdog/122981-21ssh11:45:141
169940,0watchdog/114578-21ssh11:38:581
169940,0watchdog/10-21swapper/110:07:471
169940,0watchdog/10-21swapper/109:34:391
169940,0watchdog/10-21swapper/107:42:471
149940,0migration/07559-21kthreadcore07:42:490
149940,0migration/03361-21kthreadcore11:52:490
149940,0migration/02313-21kthreadcore10:32:480
149940,0migration/02245-21fschecks_time09:32:450
149940,0migration/021093-21runrttasks08:41:420
149940,0migration/020361-21kthreadcore11:42:490
149940,0migration/018603-21kthreadcore09:02:490
149940,0migration/010283-21fschecks_time09:17:450
106839944,0cyclictest0-21swapper/211:53:532
106839943,0cyclictest3925-21ntpq07:12:522
106839943,0cyclictest3514-21snmpd08:27:352
106839943,0cyclictest3514-21snmpd07:57:342
106839943,0cyclictest3514-21snmpd07:03:492
106839943,0cyclictest3241-21irqbalance08:53:012
106839943,0cyclictest31576-21sh07:37:332
106839943,0cyclictest2516-21awk09:32:472
106839943,0cyclictest2206-21awk09:52:462
106839943,0cyclictest20428-21awk07:52:482
106839943,0cyclictest14756-21awk08:12:472
106839943,0cyclictest13763-21awk07:47:482
106829944,0cyclictest0-21swapper/108:17:451
106829943,0cyclictest3556-21lldpd12:19:441
106829943,0cyclictest3556-21lldpd12:16:141
106829943,0cyclictest3556-21lldpd12:07:441
106829943,0cyclictest3556-21lldpd11:32:441
106829943,0cyclictest3556-21lldpd11:09:441
106829943,0cyclictest3556-21lldpd10:22:431
106829943,0cyclictest3556-21lldpd10:20:431
106829943,0cyclictest3556-21lldpd09:57:131
106829943,0cyclictest3556-21lldpd09:13:131
106829943,0cyclictest3556-21lldpd09:01:141
106829943,0cyclictest3556-21lldpd08:28:131
106829943,0cyclictest3241-21irqbalance10:14:011
106829943,0cyclictest26068-21awk10:27:471
106829943,0cyclictest1613-21awk10:32:461
106829943,0cyclictest12780-21awk07:22:481
106829943,0cyclictest1191-21awk11:12:471
106819943,0cyclictest3703-21kworker/0:109:57:080
106819943,0cyclictest3241-21irqbalance11:30:210
106819943,0cyclictest26303-21awk09:07:460
106819943,0cyclictest2257-21awk08:27:480
106819943,0cyclictest1032-21awk11:32:480
29725030,0irq/27-eth0-tx-0-21swapper/008:22:450
29715030,0irq/26-eth0-rx-0-21swapper/308:47:543
29715030,0irq/26-eth0-rx-0-21swapper/308:22:433
29715030,0irq/26-eth0-rx-0-21swapper/308:07:433
249930,0watchdog/214755-21munin-node08:37:472
249930,0watchdog/20-21swapper/208:17:472
179930,0migration/111565-21kthreadcore08:07:491
106829932,0cyclictest3556-21lldpd07:32:431
106829932,0cyclictest31668-21awk07:12:471
106829932,0cyclictest26455-21df_abs07:57:451
106829932,0cyclictest16640-21timerandwakeup06:57:541
106829932,0cyclictest14345-21sensors10:57:541
106829932,0cyclictest10457-21hddtemp_smartct09:37:461
106819933,0cyclictest3703-21kworker/0:111:02:380
106819933,0cyclictest3703-21kworker/0:110:22:440
106819933,0cyclictest3703-21kworker/0:110:02:460
106819933,0cyclictest3703-21kworker/0:109:47:340
106819933,0cyclictest3703-21kworker/0:109:42:340
106819933,0cyclictest3703-21kworker/0:107:07:590
106819933,0cyclictest25192-21kworker/0:012:17:430
106819933,0cyclictest25192-21kworker/0:012:02:350
106819933,0cyclictest25192-21kworker/0:011:57:370
106819933,0cyclictest25192-21kworker/0:011:47:350
106819933,0cyclictest25192-21kworker/0:011:37:340
35120,0ktimersoftd/3988-21kthreadcore07:12:493
29715020,0irq/26-eth0-rx-0-21swapper/308:13:213
29715020,0irq/26-eth0-rx-0-21swapper/307:37:433
29715020,0irq/26-eth0-rx-0-21swapper/307:07:363
106839920,0cyclictest0-21swapper/207:27:432
106829921,0cyclictest17290-21latency_hist07:02:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional