You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 10:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Aug 06, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1047723627,0sleep30-21swapper/318:46:473
1022923624,0sleep10-21swapper/118:43:531
1020123622,0sleep00-21swapper/018:43:320
416523026,0sleep20-21swapper/218:42:462
106299999,0cyclictest0-21swapper/020:49:400
106299976,0cyclictest0-21swapper/019:32:550
339960,0migration/332569-21sh21:21:563
339960,0migration/331588-21fschecks_time22:22:563
339960,0migration/330040-21sh22:20:273
339960,0migration/328769-21sh22:38:433
339960,0migration/327715-21sh23:42:043
339960,0migration/327653-21kthreadcore19:22:583
29725060,0irq/27-eth0-tx-30843-21munin-node19:02:560
29715060,0irq/26-eth0-rx-5578-21diskstats23:07:543
29715060,0irq/26-eth0-rx-13450-21memory21:48:003
149960,0migration/04814-21sh22:45:130
149960,0migration/010968-21rt-features23:08:020
106299960,0cyclictest0-21swapper/021:19:490
4150,0ktimersoftd/00-21swapper/022:39:450
339950,0migration/39811-21latency23:27:583
339950,0migration/39272-21runrttasks00:08:133
339950,0migration/3907-21taskset20:15:383
339950,0migration/34605-21runrttasks22:44:323
339950,0migration/330012-21df_abs23:02:533
339950,0migration/327729-21taskset23:19:523
339950,0migration/327722-21munin-node22:58:033
339950,0migration/326123-21kthreadcore18:57:573
339950,0migration/323121-21kthreadcore19:43:033
339950,0migration/322402-21munin-node20:32:593
339950,0migration/320938-21taskset20:30:103
339950,0migration/320277-21latency_hist20:07:413
339950,0migration/319639-21switchtime22:53:033
339950,0migration/318348-21kthreadcore22:12:583
339950,0migration/317043-21kthreadcore23:12:593
339950,0migration/316929-21cpuspeed_turbos21:32:573
339950,0migration/315784-21kthreadcore19:12:583
339950,0migration/315426-21kthreadcore18:48:003
339950,0migration/315389-21kthreadcore00:12:593
339950,0migration/315189-21kthreadcore23:52:583
339950,0migration/313610-21idleruntime19:37:563
29725050,0irq/27-eth0-tx-24167-21munin-node18:57:550
29725050,0irq/27-eth0-tx-13787-21munin-node20:02:580
29725050,0irq/27-eth0-tx-0-21swapper/020:46:410
29725050,0irq/27-eth0-tx-0-21swapper/019:58:080
29725050,0irq/27-eth0-tx-0-21swapper/019:48:000
29725050,0irq/27-eth0-tx-0-21swapper/019:18:060
29715050,0irq/26-eth0-rx-520-21kthreadcore23:22:573
29715050,0irq/26-eth0-rx-29008-21hostname23:42:593
29715050,0irq/26-eth0-rx-29008-21hostname23:42:593
29715050,0irq/26-eth0-rx-14448-21sensors_temp21:28:033
29715050,0irq/26-eth0-rx-13714-21kernelversion23:32:573
29715050,0irq/26-eth0-rx-10084-21irqcore21:07:583
29715050,0irq/26-eth0-rx-0-21swapper/323:51:433
29715050,0irq/26-eth0-rx-0-21swapper/322:47:593
29715050,0irq/26-eth0-rx-0-21swapper/322:34:033
29715050,0irq/26-eth0-rx-0-21swapper/322:28:593
29715050,0irq/26-eth0-rx-0-21swapper/322:11:353
29715050,0irq/26-eth0-rx-0-21swapper/322:02:503
29715050,0irq/26-eth0-rx-0-21swapper/321:57:583
29715050,0irq/26-eth0-rx-0-21swapper/321:16:393
29715050,0irq/26-eth0-rx-0-21swapper/321:02:433
29715050,0irq/26-eth0-rx-0-21swapper/320:52:483
29715050,0irq/26-eth0-rx-0-21swapper/320:51:543
29715050,0irq/26-eth0-rx-0-21swapper/319:57:533
29715050,0irq/26-eth0-rx-0-21swapper/300:02:483
179950,0migration/126458-21kthreadcore19:22:581
179950,0migration/124925-21latency_hist19:22:421
179950,0migration/124087-21sh21:15:211
179950,0migration/122960-21latency_hist22:17:411
179950,0migration/12023-21taskset20:41:541
179950,0migration/114814-21sendmail_mailqu21:08:031
179950,0migration/114664-21kthreadcore23:12:581
169950,0watchdog/110644-21ntp_states19:08:001
149950,0migration/09903-21kthreadcore22:27:570
149950,0migration/08975-21kthreadcore23:47:560
149950,0migration/08339-21kthreadcore22:47:580
149950,0migration/06476-21munin-node21:23:030
149950,0migration/06389-21unixbench_singl19:53:050
149950,0migration/04625-21taskset23:06:520
149950,0migration/028769-21kernelversion00:02:550
149950,0migration/028325-21taskset22:59:270
149950,0migration/027164-21munin-node20:12:530
149950,0migration/026987-21kthreadcore21:37:590
149950,0migration/025951-21idleruntime20:57:590
149950,0migration/022898-21munin-node21:13:020
149950,0migration/022458-21kthreadcore23:37:590
149950,0migration/021418-21aten_r1power_cu20:32:540
149950,0migration/020929-21taskset22:33:530
149950,0migration/020912-21kthreadcore18:53:010
149950,0migration/019247-21missed_timers22:52:590
149950,0migration/016617-21sh21:32:530
149950,0migration/016266-21kthreadcore23:52:580
149950,0migration/016196-21kthreadcore23:32:580
149950,0migration/015836-21kthreadcore18:48:000
106329953,0cyclictest3241-21irqbalance21:59:502
106299955,0cyclictest0-21swapper/023:47:130
106299955,0cyclictest0-21swapper/023:47:130
106299955,0cyclictest0-21swapper/022:19:240
106299950,0cyclictest0-21swapper/021:59:230
106299950,0cyclictest0-21swapper/021:06:150
339940,0migration/37895-21kthreadcore19:32:583
339940,0migration/315946-21diskmemload21:52:513
29725040,0irq/27-eth0-tx-2569-21ssh23:45:112
29725040,0irq/27-eth0-tx-2569-21ssh23:45:112
29725040,0irq/27-eth0-tx-15621-21ssh20:49:452
29725040,0irq/27-eth0-tx-0-21swapper/223:32:522
29725040,0irq/27-eth0-tx-0-21swapper/223:29:052
29725040,0irq/27-eth0-tx-0-21swapper/222:44:062
29725040,0irq/27-eth0-tx-0-21swapper/222:41:372
29725040,0irq/27-eth0-tx-0-21swapper/222:23:332
29725040,0irq/27-eth0-tx-0-21swapper/221:52:532
29725040,0irq/27-eth0-tx-0-21swapper/221:32:482
29725040,0irq/27-eth0-tx-0-21swapper/200:13:462
29725040,0irq/27-eth0-tx-0-21swapper/200:08:302
29725040,0irq/27-eth0-tx-0-21swapper/020:07:590
29715040,0irq/26-eth0-rx-0-21swapper/323:57:553
29715040,0irq/26-eth0-rx-0-21swapper/321:43:493
29715040,0irq/26-eth0-rx-0-21swapper/321:41:283
29715040,0irq/26-eth0-rx-0-21swapper/321:23:003
29715040,0irq/26-eth0-rx-0-21swapper/320:57:513
29715040,0irq/26-eth0-rx-0-21swapper/320:07:583
29715040,0irq/26-eth0-rx-0-21swapper/319:52:543
259940,0migration/29750-21kthreadcore22:07:582
259940,0migration/29023-21kthreadcore19:07:582
259940,0migration/28293-21kthreadcore19:32:582
259940,0migration/26065-21sensors_fan19:53:032
259940,0migration/23902-21kthreadcore20:17:582
259940,0migration/225905-21kthreadcore18:57:572
259940,0migration/224883-21kthreadcore23:17:582
259940,0migration/217588-21kthreadcore20:02:592
179940,0migration/19419-21kthreadcore20:22:581
179940,0migration/18986-21kthreadcore22:07:581
179940,0migration/18616-21fschecks_time21:47:541
179940,0migration/18580-21needreboot00:08:011
179940,0migration/18228-21kthreadcore22:47:581
179940,0migration/16176-21kthreadcore20:43:001
179940,0migration/13830-21switchtime22:43:031
179940,0migration/129053-21kthreadcore00:02:561
179940,0migration/12317-21kthreadcore22:23:001
179940,0migration/12294-21kthreadcore19:52:591
179940,0migration/121980-21taskset23:17:561
179940,0migration/121127-21gltestperf20:07:551
179940,0migration/120297-21kthreadcore21:52:581
179940,0migration/118072-21kthreadcore20:02:591
179940,0migration/113940-21kthreadcore19:12:571
179940,0migration/112979-21kthreadcore18:47:591
179940,0migration/112939-21timerandwakeup19:58:041
179940,0migration/112762-21latency_hist19:37:421
169940,0watchdog/16917-21munin-node19:32:561
169940,0watchdog/129383-21ssh22:40:391
169940,0watchdog/128953-21kthreadcore21:57:591
169940,0watchdog/124868-21munin-node19:43:041
169940,0watchdog/123286-21cat20:33:001
169940,0watchdog/123047-21kthreadcore23:37:591
169940,0watchdog/114503-21ssh22:32:511
169940,0watchdog/10-21swapper/123:47:511
169940,0watchdog/10-21swapper/123:43:031
169940,0watchdog/10-21swapper/123:43:031
169940,0watchdog/10-21swapper/121:17:561
169940,0watchdog/10-21swapper/100:12:591
149940,0migration/028980-21kthreadcore19:22:580
149940,0migration/024408-21kthreadcore19:43:030
149940,0migration/010935-21switchtime19:08:030
149940,0migration/010593-21kthreadcore21:27:580
106329943,0cyclictest3514-21snmpd23:58:122
106329943,0cyclictest3514-21snmpd22:59:272
106329943,0cyclictest3514-21snmpd22:55:572
106329943,0cyclictest3514-21snmpd22:48:122
106329943,0cyclictest3514-21snmpd21:42:572
106329943,0cyclictest3514-21snmpd21:18:572
106329943,0cyclictest3514-21snmpd20:45:122
106329943,0cyclictest3514-21snmpd20:41:572
106329943,0cyclictest3514-21snmpd20:37:122
106329943,0cyclictest3514-21snmpd20:25:272
106329943,0cyclictest3514-21snmpd20:09:122
106329943,0cyclictest3514-21snmpd19:58:272
106329943,0cyclictest3514-21snmpd19:51:122
106329943,0cyclictest3514-21snmpd19:38:122
106329943,0cyclictest3514-21snmpd19:26:272
106329943,0cyclictest3514-21snmpd19:16:572
106329943,0cyclictest3514-21snmpd18:56:272
106329943,0cyclictest32737-21awk19:28:002
106329943,0cyclictest3241-21irqbalance23:49:092
106329943,0cyclictest3241-21irqbalance21:03:102
106329943,0cyclictest3241-21irqbalance20:53:002
106329943,0cyclictest31798-21awk19:02:572
106329943,0cyclictest26095-21awk20:58:002
106329943,0cyclictest24076-21awk22:17:552
106329943,0cyclictest20830-21sed22:13:012
106329943,0cyclictest15776-21irqcore20:27:572
106329943,0cyclictest11680-21awk18:47:572
106329943,0cyclictest0-21swapper/223:22:592
106329942,0cyclictest9312-21munin-node21:47:582
106329942,0cyclictest11625-21ssh21:07:592
106329941,0cyclictest3647-21ssh23:03:542
106329941,0cyclictest30952-21grep20:12:592
106329941,0cyclictest30056-21munin-node21:38:012
106329941,0cyclictest20273-21munin-node23:37:562
106329941,0cyclictest15213-21gltestperf22:32:552
106329941,0cyclictest0-21swapper/223:52:592
106329941,0cyclictest0-21swapper/223:07:482
106319943,0cyclictest9648-21awk21:27:571
106319943,0cyclictest6047-21awk23:07:561
106319943,0cyclictest3514-21snmpd23:58:271
106319943,0cyclictest3514-21snmpd20:52:421
106319943,0cyclictest3514-21snmpd19:05:421
106319943,0cyclictest3514-21snmpd18:58:571
106319943,0cyclictest3241-21irqbalance23:27:491
106319943,0cyclictest30552-21awk23:02:551
106319943,0cyclictest29822-21awk23:22:551
106319943,0cyclictest26119-21awk20:58:001
106319943,0cyclictest25517-21awk21:37:571
106319943,0cyclictest22683-21awk22:57:551
106319943,0cyclictest18400-21awk18:52:591
106319943,0cyclictest1665-21awk21:22:571
106319943,0cyclictest15651-21awk20:27:561
106319943,0cyclictest12570-21awk23:52:551
106319943,0cyclictest10079-21awk20:47:571
106299944,0cyclictest0-21swapper/023:30:120
106299944,0cyclictest0-21swapper/022:24:550
106299944,0cyclictest0-21swapper/022:08:220
106299944,0cyclictest0-21swapper/000:00:280
106299943,0cyclictest4008-21awk00:07:570
106299943,0cyclictest3514-21snmpd23:13:570
106299943,0cyclictest3514-21snmpd20:18:420
106299943,0cyclictest32665-21awk19:27:590
106299943,0cyclictest3241-21irqbalance23:25:290
106299943,0cyclictest3241-21irqbalance00:15:490
106299943,0cyclictest21905-21awk23:17:550
106299943,0cyclictest16814-21awk21:52:550
106299943,0cyclictest10055-21awk21:07:570
29715030,0irq/26-eth0-rx-0-21swapper/320:42:543
29715030,0irq/26-eth0-rx-0-21swapper/320:37:513
29715030,0irq/26-eth0-rx-0-21swapper/320:23:013
29715030,0irq/26-eth0-rx-0-21swapper/320:18:043
29715030,0irq/26-eth0-rx-0-21swapper/319:28:183
29715030,0irq/26-eth0-rx-0-21swapper/319:07:533
29715030,0irq/26-eth0-rx-0-21swapper/319:02:543
29715030,0irq/26-eth0-rx-0-21swapper/318:52:553
249930,0watchdog/20-21swapper/223:12:432
179930,0migration/13362-21kthreadcore21:42:581
179930,0migration/131722-21sh22:02:451
169930,0watchdog/18864-21diskmemload22:57:031
169930,0watchdog/18864-21diskmemload22:27:511
169930,0watchdog/10-21swapper/120:13:001
106329932,0cyclictest31801-21aten2.4-expect22:02:502
106329931,0cyclictest8656-21ssh21:27:452
106329931,0cyclictest6986-21df_inode22:27:532
106329931,0cyclictest525-21sed21:22:412
106329931,0cyclictest27418-21cat00:02:412
106329931,0cyclictest19651-21egrep19:42:572
106329931,0cyclictest18829-21df19:17:582
106329930,0cyclictest17130-21date21:12:412
106319932,0cyclictest3967-21grep19:28:021
106319932,0cyclictest27087-21awk19:47:571
106319932,0cyclictest22381-21sensors21:33:071
106319932,0cyclictest1745-21awk21:02:581
106319932,0cyclictest13275-21awk23:32:551
106319930,0cyclictest24989-21grep22:17:571
106299933,0cyclictest777-21kworker/0:222:12:490
106299933,0cyclictest777-21kworker/0:221:47:470
106299933,0cyclictest2902-21kworker/0:220:52:450
106299933,0cyclictest2902-21kworker/0:220:37:430
106299933,0cyclictest2902-21kworker/0:220:27:430
106299933,0cyclictest2902-21kworker/0:220:22:430
106299933,0cyclictest2902-21kworker/0:219:37:530
106299933,0cyclictest2902-21kworker/0:219:12:430
106299933,0cyclictest1630-21kworker/0:021:42:450
106299930,0cyclictest1710-21grep22:02:560
29715020,0irq/26-eth0-rx-0-21swapper/319:47:573
29715020,0irq/26-eth0-rx-0-21swapper/319:17:453
169920,0watchdog/10-21swapper/120:17:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional