You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 17:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Jun 18, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450530,0irq/25-eth10-21swapper/306:47:473
2241923724,0sleep00-21swapper/006:50:170
2223923324,0sleep10-21swapper/106:48:101
1622123223,0sleep20-21swapper/206:47:232
226689984,0cyclictest22229-21irqcore08:52:342
226689973,0cyclictest939-21awk08:12:322
226689973,0cyclictest5281-21awk12:02:322
226689973,0cyclictest29916-21awk11:17:352
226689973,0cyclictest26591-21sadc08:32:192
226689973,0cyclictest13775-21awk11:07:332
226689970,0cyclictest4798-21munin-node11:02:312
226689970,0cyclictest28681-21munin-node11:37:402
226689970,0cyclictest13653-21munin-node09:27:402
339960,0migration/34048-21sh09:18:543
339960,0migration/33804-21sh09:38:303
339960,0migration/33769-21sh11:20:483
339960,0migration/329615-21sh11:57:363
339960,0migration/329065-21sh09:36:103
339960,0migration/328260-21sh09:54:163
339960,0migration/327425-21sh10:53:043
339960,0migration/32498-21sh11:37:523
339960,0migration/320330-21sh11:32:123
339960,0migration/319140-21sh12:09:343
339960,0migration/318965-21sh10:47:423
339960,0migration/312512-21sh10:46:293
339960,0migration/312255-21sh11:06:203
29725060,0irq/27-eth0-tx-17202-21munin-node07:12:420
29725060,0irq/27-eth0-tx-11669-21ssh11:45:472
29715060,0irq/26-eth0-rx-11482-21ssh09:03:093
226689964,0cyclictest0-21swapper/210:11:582
226689963,0cyclictest3556-21lldpd09:50:192
226689962,0cyclictest14397-21awk08:22:342
226689960,0cyclictest28120-21latency_hist12:17:192
226689960,0cyclictest0-21swapper/212:12:332
226689960,0cyclictest0-21swapper/212:11:442
226689960,0cyclictest0-21swapper/211:31:482
226689960,0cyclictest0-21swapper/210:48:082
226689960,0cyclictest0-21swapper/210:39:032
226689960,0cyclictest0-21swapper/209:55:432
226689960,0cyclictest0-21swapper/209:47:012
226689960,0cyclictest0-21swapper/209:26:292
226689960,0cyclictest0-21swapper/209:08:162
226689960,0cyclictest0-21swapper/209:02:322
226689960,0cyclictest0-21swapper/208:57:462
226669965,0cyclictest29476-21sh09:37:191
226659960,0cyclictest0-21swapper/009:20:050
149960,0migration/03299-21sh11:19:320
149960,0migration/027528-21sh11:14:050
149960,0migration/027491-21sh12:15:310
149960,0migration/027377-21sh10:52:560
149960,0migration/026044-21unixbench-2d08:27:410
149960,0migration/018779-21fschecks_time07:37:330
149960,0migration/011660-21sh09:03:360
149960,0migration/010191-21missed_timers07:27:370
4150,0ktimersoftd/00-21swapper/011:41:490
339950,0migration/38834-21kthreadcore10:22:373
339950,0migration/35854-21kthreadcore08:37:373
339950,0migration/3531-21fschecks_count08:12:313
339950,0migration/331140-21kthreadcore10:37:363
339950,0migration/330591-21aten_r1power_en07:22:313
339950,0migration/330015-21kthreadcore08:07:373
339950,0migration/327596-21taskset11:34:573
339950,0migration/326819-21taskset08:32:273
339950,0migration/324542-21munin-node08:02:373
339950,0migration/323734-21munin-node06:52:333
339950,0migration/323571-21needreboot07:37:383
339950,0migration/323529-21kthreadcore09:12:363
339950,0migration/322724-21pmu-power07:12:393
339950,0migration/322217-21sh10:32:343
339950,0migration/321314-21munin-node11:12:323
339950,0migration/319212-21kthreadcore08:47:363
339950,0migration/317442-21unixbench_multi07:32:433
339950,0migration/316760-21taskset07:09:583
339950,0migration/313859-21fschecks_count09:07:323
339950,0migration/313377-21aten_r1power_cu10:07:313
339950,0migration/312904-21df_abs07:57:323
29725050,0irq/27-eth0-tx-24851-21munin-node07:42:320
29725050,0irq/27-eth0-tx-24851-21munin-node07:42:320
29725050,0irq/27-eth0-tx-23889-21munin-node07:17:340
29725050,0irq/27-eth0-tx-14560-21munin-node08:47:320
29725050,0irq/27-eth0-tx-0-21swapper/008:37:390
29715050,0irq/26-eth0-rx-865-21kthreadcore08:57:373
29715050,0irq/26-eth0-rx-5434-21irqcore11:42:343
29715050,0irq/26-eth0-rx-28236-21ssh11:57:083
29715050,0irq/26-eth0-rx-13717-21egrep09:47:313
29715050,0irq/26-eth0-rx-11554-21ssh10:02:583
29715050,0irq/26-eth0-rx-1046-21cut10:17:363
29715050,0irq/26-eth0-rx-0-21swapper/311:08:363
29715050,0irq/26-eth0-rx-0-21swapper/310:29:183
29715050,0irq/26-eth0-rx-0-21swapper/310:17:193
29715050,0irq/26-eth0-rx-0-21swapper/309:59:503
29715050,0irq/26-eth0-rx-0-21swapper/309:31:373
29715050,0irq/26-eth0-rx-0-21swapper/308:54:553
27150,0ktimersoftd/20-21swapper/210:58:482
226689955,0cyclictest0-21swapper/210:54:232
226689955,0cyclictest0-21swapper/210:25:222
226689954,0cyclictest0-21swapper/210:31:222
226689952,0cyclictest19120-21awk07:37:352
226689950,0cyclictest0-21swapper/211:59:062
226689950,0cyclictest0-21swapper/211:52:332
226689950,0cyclictest0-21swapper/211:51:182
226689950,0cyclictest0-21swapper/211:34:152
226689950,0cyclictest0-21swapper/211:12:592
226689950,0cyclictest0-21swapper/210:42:382
226689950,0cyclictest0-21swapper/210:20:172
226689950,0cyclictest0-21swapper/210:15:402
226689950,0cyclictest0-21swapper/210:06:522
226689950,0cyclictest0-21swapper/209:33:312
226689950,0cyclictest0-21swapper/209:17:212
226689950,0cyclictest0-21swapper/209:14:562
226669955,0cyclictest0-21swapper/111:30:041
226669955,0cyclictest0-21swapper/111:02:291
226669955,0cyclictest0-21swapper/109:57:501
226669955,0cyclictest0-21swapper/109:53:541
226669955,0cyclictest0-21swapper/108:52:251
226669954,0cyclictest6710-21irqrtprio09:22:351
226669950,0cyclictest0-21swapper/111:18:151
226659955,0cyclictest0-21swapper/011:59:280
226659955,0cyclictest0-21swapper/009:37:440
226659950,0cyclictest0-21swapper/011:32:020
19150,0ktimersoftd/10-21swapper/112:18:281
19150,0ktimersoftd/10-21swapper/111:54:591
19150,0ktimersoftd/10-21swapper/109:03:551
179950,0migration/14934-21aten2.4-expect07:27:301
179950,0migration/130308-21idleruntime-cro07:22:201
179950,0migration/124454-21kthreadcore11:32:371
179950,0migration/123952-21timerandwakeup07:37:431
179950,0migration/121366-21latency_hist09:12:191
149950,0migration/0599-21kthreadcore09:57:360
149950,0migration/05312-21aten_r1power_en10:02:290
149950,0migration/04079-21runrttasks09:00:300
149950,0migration/03462-21taskset10:59:180
149950,0migration/03403-21kthreadcore07:47:370
149950,0migration/032209-21kthreadcore06:57:370
149950,0migration/026493-21switchtime11:32:420
149950,0migration/024608-21kthreadcore08:52:360
149950,0migration/021486-21aten_r1power_vo10:12:300
149950,0migration/020348-21taskset09:49:410
149950,0migration/01871-21kthreadcore07:22:380
149950,0migration/016165-21kthreadcore10:47:360
149950,0migration/013874-21kthreadcore07:32:370
149950,0migration/013789-21munin-node11:07:340
149950,0migration/012867-21kthreadcore08:42:350
339940,0migration/38621-21kthreadcore08:17:353
339940,0migration/310972-21diskmemload12:04:133
339940,0migration/310457-21kthreadcore09:22:373
339940,0migration/310044-21kthreadcore09:42:373
29725040,0irq/27-eth0-tx-0-21swapper/209:58:332
29725040,0irq/27-eth0-tx-0-21swapper/008:26:480
29725040,0irq/27-eth0-tx-0-21swapper/007:59:180
29715040,0irq/26-eth0-rx-6559-21runrttasks10:57:343
29715040,0irq/26-eth0-rx-30456-21if_eth006:57:353
29715040,0irq/26-eth0-rx-28414-21aten_r1power_cu12:17:273
29715040,0irq/26-eth0-rx-0-21swapper/312:12:303
29715040,0irq/26-eth0-rx-0-21swapper/311:48:243
29715040,0irq/26-eth0-rx-0-21swapper/308:27:303
226689943,0cyclictest5148-21sadc09:42:192
226689943,0cyclictest3556-21lldpd10:36:192
226689943,0cyclictest3556-21lldpd08:36:182
226689943,0cyclictest3556-21lldpd07:52:482
226689943,0cyclictest3556-21lldpd07:50:182
226689943,0cyclictest3556-21lldpd07:42:472
226689943,0cyclictest3556-21lldpd07:42:472
226689943,0cyclictest3556-21lldpd07:36:472
226689943,0cyclictest3556-21lldpd07:12:472
226689943,0cyclictest3556-21lldpd06:52:472
226689943,0cyclictest3514-21snmpd08:38:472
226689943,0cyclictest3514-21snmpd07:19:012
226689940,0cyclictest5409-21munin-node11:22:332
226669944,0cyclictest0-21swapper/111:39:511
226669944,0cyclictest0-21swapper/110:50:581
226669944,0cyclictest0-21swapper/108:59:121
226669943,0cyclictest6887-21awk07:52:351
226669943,0cyclictest3556-21lldpd12:02:501
226669943,0cyclictest3556-21lldpd10:39:191
226669943,0cyclictest3556-21lldpd08:46:481
226669943,0cyclictest3556-21lldpd08:33:481
226669943,0cyclictest3556-21lldpd08:17:481
226669943,0cyclictest32288-21sadc08:12:201
226669943,0cyclictest14575-21awk09:27:321
226669943,0cyclictest14494-21awk09:47:351
226669943,0cyclictest13493-21awk07:57:341
226669943,0cyclictest13383-21awk11:47:341
226659944,0cyclictest0-21swapper/010:10:130
226659944,0cyclictest0-21swapper/009:24:010
226659944,0cyclictest0-21swapper/008:02:400
226659943,0cyclictest8595-21kworker/0:009:28:450
226659943,0cyclictest6614-21head07:52:330
226659943,0cyclictest6010-21sort10:42:340
226659943,0cyclictest5483-21awk11:22:330
226659943,0cyclictest5254-21awk11:42:320
226659943,0cyclictest3514-21snmpd12:06:330
226659943,0cyclictest3241-21irqbalance12:19:570
226659943,0cyclictest3241-21irqbalance10:22:480
226659943,0cyclictest3241-21irqbalance09:15:380
226659943,0cyclictest30289-21awk10:17:330
226659943,0cyclictest22706-21awk09:32:350
226659943,0cyclictest22049-21awk10:32:330
179940,0migration/18519-21kthreadcore07:02:361
179940,0migration/15900-21kthreadcore11:42:351
179940,0migration/14973-21latency_hist10:22:191
179940,0migration/132760-21kthreadcore09:37:371
179940,0migration/132729-21kthreadcore07:22:371
179940,0migration/130850-21kthreadcore10:57:351
179940,0migration/130244-21munin-node09:17:311
179940,0migration/127065-21taskset11:12:441
179940,0migration/125124-21kthreadcore10:12:351
179940,0migration/122107-21kthreadcore08:27:351
179940,0migration/121210-21aten_r1power_po10:52:301
179940,0migration/12096-21kthreadcore08:12:341
179940,0migration/120814-21fschecks_count12:12:311
179940,0migration/119315-21aten_r1power_po08:02:301
179940,0migration/119041-21pmu-power08:22:391
179940,0migration/115951-21kthreadcore10:07:371
179940,0migration/114462-21kthreadcore07:32:371
179940,0migration/114270-21irqcore10:27:361
179940,0migration/112593-21kthreadcore07:07:381
179940,0migration/112087-21taskset10:04:321
179940,0migration/11180-21kthreadcore10:17:361
179940,0migration/110584-21munin-node10:42:381
169940,0watchdog/129172-21fschecks_time11:57:331
169940,0watchdog/127049-21expr09:12:381
169940,0watchdog/124851-21munin-node07:42:381
169940,0watchdog/124851-21munin-node07:42:381
169940,0watchdog/115496-21kthreadcore12:07:371
169940,0watchdog/10-21swapper/111:07:371
149940,0migration/030426-21irqcore10:37:360
149940,0migration/025912-21aten_r1power_cu08:07:300
149940,0migration/015067-21kthreadcore12:07:360
29715030,0irq/26-eth0-rx-0-21swapper/311:22:213
29715030,0irq/26-eth0-rx-0-21swapper/308:42:403
29715030,0irq/26-eth0-rx-0-21swapper/307:52:303
29715030,0irq/26-eth0-rx-0-21swapper/307:47:373
29715030,0irq/26-eth0-rx-0-21swapper/307:44:353
29715030,0irq/26-eth0-rx-0-21swapper/307:44:353
29715030,0irq/26-eth0-rx-0-21swapper/307:29:463
29715030,0irq/26-eth0-rx-0-21swapper/307:19:593
29715030,0irq/26-eth0-rx-0-21swapper/307:06:523
249930,0watchdog/20-21swapper/207:57:302
249930,0watchdog/20-21swapper/207:07:422
226689933,0cyclictest3556-21lldpd08:18:482
226689932,0cyclictest8274-21grep08:42:302
226689932,0cyclictest5695-21awk07:27:342
226689932,0cyclictest4744-21awk07:02:332
226689932,0cyclictest30423-21awk06:57:342
226689932,0cyclictest26117-21cpuspeed_turbos08:07:312
226689932,0cyclictest20120-21awk08:02:342
226689932,0cyclictest15444-21awk08:47:342
226669932,0cyclictest3556-21lldpd11:22:191
226669932,0cyclictest2045-21awk08:37:351
226669932,0cyclictest15750-21sed08:47:351
226669930,0cyclictest0-21swapper/107:16:431
226659933,0cyclictest8595-21kworker/0:009:08:290
226659933,0cyclictest2646-21kworker/0:208:17:270
226659933,0cyclictest2646-21kworker/0:208:12:230
226659933,0cyclictest2646-21kworker/0:207:07:230
226659933,0cyclictest2646-21kworker/0:207:02:240
226659933,0cyclictest2646-21kworker/0:206:52:260
226659933,0cyclictest22504-21kworker/0:211:52:380
226659933,0cyclictest22504-21kworker/0:211:47:240
226659933,0cyclictest22504-21kworker/0:209:42:210
226659932,0cyclictest5724-21awk11:02:330
226659932,0cyclictest27349-21sensors09:52:400
226659932,0cyclictest14193-21awk10:27:350
226659930,0cyclictest0-21swapper/008:32:280
179930,0migration/12165-21kthreadcore07:47:371
169930,0watchdog/10-21swapper/110:32:291
169930,0watchdog/10-21swapper/109:42:261
169930,0watchdog/10-21swapper/106:57:541
169930,0watchdog/10-21swapper/106:52:341
29715020,0irq/26-eth0-rx-0-21swapper/308:22:303
226689921,0cyclictest30523-21date07:22:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional