You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 20:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Jul 07, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
529823826,0sleep30-21swapper/306:45:433
1132823524,0sleep00-21swapper/006:47:160
1152323223,0sleep10-21swapper/106:49:331
1154422723,0sleep20-21swapper/206:49:502
339970,0migration/325314-21sh11:40:273
8215060,0irq/24-0000:00:9085-21munin-run11:50:292
339960,0migration/39151-21sh10:29:113
339960,0migration/38897-21sh10:48:473
339960,0migration/324691-21sh10:37:343
339960,0migration/319497-21munin-node07:40:533
339960,0migration/310916-21kthreadcore11:30:463
29715060,0irq/26-eth0-rx-31751-21sendmail_mailqu10:40:513
29715060,0irq/26-eth0-rx-19144-21iostat10:15:463
29715060,0irq/26-eth0-rx-12060-21cat09:50:483
27160,0ktimersoftd/20-21swapper/211:51:102
27160,0ktimersoftd/20-21swapper/207:15:542
149960,0migration/0997-21sh09:22:520
149960,0migration/08952-21taskset10:28:360
149960,0migration/08788-21ntp_offset08:45:500
149960,0migration/025161-21sh09:17:180
149960,0migration/017824-21sh09:55:010
149960,0migration/017344-21sh09:33:250
149960,0migration/016414-21sh10:31:510
116769966,0cyclictest0-21swapper/209:45:502
116769966,0cyclictest0-21swapper/209:22:302
116759966,0cyclictest9777-21diskmemload11:37:291
116759965,0cyclictest10689-21sort11:50:451
116759960,0cyclictest0-21swapper/110:22:171
8215050,0irq/24-0000:00:23506-21munin-node10:35:502
35150,0ktimersoftd/30-21swapper/310:57:283
339950,0migration/39088-21idleruntime-cro11:50:293
339950,0migration/38115-21sh10:05:533
339950,0migration/36812-21kthreadcore09:45:483
339950,0migration/36516-21taskset07:31:543
339950,0migration/35120-21munin-node07:05:513
339950,0migration/33170-21irqrtprio09:05:473
339950,0migration/328741-21kthreadcore10:00:473
339950,0migration/321115-21sh08:10:303
339950,0migration/319924-21kthreadcore06:55:483
339950,0migration/317963-21sh08:55:413
339950,0migration/317512-21sh12:15:413
339950,0migration/31529-21df_abs12:05:423
339950,0migration/312217-21kthreadcore09:30:473
339950,0migration/311160-21idleruntime09:10:453
339950,0migration/310587-21taskset10:50:443
29725050,0irq/27-eth0-tx-9900-21munin-node10:30:442
29725050,0irq/27-eth0-tx-8583-21ssh11:08:082
29725050,0irq/27-eth0-tx-32614-21ssh09:41:132
29725050,0irq/27-eth0-tx-32610-21ssh09:01:502
29725050,0irq/27-eth0-tx-29683-21cut11:20:472
29725050,0irq/27-eth0-tx-19971-21cut10:55:472
29725050,0irq/27-eth0-tx-18120-21munin-node10:15:442
29725050,0irq/27-eth0-tx-16917-21ssh12:15:052
29725050,0irq/27-eth0-tx-15617-21load09:50:502
29725050,0irq/27-eth0-tx-0-21swapper/209:25:442
29725050,0irq/27-eth0-tx-0-21swapper/209:06:212
29725050,0irq/27-eth0-tx-0-21swapper/208:53:562
29725050,0irq/27-eth0-tx-0-21swapper/008:50:450
29725050,0irq/27-eth0-tx-0-21swapper/008:28:070
29725050,0irq/27-eth0-tx-0-21swapper/008:15:410
29725050,0irq/27-eth0-tx-0-21swapper/007:22:370
29715050,0irq/26-eth0-rx-8813-21ssh09:27:043
29715050,0irq/26-eth0-rx-25700-21ssh11:20:313
29715050,0irq/26-eth0-rx-21280-21kthreadcore09:55:473
29715050,0irq/26-eth0-rx-15727-21swap10:30:523
29715050,0irq/26-eth0-rx-15379-21kthreadcore06:50:493
29715050,0irq/26-eth0-rx-0-21swapper/312:10:543
29715050,0irq/26-eth0-rx-0-21swapper/311:52:153
29715050,0irq/26-eth0-rx-0-21swapper/311:14:343
29715050,0irq/26-eth0-rx-0-21swapper/311:07:473
29715050,0irq/26-eth0-rx-0-21swapper/311:02:403
29715050,0irq/26-eth0-rx-0-21swapper/310:20:463
29715050,0irq/26-eth0-rx-0-21swapper/310:11:163
29715050,0irq/26-eth0-rx-0-21swapper/309:40:393
29715050,0irq/26-eth0-rx-0-21swapper/309:21:183
29715050,0irq/26-eth0-rx-0-21swapper/309:15:333
29715050,0irq/26-eth0-rx-0-21swapper/309:05:133
29715050,0irq/26-eth0-rx-0-21swapper/308:53:213
29715050,0irq/26-eth0-rx-0-21swapper/308:05:303
29715050,0irq/26-eth0-rx-0-21swapper/308:00:303
259950,0migration/27226-21munin-node10:45:492
259950,0migration/2716-21sh10:23:292
259950,0migration/23554-21kernelversion08:20:482
259950,0migration/231107-21kthreadcore08:40:462
259950,0migration/224350-21munin-node09:55:532
259950,0migration/211128-21kthreadcore08:00:492
259950,0migration/210173-21aten_r1power_po10:10:442
249950,0watchdog/227685-21kthreadcore12:00:482
249950,0watchdog/226373-21ssh11:00:442
249950,0watchdog/218807-21irqcore11:15:442
249950,0watchdog/20-21swapper/211:40:482
249950,0watchdog/20-21swapper/208:58:572
179950,0migration/127090-21kthreadcore07:00:471
179950,0migration/126512-21kthreadcore08:10:501
179950,0migration/121133-21idleruntime-cro08:10:301
179950,0migration/117666-21munin-node11:55:431
179950,0migration/116296-21sh12:13:181
179950,0migration/115356-21kthreadcore07:15:481
179950,0migration/111896-21kthreadcore11:30:471
169950,0watchdog/126391-21grep11:00:441
149950,0migration/0994-21taskset07:54:580
149950,0migration/08979-21sh10:08:160
149950,0migration/08029-21kthreadcore07:10:500
149950,0migration/07415-21df_abs07:35:420
149950,0migration/06180-21kthreadcore07:55:460
149950,0migration/04425-21kthreadcore09:25:470
149950,0migration/030354-21kthreadcore10:00:480
149950,0migration/029567-21kthreadcore09:00:480
149950,0migration/029061-21kthreadcore11:20:470
149950,0migration/028347-21kthreadcore10:40:460
149950,0migration/027712-21taskset08:14:590
149950,0migration/027618-21kthreadcore07:00:470
149950,0migration/026282-21df_abs11:00:430
149950,0migration/026194-21aten_r1power_fr10:20:400
149950,0migration/025866-21taskset09:39:550
149950,0migration/025850-21latency_hist10:40:300
149950,0migration/024515-21sh11:38:120
149950,0migration/023630-21sh11:56:070
149950,0migration/018572-21aten_r1power_en06:55:430
149950,0migration/017883-21latency_hist08:55:300
149950,0migration/015180-21runrttasks07:40:470
149950,0migration/014498-21munin-plugin-st08:05:300
149950,0migration/012235-21kthreadcore10:50:470
149950,0migration/010909-21kthreadcore12:10:470
149950,0migration/010354-21fschecks_time11:10:440
116769955,0cyclictest0-21swapper/212:00:102
116769955,0cyclictest0-21swapper/210:26:212
116769950,0cyclictest0-21swapper/212:09:472
116769950,0cyclictest0-21swapper/210:52:412
116759955,0cyclictest0-21swapper/112:05:231
116759955,0cyclictest0-21swapper/109:24:441
116759950,0cyclictest0-21swapper/109:38:461
339940,0migration/3684-21taskset07:51:573
339940,0migration/330158-21kthreadcore08:15:473
339940,0migration/323891-21kthreadcore08:35:463
339940,0migration/321339-21taskset08:10:343
339940,0migration/321070-21ntp_offset08:30:503
339940,0migration/312673-21latency_hist07:15:313
29725040,0irq/27-eth0-tx-6559-21runrttasks08:30:420
29725040,0irq/27-eth0-tx-0-21swapper/211:31:252
29725040,0irq/27-eth0-tx-0-21swapper/210:40:342
29725040,0irq/27-eth0-tx-0-21swapper/210:05:432
29725040,0irq/27-eth0-tx-0-21swapper/209:35:392
29725040,0irq/27-eth0-tx-0-21swapper/209:32:402
29725040,0irq/27-eth0-tx-0-21swapper/209:16:212
29725040,0irq/27-eth0-tx-0-21swapper/209:10:512
29725040,0irq/27-eth0-tx-0-21swapper/006:52:080
29715040,0irq/26-eth0-rx-0-21swapper/312:00:343
29715040,0irq/26-eth0-rx-0-21swapper/311:58:453
29715040,0irq/26-eth0-rx-0-21swapper/311:40:413
29715040,0irq/26-eth0-rx-0-21swapper/311:25:343
29715040,0irq/26-eth0-rx-0-21swapper/311:17:193
29715040,0irq/26-eth0-rx-0-21swapper/309:35:383
29715040,0irq/26-eth0-rx-0-21swapper/307:00:513
259940,0migration/27303-21kthreadcore08:45:482
259940,0migration/26082-21latency_hist07:10:312
259940,0migration/24304-21kthreadcore07:05:472
259940,0migration/228536-21kthreadcore07:50:462
259940,0migration/228232-21cpuspeed_turbos08:15:422
259940,0migration/223896-21kthreadcore08:35:462
259940,0migration/217379-21kthreadcore08:30:472
259940,0migration/213269-21kthreadcore06:50:482
249940,0watchdog/218869-21kthreadcore08:05:492
249940,0watchdog/216312-21awk11:12:122
249940,0watchdog/20-21swapper/211:35:442
179940,0migration/17602-21sh12:06:331
179940,0migration/16729-21taskset07:34:131
179940,0migration/16646-21fschecks_count07:10:471
179940,0migration/14257-21kthreadcore11:05:471
179940,0migration/13225-21kthreadcore10:25:471
179940,0migration/131463-21needreboot07:25:501
179940,0migration/129710-21kthreadcore08:15:471
179940,0migration/128459-21taskset08:37:141
179940,0migration/128069-21kthreadcore09:00:471
179940,0migration/127669-21kthreadcore11:20:461
179940,0migration/123556-21open_files08:55:521
179940,0migration/12134-21kthreadcore07:05:461
179940,0migration/116078-21taskset10:30:541
179940,0migration/114932-21kthreadcore10:10:501
179940,0migration/114259-21fschecks_count07:40:441
179940,0migration/112484-21kthreadcore09:50:481
179940,0migration/111414-21irqcore09:30:471
169940,0watchdog/19512-21kthreadcore08:00:491
169940,0watchdog/18644-21ssh09:47:001
169940,0watchdog/17872sleep107:52:571
169940,0watchdog/17105-21python11:45:521
169940,0watchdog/16926-21cut09:05:481
169940,0watchdog/12869-21fschecks_time08:20:451
169940,0watchdog/126332-21ssh09:40:361
169940,0watchdog/125961-21ssh10:40:321
169940,0watchdog/115500-21kthreadcore09:10:481
169940,0watchdog/10-21swapper/111:40:481
169940,0watchdog/10-21swapper/109:25:481
169940,0watchdog/10-21swapper/108:25:491
149940,0migration/05558-21kthreadcore11:05:470
149940,0migration/05474-21kthreadcore09:05:480
149940,0migration/032417-21sh11:42:510
149940,0migration/030644-21kthreadcore12:00:490
149940,0migration/018110-21missed_timers07:15:500
149940,0migration/017899-21cpu11:15:400
149940,0migration/013376-21kthreadcore11:50:460
149940,0migration/013048-21kthreadcore10:10:500
116769943,0cyclictest7952-21awk07:35:442
116769943,0cyclictest3556-21lldpd10:01:092
116769943,0cyclictest2346-21awk11:25:452
116769943,0cyclictest22329-21awk08:10:482
116769943,0cyclictest21322-21awk07:45:462
116769943,0cyclictest18222-21awk12:15:442
116769943,0cyclictest14609-21awk07:40:452
116759943,0cyclictest7922-21awk07:35:441
116759943,0cyclictest3556-21lldpd10:52:091
116759943,0cyclictest3556-21lldpd10:37:091
116759943,0cyclictest3556-21lldpd09:16:081
116759943,0cyclictest3556-21lldpd08:51:071
116759943,0cyclictest3556-21lldpd08:30:371
116759943,0cyclictest3241-21irqbalance10:55:581
116759943,0cyclictest3241-21irqbalance10:47:481
116759943,0cyclictest3241-21irqbalance09:55:581
116759943,0cyclictest29865-21awk08:40:451
116759943,0cyclictest2825-21awk10:05:441
116759943,0cyclictest19072-21awk10:15:461
116759943,0cyclictest18596-21awk11:15:421
116759943,0cyclictest18254-21awk12:15:441
116749944,0cyclictest0-21swapper/009:45:310
116749943,0cyclictest7895-21kworker/0:212:09:450
116749943,0cyclictest7895-21kworker/0:210:55:590
116749943,0cyclictest3556-21lldpd09:45:080
116749943,0cyclictest18279-21awk12:15:440
116749943,0cyclictest15628-21awk08:05:460
116749943,0cyclictest10385-21awk11:30:440
116749940,0cyclictest0-21swapper/011:48:300
29715030,0irq/26-eth0-rx-0-21swapper/308:46:013
29715030,0irq/26-eth0-rx-0-21swapper/308:25:483
29715030,0irq/26-eth0-rx-0-21swapper/308:23:593
29715030,0irq/26-eth0-rx-0-21swapper/307:46:193
29715030,0irq/26-eth0-rx-0-21swapper/307:26:163
29715030,0irq/26-eth0-rx-0-21swapper/307:20:523
29715030,0irq/26-eth0-rx-0-21swapper/307:15:423
259930,0migration/21705-21fschecks_count07:55:422
249930,0watchdog/20-21swapper/208:25:492
249930,0watchdog/20-21swapper/207:25:452
169930,0watchdog/10-21swapper/110:03:161
116769932,0cyclictest26071-21awk07:00:452
116769932,0cyclictest23329-21kthreadcore07:20:482
116769932,0cyclictest19351-21awk06:55:462
116759932,0cyclictest6677-21grep07:55:471
116759932,0cyclictest3556-21lldpd11:10:391
116759932,0cyclictest3556-21lldpd08:48:071
116759932,0cyclictest3556-21lldpd07:23:081
116759932,0cyclictest21259-21awk07:45:451
116759932,0cyclictest12865-21awk06:50:471
116759931,0cyclictest21597-21kthreadcore06:55:491
116759930,0cyclictest4466-21kthreadcore11:25:471
116749933,0cyclictest7895-21kworker/0:210:45:310
116749933,0cyclictest7895-21kworker/0:210:15:310
116749933,0cyclictest7895-21kworker/0:209:55:370
116749933,0cyclictest23056-21kworker/0:008:40:320
116749933,0cyclictest13926-21kworker/0:208:20:320
116749933,0cyclictest13926-21kworker/0:207:45:320
116749933,0cyclictest13926-21kworker/0:207:30:340
116749932,0cyclictest3514-21snmpd11:25:370
116749932,0cyclictest1495-21kthreadcore07:05:460
116749932,0cyclictest11211-21awk09:10:450
116749930,0cyclictest22675-21diskstats08:35:430
116749930,0cyclictest0-21swapper/007:25:510
29715020,0irq/26-eth0-rx-0-21swapper/308:41:193
29715020,0irq/26-eth0-rx-0-21swapper/307:35:343
249920,0watchdog/20-21swapper/207:30:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional