You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 22:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Mar 24, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1867023625,0sleep20-21swapper/207:00:092
1844223626,0sleep10-21swapper/106:57:321
304450350,0irq/25-eth10-21swapper/306:57:133
1861423228,0sleep00-21swapper/006:59:310
187659970,0cyclictest0-21swapper/009:14:360
339960,0migration/35492-21sh11:33:533
339960,0migration/328380-21sh12:28:473
339960,0migration/314402-21sh10:16:483
29725060,0irq/27-eth0-tx-23438-21ssh09:01:280
29715060,0irq/26-eth0-rx-31064-21ssh09:45:543
29715060,0irq/26-eth0-rx-20664-21ssh11:20:523
29715060,0irq/26-eth0-rx-19184-21kthreadcore09:40:443
187669966,0cyclictest16892-21diskmemload10:49:291
187669960,0cyclictest16892-21diskmemload11:31:341
149960,0migration/021094-21sh12:04:080
149960,0migration/016120-21sh09:38:450
149960,0migration/014874-21sh10:39:320
8215050,0irq/24-0000:00:7354-21dump-pmu-power07:40:282
8215050,0irq/24-0000:00:0-21swapper/207:05:282
4150,0ktimersoftd/00-21swapper/009:06:340
339950,0migration/39985-21taskset08:52:313
339950,0migration/39530-21kthreadcore10:55:463
339950,0migration/37256-21sh09:10:523
339950,0migration/36750-21cpu07:15:403
339950,0migration/33517-21kthreadcore09:50:443
339950,0migration/33108-21taskset08:46:193
339950,0migration/330272-21fschecks_count12:10:413
339950,0migration/329972-21taskset11:29:133
339950,0migration/328628-21munin-node08:20:383
339950,0migration/327792-21kthreadcore09:25:453
339950,0migration/327426-21kthreadcore10:25:453
339950,0migration/322730-21sh10:22:493
339950,0migration/32165-21kthreadcore07:35:443
339950,0migration/321034-21cpu07:50:413
339950,0migration/317485-21munin-node10:00:433
339950,0migration/316223-21irqcore11:00:443
29725050,0irq/27-eth0-tx-8085-21sort11:15:462
29725050,0irq/27-eth0-tx-5868-21munin-node11:55:482
29725050,0irq/27-eth0-tx-31452-21munin-node10:50:452
29725050,0irq/27-eth0-tx-31348-21sed09:25:502
29725050,0irq/27-eth0-tx-30662-21munin-node11:30:382
29725050,0irq/27-eth0-tx-27248-21kthreadcore10:25:452
29725050,0irq/27-eth0-tx-22265-21munin-node11:45:512
29725050,0irq/27-eth0-tx-1942-21grep11:10:442
29725050,0irq/27-eth0-tx-14842-21perl11:40:392
29725050,0irq/27-eth0-tx-14234-21munin-node07:45:460
29725050,0irq/27-eth0-tx-0-21swapper/211:27:102
29725050,0irq/27-eth0-tx-0-21swapper/210:12:102
29725050,0irq/27-eth0-tx-0-21swapper/209:55:392
29725050,0irq/27-eth0-tx-0-21swapper/209:14:292
29725050,0irq/27-eth0-tx-0-21swapper/209:08:432
29725050,0irq/27-eth0-tx-0-21swapper/008:52:410
29725050,0irq/27-eth0-tx-0-21swapper/008:45:150
29725050,0irq/27-eth0-tx-0-21swapper/008:32:370
29725050,0irq/27-eth0-tx-0-21swapper/007:15:440
29715050,0irq/26-eth0-rx-7599-21sed08:00:513
29715050,0irq/26-eth0-rx-7223-21kthreadcore11:55:443
29715050,0irq/26-eth0-rx-6559-21runrttasks09:16:073
29715050,0irq/26-eth0-rx-322-21df_abs10:10:413
29715050,0irq/26-eth0-rx-32164-21gltestperf10:50:423
29715050,0irq/26-eth0-rx-31129-21cat09:05:503
29715050,0irq/26-eth0-rx-30292-21ssh11:09:063
29715050,0irq/26-eth0-rx-26804-21grep11:45:443
29715050,0irq/26-eth0-rx-202872sleep307:46:333
29715050,0irq/26-eth0-rx-18182-21irqcore09:00:453
29715050,0irq/26-eth0-rx-16436-21kthreadcore12:20:443
29715050,0irq/26-eth0-rx-15932-21fschecks_count10:40:423
29715050,0irq/26-eth0-rx-14612-21unixbench_singl09:55:513
29715050,0irq/26-eth0-rx-11144-21kthreadcore11:15:473
29715050,0irq/26-eth0-rx-0-21swapper/312:18:093
29715050,0irq/26-eth0-rx-0-21swapper/312:00:453
29715050,0irq/26-eth0-rx-0-21swapper/309:20:443
27150,0ktimersoftd/220654-21ssh12:24:272
259950,0migration/231239-21sh09:46:242
259950,0migration/231168-21taskset10:50:272
259950,0migration/228994-21kthreadcore07:30:442
259950,0migration/222893-21ntp_kernel_err09:20:472
259950,0migration/222750-21smart_sdb09:40:502
259950,0migration/214435-21sh10:59:192
259950,0migration/211708-21sh12:16:352
19150,0ktimersoftd/10-21swapper/110:13:061
19150,0ktimersoftd/10-21swapper/109:06:341
187679955,0cyclictest0-21swapper/212:08:132
187679955,0cyclictest0-21swapper/211:53:522
187679955,0cyclictest0-21swapper/210:00:402
187679953,0cyclictest0-21swapper/210:05:432
187679950,0cyclictest0-21swapper/212:03:572
187679950,0cyclictest0-21swapper/211:20:362
187679950,0cyclictest0-21swapper/211:01:032
187669955,0cyclictest0-21swapper/111:28:061
187669955,0cyclictest0-21swapper/110:24:341
187669955,0cyclictest0-21swapper/109:44:311
187669955,0cyclictest0-21swapper/108:35:561
187669950,0cyclictest0-21swapper/111:00:311
187669950,0cyclictest0-21swapper/108:00:561
187659955,0cyclictest0-21swapper/012:19:320
187659955,0cyclictest0-21swapper/011:15:220
179950,0migration/18907-21kthreadcore08:50:461
179950,0migration/16835-21sendmail_mailst09:30:501
179950,0migration/15956-21fschecks_time12:15:421
179950,0migration/1553-21munin-node07:10:411
179950,0migration/125825-21kthreadcore08:40:461
179950,0migration/124923-21kthreadcore11:05:441
179950,0migration/123255-21kthreadcore12:25:431
179950,0migration/122835-21needreboot09:20:461
179950,0migration/122304-21kthreadcore07:25:441
179950,0migration/121011-21timerwakeupswit08:10:511
179950,0migration/111625-21kthreadcore09:35:451
169950,0watchdog/12012-21kthreadcore12:10:451
149950,0migration/09520-21kthreadcore10:15:440
149950,0migration/07735-21taskset09:32:240
149950,0migration/04009-21kthreadcore09:50:440
149950,0migration/028283-21kthreadcore07:30:440
149950,0migration/026734-21kthreadcore10:45:460
149950,0migration/024515-21fschecks_time10:25:410
149950,0migration/024393-21latency_hist10:05:280
149950,0migration/024288-21kthreadcore12:25:440
149950,0migration/024147-21kthreadcore11:45:430
149950,0migration/02400-21needreboot08:45:460
149950,0migration/023905-21kthreadcore08:15:460
149950,0migration/023880-21irqcore11:25:460
149950,0migration/022465-21fschecks_time12:05:400
149950,0migration/020551-21needreboot08:10:470
149950,0migration/01964-21kthreadcore10:10:450
149950,0migration/018647-21kthreadcore09:40:440
149950,0migration/015315-21irqcore11:40:420
149950,0migration/01517-21kthreadcore07:10:440
149950,0migration/013995-21munin-node08:05:510
149950,0migration/013660-21taskset11:18:070
149950,0migration/013220-21unixbench_singl10:55:520
149950,0migration/01281-21kthreadcore10:50:450
149950,0migration/012737-21taskset11:36:530
339940,0migration/36496-21kthreadcore08:25:463
339940,0migration/332213-21kthreadcore07:55:463
339940,0migration/331923-21taskset07:09:233
339940,0migration/331609-21kthreadcore11:50:443
339940,0migration/321071-21diskmemload11:42:453
339940,0migration/318530-21kthreadcore08:10:453
339940,0migration/310870-21kthreadcore08:05:473
339940,0migration/310748-21kthreadcore10:35:473
339940,0migration/310054-21kthreadcore11:35:433
29725040,0irq/27-eth0-tx-2741-21aten2.4-expect08:25:390
29725040,0irq/27-eth0-tx-14185-21ssh10:16:052
29725040,0irq/27-eth0-tx-0-21swapper/212:10:382
29725040,0irq/27-eth0-tx-0-21swapper/211:36:552
29725040,0irq/27-eth0-tx-0-21swapper/211:06:012
29725040,0irq/27-eth0-tx-0-21swapper/210:35:352
29725040,0irq/27-eth0-tx-0-21swapper/210:20:302
29725040,0irq/27-eth0-tx-0-21swapper/209:50:432
29725040,0irq/27-eth0-tx-0-21swapper/209:15:382
29725040,0irq/27-eth0-tx-0-21swapper/008:35:400
29725040,0irq/27-eth0-tx-0-21swapper/007:40:410
29725040,0irq/27-eth0-tx-0-21swapper/007:05:410
29715040,0irq/26-eth0-rx-0-21swapper/312:06:133
29715040,0irq/26-eth0-rx-0-21swapper/311:10:333
29715040,0irq/26-eth0-rx-0-21swapper/310:45:443
29715040,0irq/26-eth0-rx-0-21swapper/310:30:383
29715040,0irq/26-eth0-rx-0-21swapper/310:06:463
29715040,0irq/26-eth0-rx-0-21swapper/309:38:453
29715040,0irq/26-eth0-rx-0-21swapper/309:30:403
259940,0migration/28073-21fschecks_count07:40:412
259940,0migration/25636-21kthreadcore09:30:462
259940,0migration/23799-21aten_r1power_en08:50:402
259940,0migration/231779-21kthreadcore07:55:462
259940,0migration/231706-21runrttasks07:06:522
259940,0migration/224367-21kthreadcore12:25:442
259940,0migration/223939-21irqcore08:40:442
259940,0migration/222881-21taskset07:25:442
259940,0migration/217210-21kthreadcore10:40:452
259940,0migration/21532-21kthreadcore08:45:452
249940,0watchdog/218721-21tr07:45:462
187679943,0cyclictest9941-21awk09:35:432
187679943,0cyclictest3514-21snmpd10:31:022
187679943,0cyclictest3514-21snmpd08:39:012
187679943,0cyclictest3514-21snmpd08:14:012
187679943,0cyclictest3514-21snmpd08:10:012
187679943,0cyclictest3514-21snmpd07:24:012
187679943,0cyclictest3514-21snmpd07:13:012
187679943,0cyclictest2694-21awk08:00:442
187679943,0cyclictest22794-21awk08:15:442
187679943,0cyclictest18017-21awk09:00:442
187669944,0cyclictest0-21swapper/110:20:191
187669944,0cyclictest0-21swapper/110:06:261
187669943,0cyclictest7673-21awk11:15:441
187669943,0cyclictest3556-21lldpd07:39:091
187669943,0cyclictest3514-21snmpd09:57:171
187669943,0cyclictest3514-21snmpd07:24:311
187669943,0cyclictest3514-21snmpd07:19:311
187669943,0cyclictest3241-21irqbalance11:12:461
187669943,0cyclictest28442-21awk07:55:431
187669943,0cyclictest24762-21awk10:25:421
187669943,0cyclictest22692-21awk08:15:441
187659944,0cyclictest0-21swapper/010:23:400
187659943,0cyclictest6849-21awk11:55:420
187659943,0cyclictest355-21awk10:30:420
187659943,0cyclictest3514-21snmpd08:03:160
187659943,0cyclictest3514-21snmpd07:36:460
187659943,0cyclictest26372-21sadc07:30:280
187659943,0cyclictest26348-21awk09:25:430
187659943,0cyclictest18230-21awk09:20:420
187659943,0cyclictest15729-21awk11:20:440
187659943,0cyclictest11346-21awk08:55:420
187659940,0cyclictest0-21swapper/010:45:160
179940,0migration/18616-21kthreadcore11:55:441
179940,0migration/17493-21taskset10:35:361
179940,0migration/17255-21aten2.4-expect10:55:401
179940,0migration/16702-21sh11:35:391
179940,0migration/131804-21df_abs10:50:401
179940,0migration/128180-21kthreadcore07:05:451
179940,0migration/126789-21kthreadcore09:45:451
179940,0migration/122934-21fschecks_time11:45:401
179940,0migration/12242-21runrttasks08:22:521
179940,0migration/122071-21sh10:00:471
179940,0migration/119473-21taskset12:20:561
179940,0migration/116367-21kthreadcore11:40:421
179940,0migration/115521-21taskset08:31:041
169940,0watchdog/127568-21python12:05:491
169940,0watchdog/120280-21kthreadcore09:00:461
169940,0watchdog/120102-21ssh12:01:131
169940,0watchdog/115993-21ssh09:17:301
169940,0watchdog/114808-21perl07:45:421
169940,0watchdog/10-21swapper/111:50:411
149940,0migration/04325-21sh12:13:190
149940,0migration/026500-21kthreadcore09:45:450
149940,0migration/020682-21sh12:24:330
149940,0migration/019470-21runrttasks07:22:550
149940,0migration/012038-21kthreadcore09:15:460
29715030,0irq/26-eth0-rx-0-21swapper/308:55:303
29715030,0irq/26-eth0-rx-0-21swapper/308:42:503
29715030,0irq/26-eth0-rx-0-21swapper/308:30:393
29715030,0irq/26-eth0-rx-0-21swapper/307:40:393
29715030,0irq/26-eth0-rx-0-21swapper/307:30:393
29715030,0irq/26-eth0-rx-0-21swapper/307:20:393
29715030,0irq/26-eth0-rx-0-21swapper/307:10:483
29715030,0irq/26-eth0-rx-0-21swapper/307:00:393
249930,0watchdog/20-21swapper/208:25:462
249930,0watchdog/20-21swapper/208:20:462
187679933,0cyclictest3556-21lldpd08:32:092
187679933,0cyclictest0-21swapper/207:15:552
187679932,0cyclictest3514-21snmpd08:59:012
187679932,0cyclictest21720-21awk07:50:432
187669933,0cyclictest0-21swapper/107:04:391
187669932,0cyclictest9506-21awk08:05:461
187669932,0cyclictest3556-21lldpd08:57:091
187669932,0cyclictest3556-21lldpd08:45:391
187669932,0cyclictest3241-21irqbalance09:50:361
187669932,0cyclictest2810-21stty08:25:401
187669932,0cyclictest27585-21awk07:30:431
187669932,0cyclictest26481-21irqcore09:25:441
187669932,0cyclictest2008-21awk09:10:431
187669932,0cyclictest12164-21tr07:40:451
187659933,0cyclictest32611-21kworker/0:011:50:310
187659933,0cyclictest32611-21kworker/0:011:30:430
187659933,0cyclictest32611-21kworker/0:011:00:350
187659933,0cyclictest21991-21kworker/0:110:00:370
187659933,0cyclictest21991-21kworker/0:109:55:390
187659933,0cyclictest21991-21kworker/0:108:21:350
187659933,0cyclictest21991-21kworker/0:107:55:470
187659932,0cyclictest3514-21snmpd07:00:310
187659932,0cyclictest26528-21sensors07:50:520
187659932,0cyclictest24475-21kthreadcore11:05:440
169930,0watchdog/10-21swapper/111:20:461
169930,0watchdog/10-21swapper/110:40:461
169930,0watchdog/10-21swapper/110:30:341
29715020,0irq/26-eth0-rx-0-21swapper/308:35:333
29715020,0irq/26-eth0-rx-0-21swapper/308:15:383
29715020,0irq/26-eth0-rx-0-21swapper/307:25:293
169920,0watchdog/10-21swapper/107:50:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional