You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 23:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Dec 31, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450660,0irq/25-eth10-21swapper/307:07:123
819523624,0sleep00-21swapper/007:06:290
797923122,0sleep10-21swapper/107:03:541
803722824,0sleep20-21swapper/207:04:392
84249960,0cyclictest6733-21diskmemload12:29:541
8215060,0irq/24-0000:00:8758-21perf12:23:162
339960,0migration/329563-21kthreadcore10:18:323
339960,0migration/325021-21sh09:37:043
339960,0migration/315788-21sh12:25:073
339960,0migration/314598-21sh09:12:213
339960,0migration/31146-21sh12:37:533
339960,0migration/31146-21sh12:37:533
29715060,0irq/26-eth0-rx-32739-21gltestperf11:58:283
29715060,0irq/26-eth0-rx-29988-21diskstats07:48:303
29715060,0irq/26-eth0-rx-0-21swapper/309:30:023
29715060,0irq/26-eth0-rx-0-21swapper/309:23:183
149960,0migration/05627-21kthreadcore10:23:340
149960,0migration/04949-21munin-node07:53:310
149960,0migration/030402-21cpuspeed_turbos11:18:290
149960,0migration/026421-21kthreadcore12:13:320
149960,0migration/015059-21munin-run09:13:160
149960,0migration/011433-21sh11:03:450
84249955,0cyclictest0-21swapper/111:28:441
84249955,0cyclictest0-21swapper/111:06:301
84249955,0cyclictest0-21swapper/110:49:291
84249955,0cyclictest0-21swapper/109:03:411
84239955,0cyclictest0-21swapper/011:58:260
84239955,0cyclictest0-21swapper/010:08:420
84239955,0cyclictest0-21swapper/009:52:370
84239955,0cyclictest0-21swapper/009:14:190
84239950,0cyclictest0-21swapper/010:37:520
84239950,0cyclictest0-21swapper/009:32:080
339950,0migration/36421-21kthreadcore09:43:343
339950,0migration/36314-21aten_r1power_vo11:23:293
339950,0migration/33742-21if_eth110:03:313
339950,0migration/328536-21latency_hist07:23:173
339950,0migration/327573-21kthreadcore08:58:343
339950,0migration/325498-21unixbench_singl10:13:403
339950,0migration/324717-21idleruntime-cro08:33:163
339950,0migration/324318-21fschecks_count09:18:303
339950,0migration/323533-21kthreadcore07:18:333
339950,0migration/323324-21diskmemload11:52:553
339950,0migration/315555-21unixbench_singl07:33:403
339950,0migration/314572-21kthreadcore08:48:323
339950,0migration/313717-21kthreadcore08:23:353
339950,0migration/31365-21kthreadcore11:38:343
339950,0migration/312419-21kthreadcore07:58:343
29725050,0irq/27-eth0-tx-738-21ssh09:59:092
29725050,0irq/27-eth0-tx-6747-21cut10:23:342
29725050,0irq/27-eth0-tx-31586-21munin-node08:38:362
29725050,0irq/27-eth0-tx-31116-21kthreadcore10:58:332
29725050,0irq/27-eth0-tx-22034-21ssh11:49:452
29725050,0irq/27-eth0-tx-18882-21grep09:13:352
29725050,0irq/27-eth0-tx-18284-21munin-node08:28:362
29725050,0irq/27-eth0-tx-12869-21ssh11:24:592
29725050,0irq/27-eth0-tx-11859-21kthreadcore09:08:382
29725050,0irq/27-eth0-tx-0-21swapper/212:01:432
29725050,0irq/27-eth0-tx-0-21swapper/211:10:292
29725050,0irq/27-eth0-tx-0-21swapper/210:05:572
29715050,0irq/26-eth0-rx-9842-21ssh10:23:453
29715050,0irq/26-eth0-rx-6559-21runrttasks07:13:273
29715050,0irq/26-eth0-rx-5219-21ssh11:03:263
29715050,0irq/26-eth0-rx-3514-21snmpd09:50:293
29715050,0irq/26-eth0-rx-28039-21cut09:58:333
29715050,0irq/26-eth0-rx-27148-21ssh10:53:443
29715050,0irq/26-eth0-rx-25972-21ssh09:38:283
29715050,0irq/26-eth0-rx-24977-21kthreadcore11:13:333
29715050,0irq/26-eth0-rx-24792-21iostat_ios11:53:333
29715050,0irq/26-eth0-rx-19480-21cut11:28:363
29715050,0irq/26-eth0-rx-19463-21kthreadcore09:13:353
29715050,0irq/26-eth0-rx-19112-21ssh10:13:153
29715050,0irq/26-eth0-rx-18660-21ssh09:53:273
29715050,0irq/26-eth0-rx-15136-21kthreadcore11:08:343
29715050,0irq/26-eth0-rx-14723-21cut10:28:343
29715050,0irq/26-eth0-rx-14232-21ssh11:46:053
29715050,0irq/26-eth0-rx-0-21swapper/312:28:353
29715050,0irq/26-eth0-rx-0-21swapper/312:16:183
29715050,0irq/26-eth0-rx-0-21swapper/312:08:333
29715050,0irq/26-eth0-rx-0-21swapper/312:03:483
29715050,0irq/26-eth0-rx-0-21swapper/311:33:203
29715050,0irq/26-eth0-rx-0-21swapper/311:00:213
29715050,0irq/26-eth0-rx-0-21swapper/310:48:333
29715050,0irq/26-eth0-rx-0-21swapper/308:03:293
27150,0ktimersoftd/20-21swapper/210:20:492
259950,0migration/216630-21sh09:32:142
259950,0migration/216550-21sh09:48:532
259950,0migration/214233-21kthreadcore07:33:342
249950,0watchdog/23117-21kthreadcore11:38:342
19150,0ktimersoftd/10-21swapper/110:20:491
19150,0ktimersoftd/10-21swapper/109:48:471
19150,0ktimersoftd/10-21swapper/107:46:451
179950,0migration/125733-21needreboot10:33:341
169950,0watchdog/114762-21kthreadcore08:23:351
149950,0migration/08848-21kthreadcore10:43:320
149950,0migration/07626-21sendmail_mailqu09:43:370
149950,0migration/0653-21kthreadcore07:48:350
149950,0migration/0398-21kthreadcore10:18:330
149950,0migration/03888-21kthreadcore08:38:340
149950,0migration/03406-21kthreadcore08:13:350
149950,0migration/031622-21kthreadcore10:58:340
149950,0migration/031417-21sh08:58:380
149950,0migration/029005-21taskset11:16:080
149950,0migration/02840-21taskset07:28:230
149950,0migration/026858-21kthreadcore07:18:340
149950,0migration/026226-21kthreadcore10:53:370
149950,0migration/022911-21aten_r1power_cu07:43:250
149950,0migration/02227-21sh10:02:450
149950,0migration/019862-21kthreadcore12:28:330
149950,0migration/019349-21kthreadcore09:33:340
149950,0migration/019070-21hwlatdetect08:28:310
149950,0migration/018885-21kthreadcore12:08:340
149950,0migration/016814-21kthreadcore08:23:350
149950,0migration/016379-21aten_r1power_po07:38:270
149950,0migration/015885-21kthreadcore08:48:320
149950,0migration/015447-21taskset12:06:420
149950,0migration/013313-21kthreadcore10:28:340
149950,0migration/012388-21idleruntime-cro08:48:160
149950,0migration/011146-21kthreadcore11:23:350
84259943,0cyclictest9487-21awk07:08:312
84259943,0cyclictest3556-21lldpd07:30:522
84259943,0cyclictest30547-21awk07:48:332
84259943,0cyclictest20368-21awk10:13:322
84259943,0cyclictest20264-21awk08:53:342
84249944,0cyclictest6733-21diskmemload09:40:161
84249944,0cyclictest0-21swapper/109:21:591
84249943,0cyclictest8021-21awk11:43:311
84249943,0cyclictest539-21awk11:58:301
84249943,0cyclictest3722-21awk10:03:311
84249943,0cyclictest3556-21lldpd12:16:231
84249943,0cyclictest3556-21lldpd11:18:231
84249943,0cyclictest3556-21lldpd10:23:231
84249943,0cyclictest3556-21lldpd10:09:531
84249943,0cyclictest3556-21lldpd09:56:221
84249943,0cyclictest3556-21lldpd08:58:211
84249943,0cyclictest3556-21lldpd08:13:211
84249943,0cyclictest3556-21lldpd08:12:221
84249943,0cyclictest3556-21lldpd07:28:221
84249943,0cyclictest3514-21snmpd08:02:141
84249943,0cyclictest3514-21snmpd07:39:441
84249943,0cyclictest3514-21snmpd07:35:141
84249943,0cyclictest3514-21snmpd07:22:141
84249943,0cyclictest3241-21irqbalance11:14:141
84249943,0cyclictest3241-21irqbalance10:13:251
84249943,0cyclictest29503-21awk10:38:311
84249943,0cyclictest2723-21awk09:43:311
84249943,0cyclictest26598-21awk12:33:331
84249943,0cyclictest26598-21awk12:33:331
84249943,0cyclictest23716-21awk11:33:321
84249943,0cyclictest19190-21awk08:28:321
84249943,0cyclictest18268-21awk09:33:321
84249943,0cyclictest16267-21awk09:13:321
84249943,0cyclictest1516-21awk12:18:301
84249943,0cyclictest12878-21awk10:28:331
84239944,0cyclictest0-21swapper/012:26:580
84239944,0cyclictest0-21swapper/012:18:370
84239944,0cyclictest0-21swapper/010:14:320
84239943,0cyclictest9615-21awk07:08:320
84239943,0cyclictest5783-21awk08:18:300
84239943,0cyclictest3514-21snmpd11:41:000
84239943,0cyclictest3514-21snmpd11:29:000
84239943,0cyclictest3241-21irqbalance11:11:040
84239943,0cyclictest3241-21irqbalance10:08:050
84239943,0cyclictest29452-21awk10:38:310
84239943,0cyclictest25842-21awk08:33:320
84239943,0cyclictest24768-21awk09:18:310
84239943,0cyclictest15120-21sadc11:48:160
339940,0migration/37355-21kthreadcore10:43:323
339940,0migration/36991-21sh12:18:593
339940,0migration/36940-21kthreadcore08:18:323
339940,0migration/330309-21kthreadcore10:38:323
339940,0migration/322121-21runrttasks10:33:323
339940,0migration/32026-21kthreadcore08:38:333
339940,0migration/318587-21kthreadcore07:38:323
339940,0migration/311845-21kthreadcore07:08:343
29725040,0irq/27-eth0-tx-7424-21ssh09:43:352
29725040,0irq/27-eth0-tx-6733-21diskmemload09:38:262
29725040,0irq/27-eth0-tx-23710-21ssh11:53:202
29725040,0irq/27-eth0-tx-17305-21munin-node08:03:302
29725040,0irq/27-eth0-tx-12749-21ssh10:48:262
29725040,0irq/27-eth0-tx-10224-21ssh10:43:372
29725040,0irq/27-eth0-tx-0-21swapper/212:28:212
29725040,0irq/27-eth0-tx-0-21swapper/212:23:202
29725040,0irq/27-eth0-tx-0-21swapper/212:08:282
29725040,0irq/27-eth0-tx-0-21swapper/211:43:202
29725040,0irq/27-eth0-tx-0-21swapper/211:33:492
29725040,0irq/27-eth0-tx-0-21swapper/211:13:342
29725040,0irq/27-eth0-tx-0-21swapper/210:53:182
29725040,0irq/27-eth0-tx-0-21swapper/210:38:352
29725040,0irq/27-eth0-tx-0-21swapper/210:33:302
29725040,0irq/27-eth0-tx-0-21swapper/210:08:312
29725040,0irq/27-eth0-tx-0-21swapper/209:53:212
29725040,0irq/27-eth0-tx-0-21swapper/209:33:282
29725040,0irq/27-eth0-tx-0-21swapper/209:23:352
29725040,0irq/27-eth0-tx-0-21swapper/209:18:252
29715040,0irq/26-eth0-rx-0-21swapper/311:18:183
29715040,0irq/26-eth0-rx-0-21swapper/307:53:273
259940,0migration/29376-21irqstats12:03:322
259940,0migration/29372-21needreboot07:53:342
259940,0migration/231764-21irqrtprio08:13:332
259940,0migration/230648-21switchtime08:33:392
259940,0migration/224775-21aten2.4-expect12:13:272
259940,0migration/218046-21munin-node08:48:342
259940,0migration/216335-21irqcore07:13:322
259940,0migration/210588-21latency_hist07:58:172
249940,0watchdog/28386-21kthreadcore08:43:352
249940,0watchdog/26733-21diskmemload12:33:222
249940,0watchdog/26733-21diskmemload12:33:222
249940,0watchdog/25222-21ssh11:03:262
249940,0watchdog/232514-21kthreadcore11:18:342
249940,0watchdog/229120-21grep07:23:312
249940,0watchdog/228982-21kthreadcore08:58:352
249940,0watchdog/227864-21sed07:18:392
249940,0watchdog/220663-21ksmtuned11:28:422
249940,0watchdog/214761-21kthreadcore08:23:352
249940,0watchdog/214544-21cut10:28:342
249940,0watchdog/20-21swapper/208:08:312
179940,0migration/19409-21sh12:03:321
179940,0migration/17082-21irqcore08:43:341
179940,0migration/132121-21kthreadcore10:58:341
179940,0migration/128868-21taskset10:58:071
179940,0migration/115477-21ksmtuned09:29:411
179940,0migration/111371-21sh10:45:351
169940,0watchdog/132552-21kthreadcore07:23:351
169940,0watchdog/132440-21ssh09:23:231
169940,0watchdog/132230-21cat09:58:351
169940,0watchdog/126622-21kthreadcore11:53:341
169940,0watchdog/120378-21kthreadcore08:03:351
169940,0watchdog/119636-21kthreadcore11:48:341
169940,0watchdog/113990-21sed07:08:351
169940,0watchdog/10-21swapper/112:08:341
169940,0watchdog/10-21swapper/111:38:341
169940,0watchdog/10-21swapper/111:23:341
169940,0watchdog/10-21swapper/111:08:341
169940,0watchdog/10-21swapper/109:10:031
169940,0watchdog/10-21swapper/108:53:351
169940,0watchdog/10-21swapper/108:18:271
169940,0watchdog/10-21swapper/107:48:351
149940,0migration/032423-21runrttasks09:23:210
149940,0migration/018637-21kthreadcore07:13:330
149940,0migration/015986-21fschecks_time11:48:300
84249932,0cyclictest3556-21lldpd08:39:221
84249932,0cyclictest3514-21snmpd08:34:591
84249932,0cyclictest10003-21awk12:23:331
84239932,0cyclictest738-21tune2fs09:03:290
84239932,0cyclictest3514-21snmpd07:34:370
84239932,0cyclictest29586-21sensors08:08:370
84239932,0cyclictest29494-21sensors11:53:390
84239932,0cyclictest19597-21grep08:53:300
84239932,0cyclictest19544-21awk09:53:330
84239932,0cyclictest16638-21munin-node07:58:410
84239930,0cyclictest31520-21python12:33:400
84239930,0cyclictest31520-21python12:33:400
84239930,0cyclictest13786-21iostat_ios10:48:320
339930,0migration/329998-21runrttasks08:09:143
29725030,0irq/27-eth0-tx-0-21swapper/209:03:272
29715030,0irq/26-eth0-rx-0-21swapper/309:03:273
29715030,0irq/26-eth0-rx-0-21swapper/308:53:283
29715030,0irq/26-eth0-rx-0-21swapper/308:43:373
29715030,0irq/26-eth0-rx-0-21swapper/308:33:283
29715030,0irq/26-eth0-rx-0-21swapper/308:16:243
29715030,0irq/26-eth0-rx-0-21swapper/307:43:273
29715030,0irq/26-eth0-rx-0-21swapper/307:28:293
249930,0watchdog/20-21swapper/208:18:272
249930,0watchdog/20-21swapper/207:43:312
249930,0watchdog/20-21swapper/207:38:272
179930,0migration/13900-21latency_hist07:53:171
169930,0watchdog/10-21swapper/108:48:271
169930,0watchdog/10-21swapper/107:13:191
149930,0migration/0784-21sh09:41:400
84239921,0cyclictest17237-21latency_hist08:03:170
84239920,0cyclictest22723-21diskmemload11:33:180
84239920,0cyclictest0-21swapper/007:23:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional