You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-10 - 09:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri Jul 10, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450650,0irq/25-eth10-21swapper/318:46:553
2901323624,0sleep20-21swapper/218:47:342
2388723223,0sleep10-21swapper/118:45:331
2905423026,0sleep00-21swapper/018:48:000
35160,0ktimersoftd/313230-21ntpq20:35:353
339960,0migration/39889-21sh22:16:323
339960,0migration/38192-21needreboot00:15:353
339960,0migration/3677-21sh00:10:453
339960,0migration/35146-21munin-node19:40:413
339960,0migration/33098-21sh21:34:353
339960,0migration/326961-21sh23:10:023
339960,0migration/325898-21sh22:05:503
339960,0migration/319556-21sh21:45:103
339960,0migration/319496-21aten_r1power_fr22:45:283
339960,0migration/319236-21sh22:25:153
339960,0migration/310191-21sh23:59:183
29725060,0irq/27-eth0-tx-20826-21kernelversion22:25:332
29715060,0irq/26-eth0-rx-28194-21diskstats20:50:273
29715060,0irq/26-eth0-rx-16402-21kthreadcore23:20:343
29715060,0irq/26-eth0-rx-0-21swapper/321:47:103
293199960,0cyclictest0-21swapper/222:53:212
293199960,0cyclictest0-21swapper/221:12:172
293179960,0cyclictest0-21swapper/021:44:320
149960,0migration/07012-21kthreadcore23:35:340
149960,0migration/07012-21kthreadcore23:35:340
149960,0migration/026104-21sh23:07:360
149960,0migration/010769-21sh22:19:040
8215050,0irq/24-0000:00:23624-21ls19:10:162
339950,0migration/37112-21kthreadcore22:35:353
339950,0migration/36590-21kthreadcore23:15:333
339950,0migration/36265-21kthreadcore22:55:353
339950,0migration/35795-21kthreadcore21:15:343
339950,0migration/35100-21cpuspeed_turbos19:20:283
339950,0migration/33191-21kthreadcore19:15:343
339950,0migration/331881-21kthreadcore18:50:353
339950,0migration/33116-21kthreadcore20:30:323
339950,0migration/328653-21kthreadcore23:50:333
339950,0migration/327129-21kthreadcore20:00:323
339950,0migration/324092-21kthreadcore19:55:333
339950,0migration/323932-21munin-node19:30:393
339950,0migration/322765-21kthreadcore20:20:323
339950,0migration/320454-21munin-node22:25:323
339950,0migration/319854-21ksmtuned20:19:373
339950,0migration/316730-21needreboot23:00:343
339950,0migration/316322-21latency23:40:343
339950,0migration/310866-21munin-node00:00:273
29725050,0irq/27-eth0-tx-9484-21ssh23:36:562
29725050,0irq/27-eth0-tx-9484-21ssh23:36:562
29725050,0irq/27-eth0-tx-4105-21sort23:55:322
29725050,0irq/27-eth0-tx-30527-21munin-node19:15:290
29725050,0irq/27-eth0-tx-17860-21ssh22:41:412
29725050,0irq/27-eth0-tx-17351-21ps22:00:382
29725050,0irq/27-eth0-tx-11476-21munin-node22:20:392
29725050,0irq/27-eth0-tx-1089-21ssh00:11:472
29725050,0irq/27-eth0-tx-0-21swapper/223:17:252
29725050,0irq/27-eth0-tx-0-21swapper/221:23:262
29725050,0irq/27-eth0-tx-0-21swapper/020:05:280
29725050,0irq/27-eth0-tx-0-21swapper/019:34:530
29725050,0irq/27-eth0-tx-0-21swapper/018:56:450
29715050,0irq/26-eth0-rx-6559-21runrttasks22:30:343
29715050,0irq/26-eth0-rx-4690-21irqcore21:55:373
29715050,0irq/26-eth0-rx-25314-21missed_timers21:25:353
29715050,0irq/26-eth0-rx-22700-21kthreadcore23:45:353
29715050,0irq/26-eth0-rx-22700-21kthreadcore23:45:353
29715050,0irq/26-eth0-rx-1394-21ssh21:10:373
29715050,0irq/26-eth0-rx-11977-21cut19:00:333
29715050,0irq/26-eth0-rx-0-21swapper/323:39:253
29715050,0irq/26-eth0-rx-0-21swapper/323:39:253
29715050,0irq/26-eth0-rx-0-21swapper/323:30:173
29715050,0irq/26-eth0-rx-0-21swapper/323:27:213
29715050,0irq/26-eth0-rx-0-21swapper/322:40:293
29715050,0irq/26-eth0-rx-0-21swapper/322:12:273
29715050,0irq/26-eth0-rx-0-21swapper/321:23:243
29715050,0irq/26-eth0-rx-0-21swapper/321:06:463
29715050,0irq/26-eth0-rx-0-21swapper/320:55:313
29715050,0irq/26-eth0-rx-0-21swapper/320:45:343
29715050,0irq/26-eth0-rx-0-21swapper/319:35:333
29715050,0irq/26-eth0-rx-0-21swapper/300:09:483
293199955,0cyclictest0-21swapper/222:09:502
293199950,0cyclictest0-21swapper/223:49:472
293199950,0cyclictest0-21swapper/223:49:472
293199950,0cyclictest0-21swapper/222:19:462
293189955,0cyclictest0-21swapper/120:25:331
293189954,0cyclictest3514-21snmpd19:09:521
293189954,0cyclictest3514-21snmpd18:58:221
293179955,0cyclictest10758-21ssh00:00:160
293179955,0cyclictest0-21swapper/022:42:330
293179955,0cyclictest0-21swapper/020:59:550
293179950,0cyclictest0-21swapper/021:17:530
259950,0migration/23690-21aten_r1power_cu21:35:282
259950,0migration/226070-21sh21:06:002
259950,0migration/225405-21sh21:25:362
259950,0migration/219492-21cpu23:05:272
259950,0migration/217348-21sh00:01:382
249950,0watchdog/29137-21python20:55:422
249950,0watchdog/226744-21if_eth120:00:302
179950,0migration/19727-21sh00:18:081
179950,0migration/127177-21latency_hist23:10:161
179950,0migration/125956-21kthreadcore19:10:321
179950,0migration/121571-21kthreadcore21:25:331
179950,0migration/113573-21kthreadcore19:25:331
179950,0migration/111892-21taskset19:45:421
169950,0watchdog/19454-21processes21:35:381
169950,0watchdog/127791-21munin-node20:50:341
149950,0migration/09083-21kernelversion20:35:320
149950,0migration/07490-21kthreadcore23:15:340
149950,0migration/05287-21kthreadcore22:35:350
149950,0migration/04018-21kthreadcore20:30:330
149950,0migration/030187-21kthreadcore22:30:320
149950,0migration/029029-21kthreadcore23:10:320
149950,0migration/029018-21irqrtprio22:10:330
149950,0migration/028512-21fschecks_time21:30:300
149950,0migration/025718-21unixbench-2d22:05:420
149950,0migration/025352-21taskset23:25:520
149950,0migration/025259-21missed_timers21:05:370
149950,0migration/023622-21kthreadcore23:45:350
149950,0migration/023622-21kthreadcore23:45:350
149950,0migration/02355-21sh23:55:030
149950,0migration/022657-21kthreadcore00:05:360
149950,0migration/021404-21kthreadcore19:55:320
149950,0migration/021114-21taskset20:45:210
149950,0migration/020167-21aten_r1power_cu20:20:260
149950,0migration/019716-21cpuspeed_turbos22:45:300
149950,0migration/018028-21sh23:02:260
149950,0migration/017162-21kthreadcore21:20:350
149950,0migration/016095-21kthreadcore23:20:340
149950,0migration/014576-21munin-node20:40:280
149950,0migration/01381-21taskset00:12:360
149950,0migration/013789-21cpuspeed_turbos20:15:280
149950,0migration/012990-21kthreadcore21:00:330
149950,0migration/012982-21kernelversion22:00:340
149950,0migration/010932-21kthreadcore20:10:340
149950,0migration/010305-21sh21:57:140
149950,0migration/01017-21timerwakeupswit22:50:370
339940,0migration/332406-21kthreadcore22:50:323
339940,0migration/318015-21kthreadcore20:40:333
339940,0migration/316950-21kthreadcore21:00:353
339940,0migration/311308-21kthreadcore20:10:343
29725040,0irq/27-eth0-tx-28411-21cut23:50:332
29725040,0irq/27-eth0-tx-0-21swapper/223:25:312
29725040,0irq/27-eth0-tx-0-21swapper/223:20:442
29725040,0irq/27-eth0-tx-0-21swapper/223:11:332
29725040,0irq/27-eth0-tx-0-21swapper/222:45:192
29725040,0irq/27-eth0-tx-0-21swapper/222:35:402
29725040,0irq/27-eth0-tx-0-21swapper/222:30:282
29725040,0irq/27-eth0-tx-0-21swapper/221:50:432
29725040,0irq/27-eth0-tx-0-21swapper/221:30:202
29725040,0irq/27-eth0-tx-0-21swapper/221:15:292
29725040,0irq/27-eth0-tx-0-21swapper/221:00:332
29725040,0irq/27-eth0-tx-0-21swapper/200:06:332
29725040,0irq/27-eth0-tx-0-21swapper/020:50:320
29725040,0irq/27-eth0-tx-0-21swapper/019:39:540
29715040,0irq/26-eth0-rx-0-21swapper/323:10:333
29715040,0irq/26-eth0-rx-0-21swapper/322:00:193
29715040,0irq/26-eth0-rx-0-21swapper/321:50:313
29715040,0irq/26-eth0-rx-0-21swapper/321:36:533
293199944,0cyclictest0-21swapper/222:55:242
293199943,0cyclictest4455-21awk21:55:352
293199943,0cyclictest3556-21lldpd20:30:162
293199943,0cyclictest3556-21lldpd20:22:462
293199943,0cyclictest3556-21lldpd19:46:152
293199943,0cyclictest3556-21lldpd19:42:152
293199943,0cyclictest3547-21awk00:15:302
293199943,0cyclictest31366-21awk19:15:302
293199943,0cyclictest20821-21awk21:45:312
293199943,0cyclictest20026-21awk19:55:302
293199943,0cyclictest15341-21awk20:40:312
293199943,0cyclictest12628-21awk21:40:302
293189943,0cyclictest9570-21ssh22:36:051
293189943,0cyclictest5767-21awk19:20:311
293189943,0cyclictest3556-21lldpd23:54:331
293189943,0cyclictest3556-21lldpd22:45:321
293189943,0cyclictest3556-21lldpd22:07:321
293189943,0cyclictest3556-21lldpd21:23:021
293189943,0cyclictest3556-21lldpd21:06:011
293189943,0cyclictest3556-21lldpd20:57:311
293189943,0cyclictest3556-21lldpd00:04:341
293189943,0cyclictest31436-21awk19:15:311
293189943,0cyclictest28744-21awk22:10:331
293189943,0cyclictest26691-21awk20:00:301
293189943,0cyclictest19956-21cut22:25:301
293189943,0cyclictest1896-21awk20:30:301
293189943,0cyclictest13430-21awk19:50:301
293189943,0cyclictest12520-21awk22:00:321
293179944,0cyclictest0-21swapper/021:51:470
293179943,0cyclictest3686-21awk23:55:300
293179943,0cyclictest3514-21snmpd22:20:220
293179943,0cyclictest3241-21irqbalance19:21:050
293179943,0cyclictest30460-21awk18:50:330
293179943,0cyclictest24703-21awk19:10:300
293179943,0cyclictest20754-21awk21:45:300
259940,0migration/2865-21nfs4_client20:50:332
259940,0migration/27403-21kthreadcore19:20:332
259940,0migration/25128-21kernelversion18:55:322
259940,0migration/25038-21kthreadcore20:05:342
259940,0migration/228781-21kthreadcore20:25:322
259940,0migration/219516-21vmstat20:15:392
259940,0migration/216891-21kthreadcore19:50:332
259940,0migration/216372-21timerwakeupswit19:00:392
259940,0migration/212960-21kthreadcore19:25:332
259940,0migration/212540-21kernelversion23:00:322
259940,0migration/212358-21kthreadcore23:40:332
249940,0watchdog/229142-21kthreadcore23:30:342
249940,0watchdog/225072-21cpuspeed_turbos19:35:272
249940,0watchdog/20-21swapper/222:10:342
179940,0migration/15467-21runrttasks19:44:031
179940,0migration/129484-21latency_hist18:50:161
179940,0migration/124178-21sshd19:30:441
179940,0migration/123356-21kthreadcore23:25:331
179940,0migration/121127-21kthreadcore19:55:321
179940,0migration/114326-21kthreadcore21:40:331
179940,0migration/111632-21fschecks_count23:20:291
179940,0migration/111574-21cpuspeed_turbos22:40:281
179940,0migration/110446-21ksmtuned21:57:371
169940,0watchdog/18735-21ntpdc22:55:381
169940,0watchdog/131046-21cut21:30:341
169940,0watchdog/128410-21if_eth1.222:50:301
169940,0watchdog/128393-21if_err_eth022:30:301
169940,0watchdog/128140-21aten_r1power_fr21:10:261
169940,0watchdog/126072-21unixbench_multi20:20:381
169940,0watchdog/124585-21kthreadcore20:45:341
169940,0watchdog/115316-21tr21:00:341
169940,0watchdog/111614-21uniq23:40:301
169940,0watchdog/10-21swapper/123:03:501
169940,0watchdog/10-21swapper/121:53:221
169940,0watchdog/10-21swapper/121:15:341
169940,0watchdog/10-21swapper/119:35:271
169940,0watchdog/10-21swapper/119:00:271
169940,0watchdog/10-21swapper/100:13:531
149940,0migration/07268-21kthreadcore00:15:340
149940,0migration/05400-21kthreadcore21:35:340
149940,0migration/025912-21aten_r1power_fr20:00:270
149940,0migration/023095-21unixbench-2d19:05:400
149940,0migration/022627-21kthreadcore22:25:340
149940,0migration/013911-21kthreadcore23:40:330
149940,0migration/01352-21kthreadcore19:40:330
29715030,0irq/26-eth0-rx-0-21swapper/320:06:293
29715030,0irq/26-eth0-rx-0-21swapper/319:51:563
29715030,0irq/26-eth0-rx-0-21swapper/319:46:193
29715030,0irq/26-eth0-rx-0-21swapper/319:25:303
29715030,0irq/26-eth0-rx-0-21swapper/318:59:293
293199932,0cyclictest19005-21awk19:30:302
293189933,0cyclictest27551-21diskmemload21:47:501
293189933,0cyclictest0-21swapper/120:41:001
293189932,0cyclictest6550-21sadc20:10:161
293189932,0cyclictest3646-21awk23:55:301
293189932,0cyclictest3514-21snmpd23:30:331
293189932,0cyclictest3514-21snmpd23:15:311
293189932,0cyclictest20894-21kthreadcore00:05:351
293189932,0cyclictest19925-21sadc20:20:161
293189932,0cyclictest12509-21sensors20:10:381
293189930,0cyclictest4449-21munin-node22:15:311
293179933,0cyclictest3483-21kworker/0:022:55:270
293179933,0cyclictest3483-21kworker/0:021:25:270
293179933,0cyclictest3483-21kworker/0:021:11:450
293179933,0cyclictest3483-21kworker/0:020:25:270
293179933,0cyclictest3483-21kworker/0:019:00:320
293179932,0cyclictest5810-21munin-node19:45:300
293179932,0cyclictest3514-21snmpd19:25:220
293179932,0cyclictest28148-21awk23:30:320
293179932,0cyclictest18179-21sensors19:50:370
249930,0watchdog/230832-21kthreadcore18:50:352
249930,0watchdog/20-21swapper/220:45:342
249930,0watchdog/20-21swapper/220:35:262
249930,0watchdog/20-21swapper/219:13:592
179930,0migration/114086-21runrttasks20:39:021
169930,0watchdog/127551-21diskmemload23:35:341
169930,0watchdog/127551-21diskmemload23:35:341
169930,0watchdog/10-21swapper/123:45:301
169930,0watchdog/10-21swapper/123:45:301
169930,0watchdog/10-21swapper/123:10:341
169930,0watchdog/10-21swapper/122:20:341
29715020,0irq/26-eth0-rx-0-21swapper/320:26:253
29715020,0irq/26-eth0-rx-0-21swapper/319:10:233
29715020,0irq/26-eth0-rx-0-21swapper/319:05:243
293199921,0cyclictest6559-21runrttasks20:10:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional