You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 02:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue May 05, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1111023723,0sleep00-21swapper/018:53:350
304450350,0irq/25-eth10-21swapper/318:52:223
1127923425,0sleep10-21swapper/118:55:331
1113623026,0sleep20-21swapper/218:53:542
11437992121,0cyclictest9667-21sadc20:56:330
11437991212,0cyclictest10809-21kworker/0:222:51:480
11437991212,0cyclictest10809-21kworker/0:222:26:440
11437991111,0cyclictest1400-21kworker/0:019:51:550
11437991111,0cyclictest1400-21kworker/0:019:46:550
11437991111,0cyclictest10809-21kworker/0:221:56:520
11437991010,0cyclictest9512-21kworker/0:023:33:040
11437991010,0cyclictest9512-21kworker/0:023:25:500
11437991010,0cyclictest9512-21kworker/0:000:06:500
11437991010,0cyclictest1400-21kworker/0:020:01:550
11437991010,0cyclictest1400-21kworker/0:019:21:550
11437991010,0cyclictest10809-21kworker/0:222:12:340
11437991010,0cyclictest10809-21kworker/0:221:52:380
114379999,0cyclictest9512-21kworker/0:023:52:500
114379999,0cyclictest9512-21kworker/0:023:11:580
114379999,0cyclictest1400-21kworker/0:021:31:010
114379999,0cyclictest1400-21kworker/0:021:16:510
114379999,0cyclictest1400-21kworker/0:021:06:510
114379999,0cyclictest1400-21kworker/0:020:46:490
114379999,0cyclictest1400-21kworker/0:020:21:550
114379999,0cyclictest1400-21kworker/0:019:27:110
114379999,0cyclictest10809-21kworker/0:222:18:460
114389984,0cyclictest26717-21sadc19:56:331
114389983,0cyclictest16651-21awk00:01:481
114379988,0cyclictest9512-21kworker/0:023:36:460
114379988,0cyclictest9512-21kworker/0:023:31:280
114379988,0cyclictest9512-21kworker/0:023:19:120
114379988,0cyclictest9512-21kworker/0:000:02:580
114379988,0cyclictest1400-21kworker/0:021:31:470
114379988,0cyclictest1400-21kworker/0:021:11:470
114379988,0cyclictest1400-21kworker/0:021:00:490
114379988,0cyclictest1400-21kworker/0:019:56:450
114379988,0cyclictest10809-21kworker/0:222:41:460
114379988,0cyclictest10809-21kworker/0:222:09:320
114379988,0cyclictest10809-21kworker/0:221:49:160
114379988,0cyclictest10809-21kworker/0:221:41:170
114389973,0cyclictest9742-21sadc21:36:331
114389973,0cyclictest3556-21lldpd23:38:111
114389973,0cyclictest3556-21lldpd22:48:411
114389973,0cyclictest18229-21awk22:21:461
114389972,0cyclictest16421-21awk00:21:471
114379977,0cyclictest9512-21kworker/0:023:49:280
114379977,0cyclictest9512-21kworker/0:023:05:500
114379977,0cyclictest9512-21kworker/0:022:59:020
114379977,0cyclictest9512-21kworker/0:000:16:520
114379977,0cyclictest9512-21kworker/0:000:12:160
114379977,0cyclictest1400-21kworker/0:021:21:550
114379977,0cyclictest1400-21kworker/0:021:06:030
114379977,0cyclictest1400-21kworker/0:019:41:510
114379977,0cyclictest1400-21kworker/0:019:36:510
114379977,0cyclictest1400-21kworker/0:019:08:170
114379977,0cyclictest1400-21kworker/0:019:04:550
114379977,0cyclictest10809-21kworker/0:222:50:280
114379977,0cyclictest10809-21kworker/0:222:31:360
114379977,0cyclictest10809-21kworker/0:222:23:560
114379977,0cyclictest10809-21kworker/0:222:02:280
114379977,0cyclictest10809-21kworker/0:221:41:530
339960,0migration/37914-21sh21:52:113
339960,0migration/37739-21sh23:36:283
339960,0migration/36629-21sh23:12:193
339960,0migration/330644-21sh23:27:133
339960,0migration/330035-21sh00:07:313
339960,0migration/315916-21sh22:18:053
29715060,0irq/26-eth0-rx-2346-21kthreadcore22:31:493
29715060,0irq/26-eth0-rx-20269-21kthreadcore21:01:503
29715060,0irq/26-eth0-rx-0-21swapper/322:01:493
149960,0migration/015559-21sh22:37:550
114399965,0cyclictest32366-21crond19:36:332
114399960,0cyclictest0-21swapper/223:21:512
114389966,0cyclictest0-21swapper/123:34:341
114389963,0cyclictest3556-21lldpd23:57:111
114389963,0cyclictest3556-21lldpd20:09:391
114389963,0cyclictest3556-21lldpd19:39:101
114389963,0cyclictest3556-21lldpd19:32:101
114389963,0cyclictest0-21swapper/121:28:451
114389962,0cyclictest9598-21awk22:56:471
114389962,0cyclictest7899-21awk19:41:481
114389962,0cyclictest3556-21lldpd20:12:091
114389962,0cyclictest17240-21awk23:21:471
114389960,0cyclictest9665-21diskmemload21:44:591
114379966,0cyclictest9512-21kworker/0:023:41:480
114379966,0cyclictest9512-21kworker/0:023:06:560
114379966,0cyclictest9512-21kworker/0:000:21:440
114379966,0cyclictest1400-21kworker/0:020:31:010
114379966,0cyclictest1400-21kworker/0:020:21:330
114379966,0cyclictest1400-21kworker/0:020:09:510
114379966,0cyclictest1400-21kworker/0:019:16:450
8215050,0irq/24-0000:00:19072-21latency_hist19:26:332
8215050,0irq/24-0000:00:12420-21turbostat19:21:332
339950,0migration/39914-21munin-node21:56:453
339950,0migration/38286-21sh21:12:063
339950,0migration/38021-21diskmemload23:36:393
339950,0migration/36525-21munin-node22:51:573
339950,0migration/3421-21hddtemp_smartct23:51:513
339950,0migration/33705-21kthreadcore21:31:493
339950,0migration/326641-21taskset19:55:483
339950,0migration/325311-21munin-node19:26:563
339950,0migration/323390-21taskset23:03:313
339950,0migration/323363-21sh23:24:243
339950,0migration/323094-21idleruntime20:41:473
339950,0migration/322764-21kthreadcore19:01:513
339950,0migration/320459-21kthreadcore22:21:483
339950,0migration/318075-21munin-node19:21:523
339950,0migration/313516-21kthreadcore20:56:503
339950,0migration/31292-21kthreadcore19:11:513
339950,0migration/311309-21kthreadcore22:36:513
29725050,0irq/27-eth0-tx-25712-21ssh21:06:032
29725050,0irq/27-eth0-tx-0-21swapper/223:57:182
29725050,0irq/27-eth0-tx-0-21swapper/221:52:002
29725050,0irq/27-eth0-tx-0-21swapper/221:36:442
29715050,0irq/26-eth0-rx-7734-21ssh23:56:413
29715050,0irq/26-eth0-rx-25787-21fschecks_count22:26:443
29715050,0irq/26-eth0-rx-24700-21fschecks_time23:46:463
29715050,0irq/26-eth0-rx-21884-21ssh00:23:003
29715050,0irq/26-eth0-rx-18457-21munin-node21:21:443
29715050,0irq/26-eth0-rx-10613-21fschecks_time21:36:463
29715050,0irq/26-eth0-rx-0-21swapper/322:58:293
29715050,0irq/26-eth0-rx-0-21swapper/322:13:503
29715050,0irq/26-eth0-rx-0-21swapper/321:46:473
29715050,0irq/26-eth0-rx-0-21swapper/321:41:483
29715050,0irq/26-eth0-rx-0-21swapper/321:16:333
29715050,0irq/26-eth0-rx-0-21swapper/320:26:563
29715050,0irq/26-eth0-rx-0-21swapper/300:16:563
27150,0ktimersoftd/20-21swapper/219:13:132
259950,0migration/25344-21kthreadcore20:51:532
259950,0migration/227185-21cpuspeed_turbos19:56:452
259950,0migration/220009-21kthreadcore22:01:492
259950,0migration/215951-21unixbench_multi20:56:562
249950,0watchdog/215638-21cat21:16:512
114399955,0cyclictest0-21swapper/223:16:392
114399955,0cyclictest0-21swapper/222:26:492
114399955,0cyclictest0-21swapper/222:14:412
114399955,0cyclictest0-21swapper/221:36:222
114399955,0cyclictest0-21swapper/219:41:452
114399955,0cyclictest0-21swapper/200:16:432
114399954,0cyclictest3514-21snmpd20:34:552
114399950,0cyclictest0-21swapper/200:13:432
114389955,0cyclictest0-21swapper/122:44:161
114389955,0cyclictest0-21swapper/120:58:001
114389953,0cyclictest0-21swapper/122:14:471
114389952,0cyclictest6944-21awk19:16:491
114389952,0cyclictest3556-21lldpd00:11:111
114389952,0cyclictest3141-21awk20:26:481
114389952,0cyclictest18568-21awk22:01:471
114389950,0cyclictest0-21swapper/123:12:391
114389950,0cyclictest0-21swapper/121:24:201
114379955,0cyclictest9512-21kworker/0:023:56:480
114379955,0cyclictest1400-21kworker/0:020:31:350
114379955,0cyclictest1400-21kworker/0:019:31:450
114379955,0cyclictest1400-21kworker/0:019:11:490
114379955,0cyclictest1400-21kworker/0:018:56:450
339940,0migration/38327-21diskmemload23:16:363
339940,0migration/35943-21kthreadcore20:01:513
339940,0migration/331799-21unixbench_singl22:06:573
339940,0migration/329841-21kthreadcore22:46:513
339940,0migration/329425-21kthreadcore23:06:503
339940,0migration/328196-21kthreadcore19:31:503
339940,0migration/327851-21kthreadcore21:26:503
339940,0migration/325516-21fschecks_time19:06:483
339940,0migration/325398-21kthreadcore20:16:503
339940,0migration/316105-21kthreadcore19:46:513
29725040,0irq/27-eth0-tx-9665-21diskmemload23:06:392
29725040,0irq/27-eth0-tx-9427-21aten_r1power_fr22:16:432
29725040,0irq/27-eth0-tx-8679-21ssh22:56:352
29725040,0irq/27-eth0-tx-6832-21ssh23:12:522
29725040,0irq/27-eth0-tx-20841-21kthreadcore00:01:512
29725040,0irq/27-eth0-tx-17372-21grep23:01:462
29725040,0irq/27-eth0-tx-14135-21unixbench_singl23:36:552
29725040,0irq/27-eth0-tx-0-21swapper/223:51:522
29725040,0irq/27-eth0-tx-0-21swapper/223:41:482
29725040,0irq/27-eth0-tx-0-21swapper/223:32:492
29725040,0irq/27-eth0-tx-0-21swapper/223:26:342
29725040,0irq/27-eth0-tx-0-21swapper/222:51:562
29725040,0irq/27-eth0-tx-0-21swapper/222:41:532
29725040,0irq/27-eth0-tx-0-21swapper/222:32:032
29725040,0irq/27-eth0-tx-0-21swapper/222:21:372
29725040,0irq/27-eth0-tx-0-21swapper/222:06:362
29725040,0irq/27-eth0-tx-0-21swapper/221:58:372
29725040,0irq/27-eth0-tx-0-21swapper/221:41:482
29725040,0irq/27-eth0-tx-0-21swapper/221:21:412
29725040,0irq/27-eth0-tx-0-21swapper/200:08:002
29715040,0irq/26-eth0-rx-2608-21kthreadcore19:36:513
29715040,0irq/26-eth0-rx-0-21swapper/323:43:233
29715040,0irq/26-eth0-rx-0-21swapper/322:41:443
29715040,0irq/26-eth0-rx-0-21swapper/321:07:083
29715040,0irq/26-eth0-rx-0-21swapper/320:36:453
29715040,0irq/26-eth0-rx-0-21swapper/319:16:453
29715040,0irq/26-eth0-rx-0-21swapper/300:12:273
29715040,0irq/26-eth0-rx-0-21swapper/300:01:363
259940,0migration/24186-21kthreadcore20:26:492
259940,0migration/230415-21latency22:46:512
259940,0migration/225117-21kthreadcore19:51:512
259940,0migration/213337-21missed_timers20:06:522
249940,0watchdog/227272-21head20:16:562
249940,0watchdog/211377-21kthreadcore22:36:512
249940,0watchdog/20-21swapper/223:46:472
249940,0watchdog/20-21swapper/221:46:512
249940,0watchdog/20-21swapper/220:36:522
169940,0watchdog/10-21swapper/123:51:551
169940,0watchdog/10-21swapper/123:01:511
169940,0watchdog/10-21swapper/121:16:511
169940,0watchdog/10-21swapper/118:56:561
114399943,0cyclictest3556-21lldpd20:48:102
114399943,0cyclictest3556-21lldpd20:13:102
114399943,0cyclictest3514-21snmpd20:42:252
114399943,0cyclictest3514-21snmpd20:05:242
114399943,0cyclictest3514-21snmpd19:50:392
114399943,0cyclictest3514-21snmpd19:37:542
114399943,0cyclictest2842-21awk21:11:482
114399943,0cyclictest27022-21awk21:06:482
114399943,0cyclictest16319-21awk00:21:462
114399943,0cyclictest12502-21awk18:56:492
114399940,0cyclictest29723-21cut21:26:512
114389944,0cyclictest0-21swapper/122:26:551
114389943,0cyclictest3556-21lldpd21:09:401
114389943,0cyclictest3556-21lldpd19:57:391
114389943,0cyclictest3556-21lldpd19:07:401
114389943,0cyclictest3556-21lldpd19:02:401
114389943,0cyclictest3514-21snmpd23:47:261
114389943,0cyclictest3514-21snmpd23:18:551
114389943,0cyclictest3514-21snmpd22:55:551
114389943,0cyclictest3514-21snmpd22:39:551
114389943,0cyclictest3514-21snmpd21:15:551
114389943,0cyclictest3514-21snmpd20:54:551
114389943,0cyclictest3514-21snmpd20:50:551
114389943,0cyclictest3514-21snmpd20:39:551
114389943,0cyclictest3514-21snmpd20:21:551
114389943,0cyclictest3514-21snmpd20:18:551
114389943,0cyclictest3514-21snmpd20:03:541
114389943,0cyclictest3514-21snmpd19:24:391
114389943,0cyclictest3514-21snmpd00:18:261
114389943,0cyclictest3514-21snmpd00:13:561
114389943,0cyclictest3241-21irqbalance23:07:211
114389943,0cyclictest3241-21irqbalance21:03:221
114389943,0cyclictest26922-21awk21:46:481
114389943,0cyclictest25285-21awk23:26:471
114389943,0cyclictest14539-21awk19:46:491
114389943,0cyclictest14391-21ntpq20:31:531
114389943,0cyclictest10334-21awk22:16:471
114379944,0cyclictest1400-21kworker/0:020:43:330
114379944,0cyclictest1400-21kworker/0:020:36:490
114379944,0cyclictest1400-21kworker/0:020:11:490
339930,0migration/316898-21kthreadcore20:11:503
29715030,0irq/26-eth0-rx-0-21swapper/320:51:483
29715030,0irq/26-eth0-rx-0-21swapper/320:31:483
29715030,0irq/26-eth0-rx-0-21swapper/320:22:333
29715030,0irq/26-eth0-rx-0-21swapper/320:06:443
29715030,0irq/26-eth0-rx-0-21swapper/319:56:443
29715030,0irq/26-eth0-rx-0-21swapper/319:42:433
29715030,0irq/26-eth0-rx-0-21swapper/318:58:043
249930,0watchdog/20-21swapper/219:26:562
169930,0watchdog/10-21swapper/121:51:471
169930,0watchdog/10-21swapper/121:36:471
169930,0watchdog/10-21swapper/120:41:481
169930,0watchdog/10-21swapper/119:26:481
114399932,0cyclictest3514-21snmpd20:24:552
114399932,0cyclictest3514-21snmpd19:01:392
114399932,0cyclictest25837-21awk19:06:492
114389932,0cyclictest9665-21diskmemload23:42:221
114389932,0cyclictest4930-21sensors19:11:551
114389932,0cyclictest1983-21awk22:31:471
114389932,0cyclictest10564-21awk21:56:471
114389930,0cyclictest0-21swapper/122:06:551
29715020,0irq/26-eth0-rx-0-21swapper/320:46:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional