You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 06:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 08, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
552926160,0sleep20-21swapper/218:47:032
304450550,0irq/25-eth10-21swapper/318:47:343
554723522,0sleep00-21swapper/018:47:170
553822622,0sleep10-21swapper/118:47:101
58989965,0cyclictest0-21swapper/223:50:452
4160,0ktimersoftd/00-21swapper/022:03:380
4160,0ktimersoftd/00-21swapper/022:03:380
35160,0ktimersoftd/30-21swapper/321:05:293
339960,0migration/36604-21sh21:53:573
339960,0migration/36497-21sh21:33:083
339960,0migration/36249-21sh20:53:363
339960,0migration/35464-21sh23:12:353
339960,0migration/329226-21sh23:06:003
339960,0migration/316152-21kthreadcore23:20:433
339960,0migration/313939-21sh23:59:313
29715060,0irq/26-eth0-rx-6559-21runrttasks21:19:463
29715060,0irq/26-eth0-rx-14539-40yum-updatesd-he22:39:273
149960,0migration/06868-21sh22:15:060
149960,0migration/05745-21sh21:51:340
149960,0migration/030342-21sh23:49:530
149960,0migration/029775-21sh00:09:010
149960,0migration/029492-21sh23:27:090
149960,0migration/023626-21latency_hist21:25:280
149960,0migration/021994-21sh23:44:010
149960,0migration/013824-21sh21:56:320
149960,0migration/012615-21switchtime23:15:500
8215050,0irq/24-0000:00:15581-21latency_hist21:20:282
8215050,0irq/24-0000:00:14550-21awk23:20:262
58989955,0cyclictest0-21swapper/219:40:422
58979955,0cyclictest31401-21diskmemload23:39:461
58979955,0cyclictest30399-21ssh21:47:311
58979955,0cyclictest0-21swapper/121:15:401
58979955,0cyclictest0-21swapper/100:14:081
58979950,0cyclictest0-21swapper/122:47:441
58979950,0cyclictest0-21swapper/122:24:341
58979950,0cyclictest0-21swapper/122:10:321
58979950,0cyclictest0-21swapper/121:31:351
58979950,0cyclictest0-21swapper/121:01:291
58979950,0cyclictest0-21swapper/100:01:221
58969950,0cyclictest0-21swapper/023:36:580
58969950,0cyclictest0-21swapper/021:17:270
58969950,0cyclictest0-21swapper/021:03:150
4150,0ktimersoftd/00-21swapper/022:56:500
339950,0migration/39962-21kthreadcore22:55:463
339950,0migration/39519-21kthreadcore21:55:463
339950,0migration/35608-21taskset23:33:193
339950,0migration/35600-21sh23:53:393
339950,0migration/34645-21munin-node22:30:483
339950,0migration/33624-21kernelversion20:00:443
339950,0migration/330644-21taskset22:49:383
339950,0migration/330296-21taskset21:47:143
339950,0migration/326500-21taskset19:26:513
339950,0migration/323393-21turbostat.cron21:45:233
339950,0migration/32011-21taskset20:00:173
339950,0migration/319415-21sh19:20:493
339950,0migration/317722-21taskset20:36:513
339950,0migration/314452-21taskset19:44:523
29725050,0irq/27-eth0-tx-6348-21aten2.4-expect00:15:382
29725050,0irq/27-eth0-tx-6106-21munin-node18:50:430
29725050,0irq/27-eth0-tx-586-21kthreadcore23:10:412
29725050,0irq/27-eth0-tx-30571-21munin-node00:10:412
29725050,0irq/27-eth0-tx-22904-21munin-node23:25:432
29725050,0irq/27-eth0-tx-21375-21munin-node19:50:440
29725050,0irq/27-eth0-tx-18279-21munin-node20:40:440
29725050,0irq/27-eth0-tx-16023-21tr23:00:422
29725050,0irq/27-eth0-tx-10081-21kthreadcore22:55:462
29725050,0irq/27-eth0-tx-0-21swapper/222:40:402
29725050,0irq/27-eth0-tx-0-21swapper/221:52:242
29725050,0irq/27-eth0-tx-0-21swapper/220:56:052
29715050,0irq/26-eth0-rx-6517-21cpu00:15:393
29715050,0irq/26-eth0-rx-28096-21ntp_offset00:05:483
29715050,0irq/26-eth0-rx-23333-21fschecks_count23:25:403
29715050,0irq/26-eth0-rx-18084-21kthreadcore22:20:443
29715050,0irq/26-eth0-rx-17272-21kthreadcore23:40:443
29715050,0irq/26-eth0-rx-13307-21unixbench_singl22:15:503
29715050,0irq/26-eth0-rx-13043-21ssh23:36:233
29715050,0irq/26-eth0-rx-0-21swapper/323:45:363
29715050,0irq/26-eth0-rx-0-21swapper/323:15:473
29715050,0irq/26-eth0-rx-0-21swapper/323:01:533
29715050,0irq/26-eth0-rx-0-21swapper/322:40:433
29715050,0irq/26-eth0-rx-0-21swapper/322:26:073
29715050,0irq/26-eth0-rx-0-21swapper/322:10:393
29715050,0irq/26-eth0-rx-0-21swapper/322:02:443
29715050,0irq/26-eth0-rx-0-21swapper/322:02:443
29715050,0irq/26-eth0-rx-0-21swapper/321:36:013
29715050,0irq/26-eth0-rx-0-21swapper/321:23:503
29715050,0irq/26-eth0-rx-0-21swapper/321:10:423
29715050,0irq/26-eth0-rx-0-21swapper/321:03:043
29715050,0irq/26-eth0-rx-0-21swapper/300:02:173
27150,0ktimersoftd/20-21swapper/222:33:392
259950,0migration/29182-21kthreadcore19:15:452
259950,0migration/28258-21unixbench-2d20:00:512
259950,0migration/26396-21sh20:53:582
259950,0migration/26216-21kthreadcore19:35:462
259950,0migration/25866-21sh21:11:122
259950,0migration/24986-21munin-node22:10:502
259950,0migration/222130-21sh22:22:422
259950,0migration/221593-21unixbench_singl21:00:522
259950,0migration/211460-21missed_timers18:50:452
249950,0watchdog/230891-21unixbench_multi20:45:502
249950,0watchdog/226996-21kthreadcore21:25:462
249950,0watchdog/224720-21tr21:45:412
249950,0watchdog/220900-21ssh00:01:332
249950,0watchdog/220836-21cat22:00:452
249950,0watchdog/220836-21cat22:00:452
249950,0watchdog/217877-21kthreadcore23:40:452
249950,0watchdog/210288-21irqstats20:05:422
249950,0watchdog/20-21swapper/219:45:422
19150,0ktimersoftd/10-21swapper/123:48:361
19150,0ktimersoftd/10-21swapper/121:14:341
179950,0migration/14044-21kthreadcore20:00:451
179950,0migration/132234-21sh22:50:421
179950,0migration/130593-21taskset22:08:361
179950,0migration/130182-21sh23:29:071
179950,0migration/121099-21fschecks_time19:25:421
179950,0migration/119959-21taskset19:23:091
179950,0migration/118851-21taskset18:56:191
179950,0migration/112528-21mdstat22:35:451
169950,0watchdog/15841-21grep19:35:461
169950,0watchdog/127021-21sendmail_mailtr19:50:501
149950,0migration/08066-21sh22:15:400
149950,0migration/05989-21sh00:15:190
149950,0migration/03886-21missed_timers23:50:460
149950,0migration/031904-21munin-node19:05:510
149950,0migration/031747-21hwlatdetect23:30:420
149950,0migration/029830-21taskset22:06:230
149950,0migration/028165-21kthreadcore20:45:430
149950,0migration/027016-21latency_hist19:30:280
149950,0migration/023934-21cpuspeed_turbos21:45:370
149950,0migration/023570-21sh21:05:300
149950,0migration/021852-21sh23:23:180
149950,0migration/019549-21kthreadcore00:00:420
149950,0migration/015334-21fschecks_time19:45:410
149950,0migration/015290-21latency_hist21:00:280
149950,0migration/014973-21latency_hist22:40:260
58989943,0cyclictest7532-21awk23:35:412
58989943,0cyclictest3556-21lldpd20:41:432
58989943,0cyclictest3556-21lldpd20:20:432
58989943,0cyclictest3556-21lldpd20:14:132
58989943,0cyclictest3556-21lldpd19:20:432
58989943,0cyclictest3556-21lldpd19:03:142
58989943,0cyclictest3514-21snmpd18:55:532
58989943,0cyclictest32167-21awk22:50:422
58989943,0cyclictest27285-21tr19:05:452
58989943,0cyclictest24361-21awk22:25:442
58989943,0cyclictest22354-21awk19:50:442
58989943,0cyclictest10957-21awk20:30:422
58979944,0cyclictest0-21swapper/121:52:331
58979944,0cyclictest0-21swapper/100:15:331
58979943,0cyclictest8937-21awk19:40:411
58979943,0cyclictest7749-21awk23:15:421
58979943,0cyclictest3556-21lldpd23:44:461
58979943,0cyclictest3556-21lldpd22:16:161
58979943,0cyclictest3514-21snmpd21:43:531
58979943,0cyclictest3514-21snmpd20:39:531
58979943,0cyclictest3241-21irqbalance23:05:351
58979943,0cyclictest3241-21irqbalance23:01:351
58979943,0cyclictest3241-21irqbalance21:05:461
58979943,0cyclictest16559-21awk20:10:441
58979943,0cyclictest16378-21awk22:00:421
58979943,0cyclictest16378-21awk22:00:421
58979943,0cyclictest1176-21awk19:10:431
58969944,0cyclictest0-21swapper/000:19:320
58969943,0cyclictest9924-21awk20:05:410
58969943,0cyclictest3556-21lldpd20:50:430
58969943,0cyclictest3514-21snmpd19:13:080
58969943,0cyclictest16176-21awk22:20:410
58969943,0cyclictest15853-21awk23:00:400
58969943,0cyclictest14594-21awk19:20:420
58969943,0cyclictest14282-21sadc00:00:260
339940,0migration/39887-21kthreadcore20:55:463
339940,0migration/34865-21kthreadcore20:25:453
339940,0migration/332377-21irqcore22:50:433
339940,0migration/327857-21proc_pri20:15:493
339940,0migration/320112-21fschecks_time19:00:413
339940,0migration/310120-21irqcore20:05:423
29725040,0irq/27-eth0-tx-7260-21ssh22:15:342
29725040,0irq/27-eth0-tx-23025-21munin-node23:05:472
29725040,0irq/27-eth0-tx-0-21swapper/223:46:182
29725040,0irq/27-eth0-tx-0-21swapper/223:20:592
29725040,0irq/27-eth0-tx-0-21swapper/222:35:402
29725040,0irq/27-eth0-tx-0-21swapper/221:36:092
29725040,0irq/27-eth0-tx-0-21swapper/221:16:202
29725040,0irq/27-eth0-tx-0-21swapper/200:05:542
29725040,0irq/27-eth0-tx-0-21swapper/020:34:520
29725040,0irq/27-eth0-tx-0-21swapper/020:15:400
29725040,0irq/27-eth0-tx-0-21swapper/020:00:440
29725040,0irq/27-eth0-tx-0-21swapper/019:59:130
29725040,0irq/27-eth0-tx-0-21swapper/019:40:430
29725040,0irq/27-eth0-tx-0-21swapper/019:39:420
29725040,0irq/27-eth0-tx-0-21swapper/019:00:480
29715040,0irq/26-eth0-rx-0-21swapper/322:05:573
29715040,0irq/26-eth0-rx-0-21swapper/321:25:353
29715040,0irq/26-eth0-rx-0-21swapper/320:44:333
29715040,0irq/26-eth0-rx-0-21swapper/320:21:083
29715040,0irq/26-eth0-rx-0-21swapper/300:12:573
259940,0migration/28490-21kthreadcore23:55:432
259940,0migration/27409-21taskset21:55:342
259940,0migration/25939-21proc_pri19:10:492
259940,0migration/230041-21runrttasks22:07:012
259940,0migration/227540-21fschecks_count19:30:402
259940,0migration/219651-21kthreadcore21:40:452
259940,0migration/21240-21kthreadcore21:30:442
249940,0watchdog/230891-21kthreadcore19:55:462
249940,0watchdog/226021-21kthreadcore22:45:452
249940,0watchdog/20-21swapper/223:30:452
249940,0watchdog/20-21swapper/221:05:462
249940,0watchdog/20-21swapper/219:25:462
179940,0migration/1512-21kthreadcore23:30:441
179940,0migration/13459-21kthreadcore20:50:461
179940,0migration/127599-21kthreadcore20:45:431
179940,0migration/127424-21kthreadcore21:25:451
179940,0migration/127294-21kthreadcore22:25:471
179940,0migration/123611-21irqcore00:05:441
179940,0migration/123242-21taskset21:24:271
179940,0migration/123223-21kthreadcore20:40:441
179940,0migration/122843-21fschecks_time20:15:411
179940,0migration/114885-21munin-node23:20:371
169940,0watchdog/14834-21ssh23:51:291
169940,0watchdog/13564-21kthreadcore22:30:451
169940,0watchdog/132399-21kthreadcore23:10:411
169940,0watchdog/130822-21kthreadcore19:05:461
169940,0watchdog/120609-21munin-node22:40:451
169940,0watchdog/112856-21ssh23:56:251
169940,0watchdog/112357-21munin-node19:15:461
169940,0watchdog/110767-21kthreadcore21:35:461
169940,0watchdog/10-21swapper/121:55:491
169940,0watchdog/10-21swapper/120:55:461
169940,0watchdog/10-21swapper/119:45:421
149940,0migration/06325-21sh21:32:380
149940,0migration/03209-21kthreadcore22:30:450
149940,0migration/030181-21sh22:27:550
149940,0migration/025018-21kthreadcore23:05:440
149940,0migration/020909-21rt-features22:40:480
149940,0migration/011247-21kthreadcore19:15:450
8215030,0irq/24-0000:00:0-21swapper/220:15:502
58989932,0cyclictest3556-21lldpd20:38:432
58979932,0cyclictest781-21kthreadcore20:20:451
58979932,0cyclictest6776-21sort18:50:401
58979932,0cyclictest28317-21tr19:55:411
58979932,0cyclictest10077-21basename20:30:381
58969933,0cyclictest7567-21kworker/0:022:50:280
58969933,0cyclictest7567-21kworker/0:022:45:280
58969933,0cyclictest7567-21kworker/0:021:40:350
58969933,0cyclictest7567-21kworker/0:021:35:470
58969933,0cyclictest5083-21kworker/0:121:25:410
58969933,0cyclictest5083-21kworker/0:121:11:110
58969933,0cyclictest5083-21kworker/0:120:20:290
58969933,0cyclictest5083-21kworker/0:118:55:410
58969932,0cyclictest31938-21awk23:10:390
58969930,0cyclictest0-21swapper/020:35:410
58969930,0cyclictest0-21swapper/020:10:420
29725030,0irq/27-eth0-tx-0-21swapper/020:25:390
29725030,0irq/27-eth0-tx-0-21swapper/019:25:440
29715030,0irq/26-eth0-rx-26220-21basename19:05:403
29715030,0irq/26-eth0-rx-0-21swapper/320:45:513
29715030,0irq/26-eth0-rx-0-21swapper/320:30:393
29715030,0irq/26-eth0-rx-0-21swapper/320:10:413
29715030,0irq/26-eth0-rx-0-21swapper/319:50:533
29715030,0irq/26-eth0-rx-0-21swapper/319:46:373
29715030,0irq/26-eth0-rx-0-21swapper/319:30:383
29715030,0irq/26-eth0-rx-0-21swapper/319:15:563
29715030,0irq/26-eth0-rx-0-21swapper/319:10:393
29715030,0irq/26-eth0-rx-0-21swapper/318:55:423
29715030,0irq/26-eth0-rx-0-21swapper/318:51:133
249930,0watchdog/20-21swapper/220:25:422
169930,0watchdog/10-21swapper/122:55:491
169930,0watchdog/10-21swapper/120:25:421
169930,0watchdog/10-21swapper/119:00:381
58979921,0cyclictest8970-21wc20:05:281
58979921,0cyclictest0-21swapper/119:30:281
329920,0watchdog/30-21swapper/319:35:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional