You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 20:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Dec 28, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450670,0irq/25-eth10-21swapper/307:05:113
3165823526,0sleep20-21swapper/207:06:212
3154923430,0sleep00-21swapper/007:05:070
3160822622,0sleep10-21swapper/107:05:481
35160,0ktimersoftd/30-21swapper/308:48:443
339960,0migration/35982-21sh11:06:153
339960,0migration/326865-21sh12:17:133
339960,0migration/325760-21sh11:57:313
339960,0migration/32525-21aten_r1power_en12:03:443
339960,0migration/318310-21sh12:11:413
339960,0migration/312579-21sh10:49:473
319199960,0cyclictest0-21swapper/112:32:241
319199960,0cyclictest0-21swapper/111:09:281
319189963,0cyclictest17425-21kworker/0:110:28:380
319189963,0cyclictest17425-21kworker/0:110:17:060
319189963,0cyclictest17425-21kworker/0:110:08:590
319189963,0cyclictest17425-21kworker/0:109:57:510
319189963,0cyclictest17425-21kworker/0:109:51:510
319189963,0cyclictest17425-21kworker/0:109:44:070
319189963,0cyclictest17425-21kworker/0:109:29:070
319189963,0cyclictest17425-21kworker/0:109:14:350
319189963,0cyclictest17425-21kworker/0:107:56:110
319189963,0cyclictest14045-21kworker/0:212:16:380
319189963,0cyclictest14045-21kworker/0:212:11:260
319189963,0cyclictest14045-21kworker/0:211:54:580
319189963,0cyclictest14045-21kworker/0:211:48:500
319189963,0cyclictest14045-21kworker/0:211:45:500
319189963,0cyclictest12126-21kworker/0:012:29:560
29725060,0irq/27-eth0-tx-20790-21munin-node07:48:492
29715060,0irq/26-eth0-rx-19032-21python10:33:573
29715060,0irq/26-eth0-rx-15804-21sh11:13:443
149960,0migration/030805-21idleruntime10:43:490
149960,0migration/02712-21if_eth1.307:58:510
149960,0migration/025131-21kthreadcore12:33:530
149960,0migration/022638-21sh09:21:360
149960,0migration/020310-21timerandwakeup10:53:550
149960,0migration/014414-21sh11:11:130
149960,0migration/011375-21sh12:27:180
8215050,0irq/24-0000:00:10651-21cat09:53:332
35150,0ktimersoftd/30-21swapper/310:42:193
339950,0migration/38156-21diskmemload11:08:483
339950,0migration/38116-21munin-node08:23:533
339950,0migration/36989-21kthreadcore12:23:523
339950,0migration/3581-21sh09:45:333
339950,0migration/34710-21munin-node10:08:523
339950,0migration/34409-21kthreadcore07:33:543
339950,0migration/332106-21runrttasks11:23:293
339950,0migration/331347-21sh09:26:393
339950,0migration/330757-21kthreadcore12:18:503
339950,0migration/321074-21switchtime09:18:573
339950,0migration/318003-21kthreadcore08:33:513
339950,0migration/317897-21latency_hist11:53:333
339950,0migration/316700-21kthreadcore07:43:513
339950,0migration/31484-21irqrtprio09:28:503
339950,0migration/31328-21taskset07:56:533
339950,0migration/313030-21kthreadcore08:53:493
339950,0migration/310945-21kthreadcore11:28:503
319209950,0cyclictest0-21swapper/212:01:492
319209950,0cyclictest0-21swapper/208:03:552
319199955,0cyclictest0-21swapper/112:26:341
319199955,0cyclictest0-21swapper/109:51:351
319199950,0cyclictest0-21swapper/112:04:391
319199950,0cyclictest0-21swapper/111:23:301
319199950,0cyclictest0-21swapper/111:15:181
319189955,0cyclictest0-21swapper/008:53:510
319189953,0cyclictest17425-21kworker/0:109:33:590
319189953,0cyclictest17425-21kworker/0:108:48:450
319189953,0cyclictest17425-21kworker/0:108:43:510
319189953,0cyclictest17425-21kworker/0:108:42:390
319189953,0cyclictest17425-21kworker/0:108:09:410
319189953,0cyclictest17425-21kworker/0:107:27:110
319189952,0cyclictest17425-21kworker/0:110:24:380
319189952,0cyclictest17425-21kworker/0:110:03:350
319189952,0cyclictest17425-21kworker/0:109:58:390
319189952,0cyclictest14045-21kworker/0:212:19:200
319189952,0cyclictest14045-21kworker/0:212:03:380
319189952,0cyclictest14045-21kworker/0:211:39:400
319189952,0cyclictest14045-21kworker/0:211:34:180
319189952,0cyclictest14045-21kworker/0:211:30:260
319189952,0cyclictest14045-21kworker/0:211:14:360
319189952,0cyclictest14045-21kworker/0:210:38:380
319189952,0cyclictest14045-21kworker/0:210:34:200
29725050,0irq/27-eth0-tx-7506-21munin-node07:38:462
29725050,0irq/27-eth0-tx-5353-21cut11:43:482
29725050,0irq/27-eth0-tx-4547-21iostat10:08:522
29725050,0irq/27-eth0-tx-3777-21munin-node12:23:552
29725050,0irq/27-eth0-tx-32130-21munin-node07:08:482
29725050,0irq/27-eth0-tx-31741-21ssh11:22:382
29725050,0irq/27-eth0-tx-26330-21cut09:43:442
29725050,0irq/27-eth0-tx-16391-21ssh11:33:042
29725050,0irq/27-eth0-tx-12209-21munin-node12:28:552
29725050,0irq/27-eth0-tx-11963-21munin-node10:13:522
29725050,0irq/27-eth0-tx-0-21swapper/212:33:522
29725050,0irq/27-eth0-tx-0-21swapper/212:14:172
29725050,0irq/27-eth0-tx-0-21swapper/211:49:232
29725050,0irq/27-eth0-tx-0-21swapper/211:04:202
29725050,0irq/27-eth0-tx-0-21swapper/210:48:442
29725050,0irq/27-eth0-tx-0-21swapper/210:43:482
29725050,0irq/27-eth0-tx-0-21swapper/210:01:012
29725050,0irq/27-eth0-tx-0-21swapper/209:18:522
29715050,0irq/26-eth0-rx-3886-21smartctl09:08:543
29715050,0irq/26-eth0-rx-3717-21ssh10:26:453
29715050,0irq/26-eth0-rx-28752-21ssh10:03:503
29715050,0irq/26-eth0-rx-26142-21swap10:18:563
29715050,0irq/26-eth0-rx-22995-21cpuspeed_turbos08:38:453
29715050,0irq/26-eth0-rx-15875-21sh09:35:303
29715050,0irq/26-eth0-rx-15213-21sed10:53:463
29715050,0irq/26-eth0-rx-0-21swapper/312:34:473
29715050,0irq/26-eth0-rx-0-21swapper/312:32:013
29715050,0irq/26-eth0-rx-0-21swapper/311:43:423
29715050,0irq/26-eth0-rx-0-21swapper/311:24:233
29715050,0irq/26-eth0-rx-0-21swapper/310:58:483
29715050,0irq/26-eth0-rx-0-21swapper/310:14:303
29715050,0irq/26-eth0-rx-0-21swapper/309:58:383
29715050,0irq/26-eth0-rx-0-21swapper/309:43:253
29715050,0irq/26-eth0-rx-0-21swapper/308:08:493
29715050,0irq/26-eth0-rx-0-21swapper/307:23:523
29715050,0irq/26-eth0-rx-0-21swapper/307:18:543
27150,0ktimersoftd/20-21swapper/210:42:192
259950,0migration/2786-21hwlatdetect11:23:472
259950,0migration/24038-21kthreadcore09:48:502
259950,0migration/231441-21sh09:26:502
259950,0migration/229767-21irqcore10:23:472
259950,0migration/228036-21taskset10:22:412
259950,0migration/226096-21gltestperf11:38:472
259950,0migration/224807-21sh11:55:152
259950,0migration/223463-21fschecks_time10:58:482
259950,0migration/222584-21munin-node11:33:532
259950,0migration/221666-21sh10:56:322
259950,0migration/221233-21kthreadcore08:58:522
259950,0migration/218934-21kthreadcore11:13:502
249950,0watchdog/2778-21grep09:28:472
19150,0ktimersoftd/10-21swapper/111:31:321
179950,0migration/18153-21sh11:28:261
179950,0migration/17720-21kthreadcore10:48:511
179950,0migration/129007-21taskset10:41:591
179950,0migration/127452-21irqrtprio09:43:481
179950,0migration/125108-21latency_hist11:38:331
179950,0migration/116711-21unixbench-2d09:53:561
179950,0migration/110875-21latency_hist12:08:331
169950,0watchdog/1779-21cut09:28:471
169950,0watchdog/12740-21iostat_ios07:58:521
169950,0watchdog/10-21swapper/107:53:481
149950,0migration/09493-21kthreadcore10:48:520
149950,0migration/07904-21kthreadcore07:13:510
149950,0migration/06967-21sh11:25:370
149950,0migration/05369-21sh09:11:560
149950,0migration/04652-21kthreadcore08:23:510
149950,0migration/04598-21taskset11:03:560
149950,0migration/031414-21kthreadcore11:58:530
149950,0migration/025766-21kthreadcore11:18:490
149950,0migration/024193-21cpuspeed_turbos09:23:450
149950,0migration/024051-21irqrtprio10:58:520
149950,0migration/024003-21cpuspeed_turbos09:03:470
149950,0migration/023558-21kthreadcore10:18:510
149950,0migration/020582-21kthreadcore08:33:520
149950,0migration/019472-21missed_timers07:43:520
149950,0migration/017699-21taskset09:38:430
149950,0migration/016703-21kthreadcore07:18:540
149950,0migration/016008-21latency_hist08:33:330
149950,0migration/011094-21kthreadcore08:03:520
339940,0migration/36689-21cpuspeed_turbos09:13:453
339940,0migration/331897-21kthreadcore10:43:513
339940,0migration/329267-21kthreadcore07:28:503
339940,0migration/327636-21kthreadcore09:03:523
339940,0migration/325867-21fschecks_count11:38:463
339940,0migration/324134-21kthreadcore07:48:503
319209944,0cyclictest0-21swapper/212:18:422
319209943,0cyclictest8214-21awk11:08:492
319209943,0cyclictest7308-21awk07:13:492
319209943,0cyclictest3556-21lldpd07:59:552
319209943,0cyclictest3556-21lldpd07:25:252
319209943,0cyclictest3514-21snmpd08:26:452
319209943,0cyclictest3514-21snmpd07:21:452
319209943,0cyclictest23379-21perl08:38:462
319209943,0cyclictest11587-21perl12:08:462
319199944,0cyclictest3556-21lldpd08:50:241
319199944,0cyclictest0-21swapper/112:14:351
319199944,0cyclictest0-21swapper/110:30:121
319199944,0cyclictest0-21swapper/110:20:071
319199944,0cyclictest0-21swapper/109:16:441
319199943,0cyclictest4410-21awk10:08:511
319199943,0cyclictest3680-21awk08:23:481
319199943,0cyclictest3514-21snmpd10:55:451
319199943,0cyclictest28662-21awk12:18:481
319199943,0cyclictest20696-21awk07:23:481
319199943,0cyclictest18596-21awk09:38:481
319199943,0cyclictest18016-21awk08:58:491
319199943,0cyclictest1638-21awk07:33:501
319199943,0cyclictest16126-21awk09:18:501
319199943,0cyclictest14987-21awk07:43:491
319199943,0cyclictest10650-21awk11:48:471
319199943,0cyclictest10402-21awk08:28:511
319189944,0cyclictest17425-21kworker/0:107:41:550
319189943,0cyclictest517-21awk07:08:480
319189943,0cyclictest21697-21awk07:48:480
319189942,0cyclictest17425-21kworker/0:108:13:590
319189942,0cyclictest17425-21kworker/0:107:33:590
29725040,0irq/27-eth0-tx-12667-21ssh09:14:052
29725040,0irq/27-eth0-tx-0-21swapper/210:28:442
29725040,0irq/27-eth0-tx-0-21swapper/210:04:322
29725040,0irq/27-eth0-tx-0-21swapper/209:38:352
29725040,0irq/27-eth0-tx-0-21swapper/209:08:522
29725040,0irq/27-eth0-tx-0-21swapper/207:28:522
29715040,0irq/26-eth0-rx-30494-21kthreadcore08:18:523
29715040,0irq/26-eth0-rx-23133-21ssh11:34:053
29715040,0irq/26-eth0-rx-0-21swapper/311:58:583
29715040,0irq/26-eth0-rx-0-21swapper/310:28:503
29715040,0irq/26-eth0-rx-0-21swapper/309:53:333
29715040,0irq/26-eth0-rx-0-21swapper/309:48:503
29715040,0irq/26-eth0-rx-0-21swapper/307:38:483
27140,0ktimersoftd/20-21swapper/207:48:122
259940,0migration/29713-21cpuspeed_turbos08:28:472
259940,0migration/25186-21kthreadcore08:48:492
259940,0migration/2392-21kthreadcore08:43:502
259940,0migration/228606-21aten2.4-expect08:18:472
259940,0migration/225974-21kthreadcore09:03:512
259940,0migration/22340-21latency_hist12:03:332
259940,0migration/222394-21fschecks_time08:13:482
259940,0migration/218458-21kthreadcore10:33:532
249940,0watchdog/230545-21kthreadcore07:53:522
249940,0watchdog/216516-21diskstats08:33:482
249940,0watchdog/20-21swapper/209:33:552
179940,0migration/19709-21kthreadcore07:38:501
179940,0migration/132174-21aten_r1power_en07:08:451
179940,0migration/131785-21kthreadcore08:43:501
179940,0migration/131455-21cpuspeed_turbos11:03:471
179940,0migration/131432-21kthreadcore10:43:511
179940,0migration/127402-21kthreadcore08:38:501
179940,0migration/127077-21kthreadcore10:58:531
179940,0migration/125375-21kthreadcore08:13:521
179940,0migration/119413-21cpuspeed_turbos09:58:481
179940,0migration/116749-21kthreadcore10:33:521
179940,0migration/115552-21kthreadcore08:53:501
179940,0migration/113154-21aten_r1power_cu07:18:471
169940,0watchdog/19814-21kthreadcore08:03:521
169940,0watchdog/132670-21ssh11:41:511
169940,0watchdog/131611-21awk09:27:111
169940,0watchdog/130729-21cut08:18:521
169940,0watchdog/127860-21ssh12:36:311
169940,0watchdog/127387-21ssh10:03:351
169940,0watchdog/124439-21ssh11:54:231
169940,0watchdog/11590-21df11:43:431
169940,0watchdog/112706-21ssh10:13:471
169940,0watchdog/10-21swapper/109:33:551
169940,0watchdog/10-21swapper/109:03:521
169940,0watchdog/10-21swapper/108:33:521
169940,0watchdog/10-21swapper/107:13:521
149940,0migration/031136-21kthreadcore08:18:520
149940,0migration/019127-21kthreadcore08:58:510
319209932,0cyclictest11556-21sed08:53:482
319209930,0cyclictest0-21swapper/208:08:512
319199932,0cyclictest30876-21tr10:23:481
319199932,0cyclictest21747-21awk07:48:491
319199932,0cyclictest16116-21awk08:08:481
319189931,0cyclictest17425-21kworker/0:107:28:410
29715030,0irq/26-eth0-rx-0-21swapper/308:58:463
29715030,0irq/26-eth0-rx-0-21swapper/308:43:443
29715030,0irq/26-eth0-rx-0-21swapper/308:28:533
29715030,0irq/26-eth0-rx-0-21swapper/308:15:233
29715030,0irq/26-eth0-rx-0-21swapper/308:05:413
29715030,0irq/26-eth0-rx-0-21swapper/307:58:483
29715030,0irq/26-eth0-rx-0-21swapper/307:14:003
179930,0migration/11406-21kthreadcore09:08:501
169930,0watchdog/130210-21diskmemload11:58:351
169930,0watchdog/10-21swapper/107:28:561
319209921,0cyclictest663-21sed07:33:332
29715020,0irq/26-eth0-rx-0-21swapper/307:08:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional