You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 09:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 09, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3201023726,0sleep00-21swapper/018:51:270
304450350,0irq/25-eth10-21swapper/318:48:173
3212623422,0sleep10-21swapper/118:52:481
3203723424,0sleep20-21swapper/218:51:452
35170,0ktimersoftd/30-21swapper/323:18:353
322309977,0cyclictest23018-21sensors20:43:352
339960,0migration/37934-21timerwakeupswit19:43:363
339960,0migration/34953-21sh21:33:553
339960,0migration/329131-21sh21:09:103
339960,0migration/32845-21sh00:14:243
339960,0migration/328230-21missed_timers21:48:303
339960,0migration/320148-21sh23:25:423
339960,0migration/314040-21latency_hist22:23:143
339960,0migration/313468-21sh21:01:083
339960,0migration/312999-21sh21:59:383
322309960,0cyclictest0-21swapper/223:34:352
322299966,0cyclictest0-21swapper/120:58:241
322299960,0cyclictest0-21swapper/123:11:091
322289965,0cyclictest12562-21sadc00:03:130
322289965,0cyclictest11876-21ps20:38:290
29725060,0irq/27-eth0-tx-0-21swapper/220:56:082
29715060,0irq/26-eth0-rx-20331-21ssh23:46:503
29715060,0irq/26-eth0-rx-11091-21sh00:19:473
149960,0migration/05831-21sh20:57:480
149960,0migration/04994-21sh22:36:320
149960,0migration/024919-21kthreadcore22:08:290
149960,0migration/017050-21kthreadcore22:03:320
149960,0migration/014501-21sh21:22:430
149960,0migration/012497-21sh22:19:040
8215050,0irq/24-0000:00:8537-21latency_hist19:48:142
8215050,0irq/24-0000:00:6232-21latency_hist21:58:142
339950,0migration/36561-21munin-node19:18:353
339950,0migration/36095-21cpuspeed_turbos22:38:253
339950,0migration/330652-21aten_r1power_po22:13:253
339950,0migration/329550-21taskset23:13:193
339950,0migration/328027-21needreboot22:08:313
339950,0migration/327899-21munin-node19:38:263
339950,0migration/326443-21kthreadcore20:48:303
339950,0migration/323988-21kthreadcore19:33:303
339950,0migration/323932-21kthreadcore23:48:323
339950,0migration/32323-21munin-node23:33:303
339950,0migration/32048-21kthreadcore22:33:293
339950,0migration/320322-21kthreadcore20:43:303
339950,0migration/318876-21unixbench-2d00:03:353
339950,0migration/318352-21kthreadcore21:23:313
339950,0migration/314781-21taskset19:48:473
339950,0migration/313950-21taskset19:25:253
339950,0migration/313260-21diskmemload21:19:103
339950,0migration/311074-21kthreadcore21:38:303
322309955,0cyclictest0-21swapper/222:15:262
322309954,0cyclictest0-21swapper/220:08:312
322309950,0cyclictest0-21swapper/221:43:072
322299955,0cyclictest0-21swapper/122:36:471
322299955,0cyclictest0-21swapper/100:01:451
322299950,0cyclictest0-21swapper/121:43:481
322299950,0cyclictest0-21swapper/121:40:111
322299950,0cyclictest0-21swapper/121:18:251
322289950,0cyclictest0-21swapper/000:06:160
29725050,0irq/27-eth0-tx-6899-21munin-node21:18:372
29725050,0irq/27-eth0-tx-6026-21iostat_ios23:38:292
29725050,0irq/27-eth0-tx-6026-21iostat_ios23:38:292
29725050,0irq/27-eth0-tx-4042-21mdstat21:13:322
29725050,0irq/27-eth0-tx-3429-21cat22:53:362
29725050,0irq/27-eth0-tx-3389-21ssh00:15:562
29725050,0irq/27-eth0-tx-3307-21unixbench_singl23:13:352
29725050,0irq/27-eth0-tx-30058-21if_eth1.323:53:282
29725050,0irq/27-eth0-tx-23274-21cpuspeed_turbos21:28:262
29725050,0irq/27-eth0-tx-22821-21munin-node21:48:252
29725050,0irq/27-eth0-tx-21482-21ssh22:47:542
29725050,0irq/27-eth0-tx-13229-21diskstats00:03:252
29725050,0irq/27-eth0-tx-12240-21ssh22:39:132
29725050,0irq/27-eth0-tx-10428-21grep23:18:302
29725050,0irq/27-eth0-tx-0-21swapper/223:52:332
29725050,0irq/27-eth0-tx-0-21swapper/223:09:002
29725050,0irq/27-eth0-tx-0-21swapper/223:07:472
29725050,0irq/27-eth0-tx-0-21swapper/222:33:182
29725050,0irq/27-eth0-tx-0-21swapper/222:18:372
29725050,0irq/27-eth0-tx-0-21swapper/221:11:532
29725050,0irq/27-eth0-tx-0-21swapper/221:00:492
29725050,0irq/27-eth0-tx-0-21swapper/200:02:222
29725050,0irq/27-eth0-tx-0-21swapper/020:28:160
29725050,0irq/27-eth0-tx-0-21swapper/019:43:270
29725050,0irq/27-eth0-tx-0-21swapper/019:38:280
29715050,0irq/26-eth0-rx-848-21kthreadcore21:13:313
29715050,0irq/26-eth0-rx-4440-21ssh22:55:453
29715050,0irq/26-eth0-rx-16478-21kthreadcore22:23:303
29715050,0irq/26-eth0-rx-0-21swapper/323:03:253
29715050,0irq/26-eth0-rx-0-21swapper/322:43:313
29715050,0irq/26-eth0-rx-0-21swapper/321:53:253
29715050,0irq/26-eth0-rx-0-21swapper/321:07:573
29715050,0irq/26-eth0-rx-0-21swapper/320:56:443
29715050,0irq/26-eth0-rx-0-21swapper/318:58:343
29715050,0irq/26-eth0-rx-0-21swapper/300:01:173
27150,0ktimersoftd/20-21swapper/222:08:582
259950,0migration/25624-21irqcore00:18:292
259950,0migration/220471-21sh22:24:032
259950,0migration/217920-21kthreadcore21:23:312
179950,0migration/18784-21kthreadcore18:58:311
179950,0migration/16001-21sh20:58:121
179950,0migration/124540-21kthreadcore21:48:291
179950,0migration/123091-21sh21:28:251
179950,0migration/115790-21runrttasks20:13:521
179950,0migration/113890-21sh22:23:081
169950,0watchdog/14484-21sendmail_mailtr21:33:361
169950,0watchdog/10-21swapper/120:28:321
149950,0migration/07278-21gltestperf21:58:240
149950,0migration/06543-21kthreadcore00:18:300
149950,0migration/05291-21cpuspeed_turbos23:38:250
149950,0migration/05291-21cpuspeed_turbos23:38:250
149950,0migration/05055-21kthreadcore20:08:300
149950,0migration/032676-21kthreadcore21:13:310
149950,0migration/031769-21kthreadcore20:03:290
149950,0migration/030129-21hwlatdetect23:33:260
149950,0migration/027564-21kthreadcore20:48:310
149950,0migration/024827-21kthreadcore21:48:290
149950,0migration/023859-21kthreadcore23:28:300
149950,0migration/021729-21munin-node23:08:250
149950,0migration/01797-21kthreadcore23:53:300
149950,0migration/017223-21kthreadcore21:23:310
149950,0migration/01654-21kthreadcore23:13:290
149950,0migration/016468-21kthreadcore19:28:320
149950,0migration/015886-21kernelversion21:03:290
149950,0migration/014709-21irqrtprio19:03:290
149950,0migration/014498-21kthreadcore20:13:310
149950,0migration/012713-21kthreadcore19:23:320
149950,0migration/01227-21kthreadcore22:53:310
149950,0migration/01072-21aten_r1power_fr19:18:260
339940,0migration/35137-21kthreadcore18:53:323
339940,0migration/329090-21taskset20:23:493
339940,0migration/324545-21kthreadcore23:28:303
339940,0migration/312980-21kthreadcore20:13:303
322309943,0cyclictest3556-21lldpd19:27:102
322309943,0cyclictest3556-21lldpd19:23:102
322309943,0cyclictest22013-21awk19:33:292
322309943,0cyclictest1780-21ps21:33:322
322309943,0cyclictest15271-21awk19:28:302
322309943,0cyclictest14325-21awk19:03:282
322299944,0cyclictest0-21swapper/122:48:271
322299944,0cyclictest0-21swapper/119:06:181
322299943,0cyclictest7395-21awk21:58:251
322299943,0cyclictest3556-21lldpd23:55:111
322299943,0cyclictest3556-21lldpd23:06:121
322299943,0cyclictest3556-21lldpd22:39:121
322299943,0cyclictest3556-21lldpd21:53:411
322299943,0cyclictest3556-21lldpd19:28:101
322299943,0cyclictest30456-21awk23:13:261
322299943,0cyclictest23464-21awk22:08:271
322299943,0cyclictest20934-21awk19:08:301
322299943,0cyclictest15539-21awk21:03:281
322289944,0cyclictest0-21swapper/023:44:310
322289944,0cyclictest0-21swapper/023:25:170
322289943,0cyclictest8531-21kworker/0:221:43:490
322289943,0cyclictest3514-21snmpd21:11:170
322289943,0cyclictest3514-21snmpd20:37:020
322289943,0cyclictest3514-21snmpd18:53:310
322289943,0cyclictest3241-21irqbalance22:39:220
322289943,0cyclictest3241-21irqbalance21:54:520
322289943,0cyclictest27593-21awk19:13:290
322289943,0cyclictest23116-21awk22:28:280
322289943,0cyclictest21749-21awk00:08:280
322289940,0cyclictest0-21swapper/023:19:550
29725040,0irq/27-eth0-tx-14520-21munin-node22:03:302
29725040,0irq/27-eth0-tx-0-21swapper/223:44:342
29725040,0irq/27-eth0-tx-0-21swapper/223:28:202
29725040,0irq/27-eth0-tx-0-21swapper/222:58:222
29725040,0irq/27-eth0-tx-0-21swapper/222:48:172
29725040,0irq/27-eth0-tx-0-21swapper/222:28:162
29725040,0irq/27-eth0-tx-0-21swapper/221:54:382
29725040,0irq/27-eth0-tx-0-21swapper/221:44:512
29725040,0irq/27-eth0-tx-0-21swapper/221:03:232
29725040,0irq/27-eth0-tx-0-21swapper/200:08:252
29725040,0irq/27-eth0-tx-0-21swapper/020:43:190
29725040,0irq/27-eth0-tx-0-21swapper/020:23:330
29725040,0irq/27-eth0-tx-0-21swapper/020:18:260
29725040,0irq/27-eth0-tx-0-21swapper/019:58:250
29725040,0irq/27-eth0-tx-0-21swapper/019:33:260
29725040,0irq/27-eth0-tx-0-21swapper/019:08:320
29715040,0irq/26-eth0-rx-0-21swapper/323:55:553
29715040,0irq/26-eth0-rx-0-21swapper/323:38:243
29715040,0irq/26-eth0-rx-0-21swapper/323:38:243
29715040,0irq/26-eth0-rx-0-21swapper/323:08:513
29715040,0irq/26-eth0-rx-0-21swapper/322:58:323
29715040,0irq/26-eth0-rx-0-21swapper/322:48:263
29715040,0irq/26-eth0-rx-0-21swapper/322:30:123
29715040,0irq/26-eth0-rx-0-21swapper/322:03:273
29715040,0irq/26-eth0-rx-0-21swapper/321:43:363
29715040,0irq/26-eth0-rx-0-21swapper/321:28:173
29715040,0irq/26-eth0-rx-0-21swapper/320:03:323
29715040,0irq/26-eth0-rx-0-21swapper/319:03:303
29715040,0irq/26-eth0-rx-0-21swapper/300:09:133
259940,0migration/27323-21fschecks_time18:58:272
259940,0migration/24606-21fschecks_time20:33:272
259940,0migration/229318-21fschecks_time20:03:252
259940,0migration/226150-21kthreadcore20:48:302
259940,0migration/223087-21aten2.4-expect20:23:252
259940,0migration/220019-21kthreadcore20:18:312
259940,0migration/217742-21kthreadcore19:53:312
259940,0migration/214068-21gltestperf23:23:262
249940,0watchdog/2801-21hwlatdetect18:53:292
249940,0watchdog/223961-21kthreadcore19:08:322
179940,0migration/19935-21unixbench-2d20:33:361
179940,0migration/1795-21kthreadcore23:33:291
179940,0migration/15747-21fschecks_count23:18:261
179940,0migration/14952-21taskset23:38:171
179940,0migration/14952-21taskset23:38:171
179940,0migration/14492-21kthreadcore18:53:321
179940,0migration/131538-21fschecks_time21:13:271
179940,0migration/129487-21idleruntime-cro20:28:141
179940,0migration/128273-21fschecks_count19:38:281
179940,0migration/127290-21kthreadcore21:08:301
179940,0migration/125923-21kthreadcore20:48:301
179940,0migration/125077-21kthreadcore00:08:311
179940,0migration/124515-21kthreadcore23:48:321
179940,0migration/123556-21taskset20:45:291
179940,0migration/117107-21kthreadcore21:23:311
179940,0migration/117011-21kthreadcore23:23:301
179940,0migration/116501-21kthreadcore22:23:301
179940,0migration/116407-21kthreadcore19:28:321
179940,0migration/113360-21kthreadcore19:48:341
179940,0migration/11248-21kthreadcore20:03:301
179940,0migration/11214-21kthreadcore22:13:301
169940,0watchdog/12932-21if_eth1.319:43:281
169940,0watchdog/127747-21python19:58:361
169940,0watchdog/122071-21python20:18:361
169940,0watchdog/117853-21kthreadcore23:43:311
169940,0watchdog/116181-21sh19:53:281
169940,0watchdog/114962-21grep22:03:281
169940,0watchdog/10-21swapper/122:58:201
169940,0watchdog/10-21swapper/119:34:161
169940,0watchdog/10-21swapper/100:18:271
149940,0migration/07801-21kthreadcore20:58:290
149940,0migration/032036-21if_eth1.321:33:300
149940,0migration/031494-21kthreadcore00:13:290
149940,0migration/024247-21kthreadcore22:48:310
149940,0migration/011167-21open_files22:58:310
149940,0migration/011159-21kthreadcore18:58:320
322309933,0cyclictest3556-21lldpd19:14:102
322309932,0cyclictest30596-21awk20:28:302
322309932,0cyclictest11581-21awk20:38:282
322309930,0cyclictest0-21swapper/219:59:132
322299933,0cyclictest3556-21lldpd20:09:401
322299932,0cyclictest6053-21grep19:18:321
322299932,0cyclictest3556-21lldpd22:28:411
322299932,0cyclictest3556-21lldpd19:15:401
322299932,0cyclictest3514-21snmpd23:28:481
322299932,0cyclictest29901-21irqcore00:13:281
322299930,0cyclictest0-21swapper/120:39:101
322289933,0cyclictest8531-21kworker/0:221:38:190
322289933,0cyclictest8531-21kworker/0:221:28:170
322289933,0cyclictest8531-21kworker/0:219:48:160
322289933,0cyclictest15307-21kworker/0:023:48:170
322289933,0cyclictest15307-21kworker/0:023:03:170
322289933,0cyclictest15307-21kworker/0:022:43:150
322289933,0cyclictest15307-21kworker/0:022:23:150
322289933,0cyclictest15307-21kworker/0:022:13:170
322289932,0cyclictest15353-21cat19:53:140
29715030,0irq/26-eth0-rx-0-21swapper/320:43:133
29715030,0irq/26-eth0-rx-0-21swapper/320:20:183
29715030,0irq/26-eth0-rx-0-21swapper/320:08:253
249930,0watchdog/20-21swapper/220:17:282
169930,0watchdog/10-21swapper/122:53:361
169930,0watchdog/10-21swapper/122:43:241
35120,0ktimersoftd/315541-21aten_r1power_vo19:53:263
339920,0migration/330108-21diskstats20:28:283
339920,0migration/322497-21diskstats19:58:273
322309921,0cyclictest8752-21date19:48:142
322299921,0cyclictest12733-21cut00:03:141
29715020,0irq/26-eth0-rx-0-21swapper/320:33:243
29715020,0irq/26-eth0-rx-0-21swapper/319:28:263
29715020,0irq/26-eth0-rx-0-21swapper/319:13:183
29715020,0irq/26-eth0-rx-0-21swapper/319:08:333
249920,0watchdog/20-21swapper/219:38:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional