You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 08:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Apr 06, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2289725142,0sleep10-21swapper/118:56:401
2296823926,0sleep30-21swapper/318:57:303
2277723626,0sleep20-21swapper/218:55:132
2280623430,0sleep00-21swapper/018:55:350
231979976,0cyclictest0-21swapper/000:24:350
339960,0migration/37044-21kthreadcore21:09:353
339960,0migration/34791-21sh21:48:303
339960,0migration/33980-21sh22:07:133
339960,0migration/33691-21sh22:48:063
339960,0migration/332181-21munin-node19:29:333
339960,0migration/312876-21munin-node19:39:323
29715060,0irq/26-eth0-rx-4015-21if_err_eth000:09:303
29715060,0irq/26-eth0-rx-32756-21kthreadcore23:44:353
29715060,0irq/26-eth0-rx-21668-21munin-node21:39:373
231999960,0cyclictest0-21swapper/221:30:582
231999960,0cyclictest0-21swapper/221:14:342
231979960,0cyclictest0-21swapper/022:30:360
179960,0migration/1479-21missed_timers00:04:351
149960,0migration/028000-21sh22:21:590
149960,0migration/027169-21switchtime21:59:390
149960,0migration/026536-21sh00:02:050
149960,0migration/020183-21sh21:15:140
4150,0ktimersoftd/00-21swapper/021:58:450
339950,0migration/39276-21kthreadcore19:09:353
339950,0migration/38933-21kthreadcore22:49:333
339950,0migration/37884-21taskset20:46:373
339950,0migration/37741-21munin-node20:24:313
339950,0migration/37413-21kthreadcore19:34:343
339950,0migration/34305-21taskset21:06:273
339950,0migration/332604-21taskset20:17:393
339950,0migration/330058-21munin-node19:04:293
339950,0migration/330019-21munin-node19:24:383
339950,0migration/329770-21taskset19:03:543
339950,0migration/327674-21taskset00:04:273
339950,0migration/325261-21latency_hist19:49:183
339950,0migration/324226-21kthreadcore23:39:343
339950,0migration/322132-21kthreadcore22:59:333
339950,0migration/321433-21taskset20:58:593
339950,0migration/314086-21aten_r1power_en20:29:273
339950,0migration/313987-21cpuspeed_turbos21:34:303
339950,0migration/312927-21latency_hist20:04:183
339950,0migration/312711-21diskmemload22:34:193
29725050,0irq/27-eth0-tx-31997-21munin-node19:54:370
29725050,0irq/27-eth0-tx-31937-21kthreadcore21:04:362
29725050,0irq/27-eth0-tx-28169-21munin-node23:24:332
29725050,0irq/27-eth0-tx-21961-21munin-node21:19:332
29725050,0irq/27-eth0-tx-20142-21df23:39:292
29725050,0irq/27-eth0-tx-20128-21ssh21:35:362
29725050,0irq/27-eth0-tx-17449-21kthreadcore23:14:352
29725050,0irq/27-eth0-tx-15120-21kthreadcore21:54:342
29725050,0irq/27-eth0-tx-0-21swapper/223:54:352
29725050,0irq/27-eth0-tx-0-21swapper/223:53:082
29725050,0irq/27-eth0-tx-0-21swapper/222:25:572
29725050,0irq/27-eth0-tx-0-21swapper/222:09:252
29725050,0irq/27-eth0-tx-0-21swapper/019:20:120
29725050,0irq/27-eth0-tx-0-21swapper/019:13:420
29715050,0irq/26-eth0-rx-4520-21if_eth1.223:49:313
29715050,0irq/26-eth0-rx-3488-21cat21:24:403
29715050,0irq/26-eth0-rx-29497-21kthreadcore23:24:333
29715050,0irq/26-eth0-rx-24756-21kthreadcore21:19:343
29715050,0irq/26-eth0-rx-14331-21kthreadcore00:14:353
29715050,0irq/26-eth0-rx-0-21swapper/323:55:373
29715050,0irq/26-eth0-rx-0-21swapper/323:34:303
29715050,0irq/26-eth0-rx-0-21swapper/323:09:333
29715050,0irq/26-eth0-rx-0-21swapper/323:08:123
29715050,0irq/26-eth0-rx-0-21swapper/322:23:043
29715050,0irq/26-eth0-rx-0-21swapper/322:14:273
29715050,0irq/26-eth0-rx-0-21swapper/321:59:233
27150,0ktimersoftd/20-21swapper/223:12:202
259950,0migration/230561-21irqrtprio22:04:332
259950,0migration/227756-21sh23:03:082
259950,0migration/224500-21kthreadcore23:59:372
259950,0migration/221557-21fschecks_count22:19:302
259950,0migration/22079-21sh23:46:022
259950,0migration/214913-21latency_hist20:54:182
259950,0migration/214913-21latency_hist20:54:182
231999955,0cyclictest0-21swapper/222:46:482
231999955,0cyclictest0-21swapper/221:10:002
231999955,0cyclictest0-21swapper/219:53:132
231999950,0cyclictest0-21swapper/223:30:002
231999950,0cyclictest0-21swapper/222:41:362
231999950,0cyclictest0-21swapper/222:32:172
231999950,0cyclictest0-21swapper/221:51:372
231989950,0cyclictest0-21swapper/123:22:171
231989950,0cyclictest0-21swapper/122:35:561
231979955,0cyclictest0-21swapper/023:55:250
231979955,0cyclictest0-21swapper/023:47:320
231979955,0cyclictest0-21swapper/023:42:390
231979950,0cyclictest0-21swapper/023:29:530
231979950,0cyclictest0-21swapper/021:33:220
231979950,0cyclictest0-21swapper/020:49:420
231979950,0cyclictest0-21swapper/020:49:420
231979950,0cyclictest0-21swapper/020:44:350
179950,0migration/18303-21kthreadcore23:29:341
179950,0migration/17645-21munin-node20:44:391
179950,0migration/16811-21taskset20:20:501
179950,0migration/14088-21sh22:28:171
179950,0migration/14049-21taskset19:08:381
179950,0migration/115982-21munin-node20:54:321
179950,0migration/114293-21kthreadcore23:54:331
179950,0migration/111799-21gltestperf19:14:321
179950,0migration/111724-21needreboot19:59:361
179950,0migration/111679-21taskset19:38:281
169950,0watchdog/119138-21python21:54:401
149950,0migration/09421-21sh00:09:520
149950,0migration/06658-21kthreadcore22:49:320
149950,0migration/06286-21kernelversion22:09:330
149950,0migration/05202-21kthreadcore23:49:330
149950,0migration/04560-21taskset21:47:500
149950,0migration/032696-21kthreadcore21:04:360
149950,0migration/029652-21munin-node19:24:350
149950,0migration/026523-21kthreadcore18:59:340
149950,0migration/024970-21kthreadcore21:39:340
149950,0migration/022929-21kthreadcore23:19:340
149950,0migration/020119-21fschecks_count20:09:290
149950,0migration/019162-21aten_r1power_cu00:19:270
149950,0migration/015951-21kthreadcore22:14:330
149950,0migration/014783-21irqcore21:34:330
149950,0migration/012958-21hddtemp_smartct23:14:300
149950,0migration/012529-21aten_r1power_fr22:54:280
149950,0migration/011228-21kthreadcore20:24:360
339940,0migration/36957-21kthreadcore22:29:343
339940,0migration/327950-21hwlatdetect00:24:323
339940,0migration/326699-21taskset20:34:413
339940,0migration/322546-21kthreadcore23:59:363
339940,0migration/317885-21runrttasks23:14:383
29725040,0irq/27-eth0-tx-29637-21ssh21:44:182
29725040,0irq/27-eth0-tx-27584-21ssh21:59:582
29725040,0irq/27-eth0-tx-27154-21munin-node00:24:322
29725040,0irq/27-eth0-tx-0-21swapper/223:34:302
29725040,0irq/27-eth0-tx-0-21swapper/223:04:272
29725040,0irq/27-eth0-tx-0-21swapper/222:49:312
29725040,0irq/27-eth0-tx-0-21swapper/222:34:592
29725040,0irq/27-eth0-tx-0-21swapper/221:39:252
29725040,0irq/27-eth0-tx-0-21swapper/221:24:172
29725040,0irq/27-eth0-tx-0-21swapper/221:00:252
29725040,0irq/27-eth0-tx-0-21swapper/200:20:492
29725040,0irq/27-eth0-tx-0-21swapper/020:54:310
29725040,0irq/27-eth0-tx-0-21swapper/020:34:270
29725040,0irq/27-eth0-tx-0-21swapper/019:49:360
29725040,0irq/27-eth0-tx-0-21swapper/019:34:290
29715040,0irq/26-eth0-rx-7100-21munin-node19:59:313
29715040,0irq/26-eth0-rx-0-21swapper/323:29:293
29715040,0irq/26-eth0-rx-0-21swapper/323:19:273
29715040,0irq/26-eth0-rx-0-21swapper/322:54:273
29715040,0irq/26-eth0-rx-0-21swapper/322:40:543
29715040,0irq/26-eth0-rx-0-21swapper/322:24:333
29715040,0irq/26-eth0-rx-0-21swapper/322:10:333
29715040,0irq/26-eth0-rx-0-21swapper/321:55:113
29715040,0irq/26-eth0-rx-0-21swapper/321:49:383
29715040,0irq/26-eth0-rx-0-21swapper/321:29:543
29715040,0irq/26-eth0-rx-0-21swapper/321:15:243
29715040,0irq/26-eth0-rx-0-21swapper/321:01:403
29715040,0irq/26-eth0-rx-0-21swapper/320:19:333
29715040,0irq/26-eth0-rx-0-21swapper/319:48:383
29715040,0irq/26-eth0-rx-0-21swapper/300:19:393
259940,0migration/24697-21kthreadcore20:44:332
259940,0migration/24415-21sh19:09:292
259940,0migration/232456-21fschecks_count19:54:302
259940,0migration/231601-21fschecks_time19:29:302
259940,0migration/230670-21kthreadcore20:39:352
259940,0migration/229991-21latency_hist19:04:182
259940,0migration/229771-21kthreadcore00:04:332
259940,0migration/22755-21kthreadcore20:19:332
259940,0migration/227075-21runrttasks20:39:052
259940,0migration/218882-21unixbench-2d20:04:412
259940,0migration/214619-21kthreadcore19:14:352
259940,0migration/213500-21kthreadcore19:39:332
259940,0migration/213031-21kthreadcore00:14:342
259940,0migration/212508-21aten2.4-expect22:54:272
249940,0watchdog/24148-21if_eth1.300:09:312
249940,0watchdog/213188-21cut22:14:272
231999943,0cyclictest6243-21awk19:34:332
231999943,0cyclictest3514-21snmpd19:28:402
231999943,0cyclictest27204-21awk20:14:322
231999943,0cyclictest21477-21sadc20:59:182
231999943,0cyclictest21109-21awk23:19:322
231999943,0cyclictest19622-21awk19:44:312
231999943,0cyclictest14881-21awk20:29:312
231999940,0cyclictest28187-21cut18:59:342
231989944,0cyclictest0-21swapper/121:40:451
231989944,0cyclictest0-21swapper/118:59:281
231989943,0cyclictest8204-21awk20:24:341
231989943,0cyclictest4473-21awk23:49:311
231989943,0cyclictest3556-21lldpd23:41:141
231989943,0cyclictest3556-21lldpd23:14:441
231989943,0cyclictest3556-21lldpd21:53:121
231989943,0cyclictest3556-21lldpd20:12:111
231989943,0cyclictest3556-21lldpd00:17:141
231989943,0cyclictest3514-21snmpd23:49:111
231989943,0cyclictest3514-21snmpd23:24:261
231989943,0cyclictest3514-21snmpd23:06:251
231989943,0cyclictest3514-21snmpd00:09:411
231989943,0cyclictest3241-21irqbalance23:59:251
231989943,0cyclictest28157-21awk00:24:341
231989943,0cyclictest19574-21awk19:44:311
231989943,0cyclictest18561-21awk19:19:321
231989943,0cyclictest13924-21awk20:04:331
231989943,0cyclictest13299-21awk22:54:311
231989940,0cyclictest0-21swapper/121:28:371
231979944,0cyclictest21486-21diskmemload23:37:460
231979943,0cyclictest3514-21snmpd21:12:400
231979943,0cyclictest3514-21snmpd00:14:260
231979943,0cyclictest12974-21awk19:39:320
231979940,0cyclictest0-21swapper/022:49:170
179940,0migration/15210-21fschecks_count22:29:301
179940,0migration/127346-21pmu-power20:59:371
179940,0migration/126815-21munin-node21:59:351
179940,0migration/126654-21unixbench_singl20:34:391
179940,0migration/125945-21fschecks_time19:49:301
179940,0migration/124444-21kthreadcore22:59:341
179940,0migration/12330-21kthreadcore19:54:341
179940,0migration/121322-21cpuspeed_turbos22:19:291
179940,0migration/119794-21timerandwakeup20:29:391
179940,0migration/114769-21kthreadcore19:39:341
179940,0migration/112263-21entropy23:34:301
179940,0migration/11214-21kthreadcore21:44:321
179940,0migration/111830-21kthreadcore20:49:361
179940,0migration/111830-21kthreadcore20:49:361
179940,0migration/110019-21kthreadcore21:09:361
169940,0watchdog/16559-21runrttasks21:39:081
169940,0watchdog/122814-21if_err_eth021:19:321
169940,0watchdog/120767-21ssh21:16:481
169940,0watchdog/10-21swapper/123:09:391
169940,0watchdog/10-21swapper/122:12:591
169940,0watchdog/10-21swapper/121:04:361
149940,0migration/07027-21fschecks_time19:59:310
149940,0migration/06533-21irqcore21:49:360
149940,0migration/031584-21kthreadcore23:24:340
149940,0migration/029893-21sh22:24:310
149940,0migration/025153-21kthreadcore22:59:340
149940,0migration/023014-21sh20:59:340
149940,0migration/019578-21proc_pri20:29:370
149940,0migration/01644-21kthreadcore19:04:350
149940,0migration/015514-21kthreadcore22:34:320
149940,0migration/01383-21kthreadcore19:29:340
35130,0ktimersoftd/30-21swapper/319:18:173
29715030,0irq/26-eth0-rx-0-21swapper/320:49:423
29715030,0irq/26-eth0-rx-0-21swapper/320:49:423
29715030,0irq/26-eth0-rx-0-21swapper/320:39:293
29715030,0irq/26-eth0-rx-0-21swapper/320:11:343
29715030,0irq/26-eth0-rx-0-21swapper/319:55:253
29715030,0irq/26-eth0-rx-0-21swapper/319:19:593
231999932,0cyclictest8220-21awk20:24:342
231999932,0cyclictest7529-21cut19:59:342
231999932,0cyclictest24264-21sed19:24:182
231999932,0cyclictest20597-21awk20:09:312
231989932,0cyclictest5260-21awk19:09:321
231989932,0cyclictest3556-21lldpd22:49:431
231989932,0cyclictest3556-21lldpd20:44:111
231989932,0cyclictest3514-21snmpd20:15:401
231989932,0cyclictest30789-21sadc19:29:181
231989932,0cyclictest11181-21tail21:29:351
231979933,0cyclictest31943-21kworker/0:223:09:200
231979933,0cyclictest31943-21kworker/0:223:04:240
231979933,0cyclictest31943-21kworker/0:222:39:330
231979933,0cyclictest31943-21kworker/0:222:04:230
231979933,0cyclictest31943-21kworker/0:221:24:210
231979933,0cyclictest31943-21kworker/0:221:19:510
231979933,0cyclictest31943-21kworker/0:220:39:210
231979933,0cyclictest31943-21kworker/0:220:19:190
231979933,0cyclictest31943-21kworker/0:220:14:270
231979933,0cyclictest31943-21kworker/0:220:04:190
231979933,0cyclictest31943-21kworker/0:219:44:210
231979933,0cyclictest31943-21kworker/0:219:14:270
231979933,0cyclictest28959-21kworker/0:100:04:280
169930,0watchdog/10-21swapper/122:44:231
169930,0watchdog/10-21swapper/122:40:311
169930,0watchdog/10-21swapper/122:14:271
169930,0watchdog/10-21swapper/122:04:311
169930,0watchdog/10-21swapper/100:20:071
169920,0watchdog/10-21swapper/119:29:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional