You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 13:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Apr 25, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2623623925,0sleep00-21swapper/006:57:040
304450350,0irq/25-eth10-21swapper/306:53:283
2613223526,0sleep20-21swapper/206:55:502
2618523430,0sleep10-21swapper/106:56:291
4160,0ktimersoftd/00-21swapper/009:09:130
339960,0migration/38721-21sh11:50:323
339960,0migration/326508-21sh09:00:563
339960,0migration/317939-21sh10:36:263
339960,0migration/316758-21sh10:53:463
339960,0migration/316758-21sh10:53:463
339960,0migration/313190-21kthreadcore09:12:443
29725060,0irq/27-eth0-tx-5981-21munin-node08:47:410
29725060,0irq/27-eth0-tx-22166-21munin-node07:22:430
29715060,0irq/26-eth0-rx-3954-21perl09:27:413
29715060,0irq/26-eth0-rx-30425-21kthreadcore12:02:453
29715060,0irq/26-eth0-rx-16844-21nfs4_client09:32:453
29715060,0irq/26-eth0-rx-11321-21cut10:12:403
263429960,0cyclictest0-21swapper/211:48:042
149960,0migration/08760-21sh10:48:450
149960,0migration/01960-21sh09:45:220
149960,0migration/016925-21sh11:56:030
8215050,0irq/24-0000:00:1922-21munin-plugin-st07:07:272
339950,0migration/35831-21kthreadcore09:47:443
339950,0migration/34483-21kthreadcore07:32:453
339950,0migration/34117-21munin-node10:07:433
339950,0migration/332730-21kthreadcore08:17:443
339950,0migration/332627-21if_eth108:42:443
339950,0migration/332552-21munin-node10:02:463
339950,0migration/33163-21diskmemload10:27:413
339950,0migration/328736-21irqcore09:22:433
339950,0migration/327521-21latency_hist09:22:273
339950,0migration/326121-21kthreadcore08:12:453
339950,0migration/32276-21unixbench-2d07:27:503
339950,0migration/321483-21unixbench_singl07:17:513
339950,0migration/319526-21kthreadcore11:37:443
339950,0migration/318639-21cpuspeed_turbos08:32:403
339950,0migration/31840-21munin-node12:07:393
339950,0migration/314438-21kthreadcore09:52:433
339950,0migration/311424-21kthreadcore11:12:433
339950,0migration/310920-21irqcore11:32:423
29725050,0irq/27-eth0-tx-97992sleep211:32:352
29725050,0irq/27-eth0-tx-9770-21munin-node07:37:490
29725050,0irq/27-eth0-tx-6559-21runrttasks10:17:442
29725050,0irq/27-eth0-tx-3576-21ssh09:07:392
29725050,0irq/27-eth0-tx-31070-21grep09:02:442
29725050,0irq/27-eth0-tx-27195-21if_err_eth111:02:432
29725050,0irq/27-eth0-tx-26900-21munin-node10:22:482
29725050,0irq/27-eth0-tx-26119-21munin-node11:22:402
29725050,0irq/27-eth0-tx-2478-21munin-node10:27:492
29725050,0irq/27-eth0-tx-23107-21munin-node07:47:450
29725050,0irq/27-eth0-tx-2189-21munin-node10:47:422
29725050,0irq/27-eth0-tx-1706-21munin-node11:27:482
29725050,0irq/27-eth0-tx-10029-21munin-node11:12:452
29725050,0irq/27-eth0-tx-0-21swapper/212:18:172
29725050,0irq/27-eth0-tx-0-21swapper/211:52:282
29725050,0irq/27-eth0-tx-0-21swapper/211:37:452
29725050,0irq/27-eth0-tx-0-21swapper/211:07:552
29725050,0irq/27-eth0-tx-0-21swapper/210:56:472
29725050,0irq/27-eth0-tx-0-21swapper/210:56:472
29725050,0irq/27-eth0-tx-0-21swapper/210:46:472
29725050,0irq/27-eth0-tx-0-21swapper/210:46:472
29725050,0irq/27-eth0-tx-0-21swapper/209:57:372
29725050,0irq/27-eth0-tx-0-21swapper/209:32:482
29725050,0irq/27-eth0-tx-0-21swapper/209:21:482
29725050,0irq/27-eth0-tx-0-21swapper/008:19:580
29715050,0irq/26-eth0-rx-6559-21runrttasks11:23:233
29715050,0irq/26-eth0-rx-32433-21kthreadcore09:02:453
29715050,0irq/26-eth0-rx-29632-21kthreadcore11:02:453
29715050,0irq/26-eth0-rx-25796-21ssh09:59:223
29715050,0irq/26-eth0-rx-2266-21df11:07:413
29715050,0irq/26-eth0-rx-19324-21ssh09:37:343
29715050,0irq/26-eth0-rx-18152-21head11:17:373
29715050,0irq/26-eth0-rx-16996-21ssh12:17:003
29715050,0irq/26-eth0-rx-16819-21df_abs07:42:413
29715050,0irq/26-eth0-rx-15697-21unixbench_multi07:37:513
29715050,0irq/26-eth0-rx-11226-21tune2fs08:02:413
29715050,0irq/26-eth0-rx-0-21swapper/312:17:483
29715050,0irq/26-eth0-rx-0-21swapper/311:52:463
29715050,0irq/26-eth0-rx-0-21swapper/311:42:453
29715050,0irq/26-eth0-rx-0-21swapper/311:28:023
29715050,0irq/26-eth0-rx-0-21swapper/310:57:553
29715050,0irq/26-eth0-rx-0-21swapper/310:46:163
29715050,0irq/26-eth0-rx-0-21swapper/310:46:163
29715050,0irq/26-eth0-rx-0-21swapper/310:41:273
29715050,0irq/26-eth0-rx-0-21swapper/310:25:403
29715050,0irq/26-eth0-rx-0-21swapper/310:17:403
29715050,0irq/26-eth0-rx-0-21swapper/309:07:433
29715050,0irq/26-eth0-rx-0-21swapper/308:37:273
263429954,0cyclictest3514-21snmpd08:49:282
263429950,0cyclictest0-21swapper/211:46:112
263429950,0cyclictest0-21swapper/210:39:292
263419955,0cyclictest0-21swapper/108:22:391
263419954,0cyclictest5372-21tr07:57:441
263419950,0cyclictest0-21swapper/111:59:451
263409955,0cyclictest0-21swapper/009:50:220
263409955,0cyclictest0-21swapper/009:02:170
263409952,0cyclictest3834-21munin-run07:57:270
263409950,0cyclictest0-21swapper/009:57:380
263409950,0cyclictest0-21swapper/009:37:270
259950,0migration/27240-21switchtime12:07:492
259950,0migration/229958-21sh10:02:452
259950,0migration/229707-21munin-node08:12:502
259950,0migration/22960-21runrttasks09:27:262
259950,0migration/22486-21munin-node07:07:412
249950,0watchdog/232192-21sh12:03:532
249950,0watchdog/20-21swapper/209:38:572
179950,0migration/132535-21ksmtuned12:25:331
179950,0migration/118390-21latency_hist10:37:271
179950,0migration/115710-21kthreadcore09:32:431
179950,0migration/111043-21latency_hist09:52:271
169950,0watchdog/117246-21ssh11:36:331
149950,0migration/07401-21kthreadcore10:27:450
149950,0migration/07321-21kthreadcore07:07:460
149950,0migration/06377-21kthreadcore07:32:460
149950,0migration/04106-21kthreadcore12:07:430
149950,0migration/031417-21kthreadcore09:02:450
149950,0migration/031274-21kthreadcore11:02:460
149950,0migration/028833-21taskset07:27:380
149950,0migration/028444-21kthreadcore08:12:450
149950,0migration/027814-21kthreadcore11:22:440
149950,0migration/027222-21latency_hist09:42:270
149950,0migration/023883-21kthreadcore10:17:450
149950,0migration/021115-21kthreadcore11:57:430
149950,0migration/020333-21kthreadcore07:17:450
149950,0migration/020191-21kthreadcore11:17:430
149950,0migration/018921-21fschecks_time10:57:410
149950,0migration/017675-21cpuspeed_turbos12:17:370
149950,0migration/013807-21kthreadcore08:27:440
149950,0migration/012658-21kthreadcore10:12:440
149950,0migration/01181-21sh10:45:230
149950,0migration/01181-21sh10:45:230
8215040,0irq/24-0000:00:0-21swapper/207:57:272
339940,0migration/38109-21kthreadcore07:57:453
339940,0migration/327636-21taskset07:01:483
339940,0migration/323341-21cpuspeed_turbos07:47:403
29725040,0irq/27-eth0-tx-28030-21telnet07:02:390
29725040,0irq/27-eth0-tx-0-21swapper/212:22:382
29725040,0irq/27-eth0-tx-0-21swapper/211:57:442
29725040,0irq/27-eth0-tx-0-21swapper/211:17:372
29725040,0irq/27-eth0-tx-0-21swapper/210:33:072
29725040,0irq/27-eth0-tx-0-21swapper/210:13:242
29725040,0irq/27-eth0-tx-0-21swapper/209:52:382
29725040,0irq/27-eth0-tx-0-21swapper/209:42:452
29725040,0irq/27-eth0-tx-0-21swapper/209:27:332
29725040,0irq/27-eth0-tx-0-21swapper/008:37:400
29715040,0irq/26-eth0-rx-18303-21rt-features08:52:493
29715040,0irq/26-eth0-rx-0-21swapper/312:23:593
29715040,0irq/26-eth0-rx-0-21swapper/311:57:383
29715040,0irq/26-eth0-rx-0-21swapper/310:48:033
29715040,0irq/26-eth0-rx-0-21swapper/309:42:463
29715040,0irq/26-eth0-rx-0-21swapper/308:48:363
263429943,0cyclictest5889-21awk08:22:422
263429943,0cyclictest3556-21lldpd08:31:502
263429943,0cyclictest3556-21lldpd08:19:492
263429943,0cyclictest29639-21awk07:27:412
263429943,0cyclictest23019-21awk07:22:432
263429943,0cyclictest10680-21awk07:37:432
263429940,0cyclictest0-21swapper/208:07:462
263419944,0cyclictest0-21swapper/110:11:451
263419944,0cyclictest0-21swapper/109:44:571
263419943,0cyclictest4187-21awk09:07:421
263419943,0cyclictest3961-21awk07:32:431
263419943,0cyclictest3556-21lldpd12:07:511
263419943,0cyclictest3556-21lldpd11:26:511
263419943,0cyclictest3556-21lldpd11:13:511
263419943,0cyclictest3556-21lldpd10:18:511
263419943,0cyclictest3556-21lldpd10:02:211
263419943,0cyclictest3556-21lldpd09:41:511
263419943,0cyclictest3556-21lldpd08:34:501
263419943,0cyclictest3556-21lldpd08:28:201
263419943,0cyclictest3556-21lldpd07:37:501
263419943,0cyclictest3556-21lldpd07:08:491
263419943,0cyclictest3514-21snmpd09:20:131
263419943,0cyclictest28337-21awk09:02:421
263419943,0cyclictest26697-21awk12:02:431
263419943,0cyclictest24990-21awk08:12:431
263419943,0cyclictest2382-21awk11:47:401
263419943,0cyclictest18438-21awk12:17:411
263419943,0cyclictest18251-21awk08:07:441
263409944,0cyclictest0-21swapper/012:02:480
263409944,0cyclictest0-21swapper/011:42:470
263409944,0cyclictest0-21swapper/010:24:450
263409943,0cyclictest4161-21awk09:27:420
263409943,0cyclictest3556-21lldpd10:10:510
263409943,0cyclictest3514-21snmpd10:38:130
263409943,0cyclictest3241-21irqbalance11:48:050
263409943,0cyclictest3241-21irqbalance11:08:450
263409943,0cyclictest26357-21awk12:22:420
263409943,0cyclictest18221-21awk08:07:430
263409943,0cyclictest14042-21kworker/0:009:18:240
263409940,0cyclictest5022-21munin-node08:22:450
259940,0migration/27947-21kthreadcore10:07:442
259940,0migration/24151-21irqcore09:47:432
259940,0migration/231680-21taskset08:42:302
259940,0migration/23039-21runrttasks07:32:292
259940,0migration/226436-21kthreadcore08:37:432
259940,0migration/221386-21kthreadcore07:42:462
259940,0migration/220702-21kthreadcore08:57:432
259940,0migration/213446-21kthreadcore09:12:442
249940,0watchdog/29605-21gltestperf07:12:422
249940,0watchdog/227471-21tr07:47:462
249940,0watchdog/218857-21fschecks_time10:57:412
249940,0watchdog/20-21swapper/212:12:412
249940,0watchdog/20-21swapper/208:52:452
249940,0watchdog/20-21swapper/208:32:412
179940,0migration/13534-21cpuspeed_turbos09:27:401
179940,0migration/130966-21unixbench_multi08:37:501
179940,0migration/129867-21kthreadcore07:02:451
179940,0migration/129799-21kthreadcore09:22:441
179940,0migration/128634-21kthreadcore10:42:421
179940,0migration/128634-21kthreadcore10:42:421
179940,0migration/126844-21kthreadcore07:47:451
179940,0migration/123434-21kthreadcore08:57:441
179940,0migration/123125-21kthreadcore10:37:441
179940,0migration/121024-21pmu-power07:17:481
179940,0migration/11950-21cpuspeed_turbos11:27:381
179940,0migration/118784-21gltestperf11:17:401
179940,0migration/113939-21kthreadcore10:12:441
179940,0migration/113394-21kthreadcore11:52:431
179940,0migration/111019-21fschecks_time10:52:411
179940,0migration/111019-21fschecks_time10:52:411
179940,0migration/110154-21irqstats07:12:441
169940,0watchdog/17337-21kthreadcore10:47:451
169940,0watchdog/128336-21grep11:42:451
169940,0watchdog/127790-21cut10:02:411
169940,0watchdog/123471-21kthreadcore07:22:461
169940,0watchdog/119111-21diskmemload09:12:491
169940,0watchdog/118858-21fschecks_time10:57:411
169940,0watchdog/11812-21nfs4_client07:27:461
169940,0watchdog/110223-21ssh10:32:131
169940,0watchdog/10-21swapper/112:12:411
169940,0watchdog/10-21swapper/111:02:451
169940,0watchdog/10-21swapper/109:50:131
169940,0watchdog/10-21swapper/107:52:461
169940,0watchdog/10-21swapper/107:42:461
149940,0migration/0502-21latency09:22:450
149940,0migration/028598-21kthreadcore10:02:440
149940,0migration/024976-21sh11:40:330
149940,0migration/015811-21kthreadcore08:02:450
149940,0migration/013121-21kthreadcore07:12:450
149940,0migration/013032-21kthreadcore10:32:430
149940,0migration/012511-21kthreadcore10:52:440
149940,0migration/012511-21kthreadcore10:52:440
149940,0migration/011751-21fschecks_time09:52:390
29715030,0irq/26-eth0-rx-0-21swapper/308:27:383
29715030,0irq/26-eth0-rx-0-21swapper/308:24:013
29715030,0irq/26-eth0-rx-0-21swapper/308:09:243
29715030,0irq/26-eth0-rx-0-21swapper/307:52:393
29715030,0irq/26-eth0-rx-0-21swapper/307:24:253
29715030,0irq/26-eth0-rx-0-21swapper/307:12:393
29715030,0irq/26-eth0-rx-0-21swapper/307:09:453
29715030,0irq/26-eth0-rx-0-21swapper/307:02:433
263429932,0cyclictest21169-21sensors07:17:492
263429932,0cyclictest11467-21gltestperf08:02:412
263419933,0cyclictest0-21swapper/110:23:061
263419932,0cyclictest3556-21lldpd08:04:191
263419932,0cyclictest3556-21lldpd06:58:491
263419932,0cyclictest13624-21awk08:52:441
263419930,0cyclictest6392-21diskstats08:47:401
263409933,0cyclictest2081-21kworker/0:212:12:300
263409933,0cyclictest14042-21kworker/0:011:27:280
263409933,0cyclictest14042-21kworker/0:011:12:280
263409933,0cyclictest14042-21kworker/0:009:12:280
263409933,0cyclictest14042-21kworker/0:008:52:280
263409933,0cyclictest14042-21kworker/0:008:42:290
263409933,0cyclictest14042-21kworker/0:008:32:310
263409933,0cyclictest14042-21kworker/0:007:57:310
263409933,0cyclictest14042-21kworker/0:007:42:290
263409933,0cyclictest14042-21kworker/0:006:57:310
263409932,0cyclictest10715-21awk11:32:410
249930,0watchdog/20-21swapper/207:52:462
169930,0watchdog/13657-21munin-node08:17:451
169930,0watchdog/12106-21kthreadcore08:42:451
169930,0watchdog/10-21swapper/111:37:451
169930,0watchdog/10-21swapper/111:07:491
249920,0watchdog/20-21swapper/206:57:302
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional