You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 23:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 29, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1071329190,0sleep30-21swapper/306:47:533
1073224938,0sleep00-21swapper/006:48:020
1039523726,0sleep20-21swapper/206:44:072
1053023624,0sleep10-21swapper/106:45:431
339970,0migration/330807-21taskset09:19:013
339960,0migration/312550-21sh10:51:053
29725060,0irq/27-eth0-tx-13875-21munin-node08:03:460
29715060,0irq/26-eth0-rx-30472-21diskstats10:43:373
29715060,0irq/26-eth0-rx-27647-21sh12:03:373
29715060,0irq/26-eth0-rx-2516-21yum11:23:503
29715060,0irq/26-eth0-rx-23504-21cat10:58:443
29715060,0irq/26-eth0-rx-0-21swapper/311:39:403
27160,0ktimersoftd/20-21swapper/210:18:512
149960,0migration/08667-21sh09:08:270
149960,0migration/028648-21sh11:01:550
149960,0migration/024108-21gltestperf09:58:360
149960,0migration/023357-21fschecks_time10:18:360
149960,0migration/023015-21sh09:58:140
149960,0migration/020200-21sh11:17:130
149960,0migration/010147-21sh11:49:410
108319960,0cyclictest0-21swapper/010:48:410
8215050,0irq/24-0000:00:7429-21cat09:48:242
8215050,0irq/24-0000:00:1455-21sensors_fan11:43:452
4150,0ktimersoftd/00-21swapper/010:45:510
339950,0migration/39836-21diskmemload12:10:463
339950,0migration/38642-21kthreadcore11:28:423
339950,0migration/37455-21kthreadcore08:43:433
339950,0migration/3726-21munin-node08:13:483
339950,0migration/330532-21taskset07:00:433
339950,0migration/325746-21munin-node08:08:443
339950,0migration/325234-21munin-node07:43:473
339950,0migration/323287-21sh08:54:263
339950,0migration/319601-21runrttasks11:15:253
339950,0migration/316970-21cpuspeed_turbos09:13:383
339950,0migration/316629-21munin-node06:48:453
339950,0migration/316361-21cpuspeed_turbos09:33:363
339950,0migration/313812-21munin-node08:23:463
339950,0migration/313019-21munin-node11:33:383
339950,0migration/313017-21timerandwakeup07:58:483
339950,0migration/311764-21munin-node07:33:463
339950,0migration/310392-21latency11:08:433
29725050,0irq/27-eth0-tx-7236-21munin-node07:58:420
29725050,0irq/27-eth0-tx-5311-21munin-node07:08:480
29725050,0irq/27-eth0-tx-3017-21munin-node12:08:422
29725050,0irq/27-eth0-tx-25011-21diskstats09:18:372
29725050,0irq/27-eth0-tx-0-21swapper/212:06:072
29725050,0irq/27-eth0-tx-0-21swapper/211:58:292
29725050,0irq/27-eth0-tx-0-21swapper/211:53:372
29725050,0irq/27-eth0-tx-0-21swapper/210:38:212
29725050,0irq/27-eth0-tx-0-21swapper/008:48:390
29725050,0irq/27-eth0-tx-0-21swapper/008:18:370
29725050,0irq/27-eth0-tx-0-21swapper/007:38:450
29725050,0irq/27-eth0-tx-0-21swapper/007:23:370
29715050,0irq/26-eth0-rx-6881-21munin-node10:08:473
29715050,0irq/26-eth0-rx-6181-21ssh09:45:193
29715050,0irq/26-eth0-rx-5622-21kthreadcore11:48:423
29715050,0irq/26-eth0-rx-3609-21ssh11:05:033
29715050,0irq/26-eth0-rx-31948-21aten_r1power_cu07:28:373
29715050,0irq/26-eth0-rx-28537-21diskstats08:38:383
29715050,0irq/26-eth0-rx-2604-21ssh11:46:083
29715050,0irq/26-eth0-rx-22119-21ssh10:38:363
29715050,0irq/26-eth0-rx-0-21swapper/312:17:523
29715050,0irq/26-eth0-rx-0-21swapper/311:53:463
29715050,0irq/26-eth0-rx-0-21swapper/310:53:433
29715050,0irq/26-eth0-rx-0-21swapper/310:36:393
29715050,0irq/26-eth0-rx-0-21swapper/310:28:423
29715050,0irq/26-eth0-rx-0-21swapper/310:24:573
29715050,0irq/26-eth0-rx-0-21swapper/310:13:443
29715050,0irq/26-eth0-rx-0-21swapper/309:30:113
29715050,0irq/26-eth0-rx-0-21swapper/309:23:293
29715050,0irq/26-eth0-rx-0-21swapper/309:08:423
29715050,0irq/26-eth0-rx-0-21swapper/308:52:583
259950,0migration/219119-21munin-node10:53:442
259950,0migration/214963-21kthreadcore11:33:412
259950,0migration/212041-21dump-pmu-power11:33:242
249950,0watchdog/220457-21cut09:53:422
249950,0watchdog/213930-21timerandwakeup08:23:472
179950,0migration/13836-21munin-node11:48:371
179950,0migration/130657-21munin-node09:18:471
179950,0migration/128863-21needreboot09:58:421
179950,0migration/126235-21munin-node08:58:411
179950,0migration/124616-21kthreadcore08:33:401
179950,0migration/124149-21kthreadcore11:38:431
179950,0migration/124127-21kthreadcore10:38:431
179950,0migration/121555-21needreboot09:33:431
179950,0migration/111758-21gltestperf12:13:371
179950,0migration/111484-21taskset07:09:571
169950,0watchdog/15155-21kthreadcore09:23:431
169950,0watchdog/12792-21grep10:43:421
169950,0watchdog/123098-21kthreadcore07:43:431
149950,0migration/08323-21kthreadcore11:28:420
149950,0migration/07163-21cpuspeed_turbos10:08:370
149950,0migration/06821-21fschecks_count07:33:400
149950,0migration/03955-21kthreadcore07:28:430
149950,0migration/028391-21cpuspeed_turbos08:38:370
149950,0migration/027087-21idleruntime07:48:390
149950,0migration/025290-21fschecks_time09:18:370
149950,0migration/021787-40yum-updatesd10:38:160
149950,0migration/019745-21aten_r1power_vo07:43:370
149950,0migration/019288-21fschecks_time07:18:390
149950,0migration/018323-21kthreadcore08:28:430
149950,0migration/017680-21kthreadcore10:53:420
149950,0migration/012779-21fschecks_count11:33:370
149950,0migration/01148-21irqcore09:23:410
149950,0migration/011186-21kthreadcore08:23:410
108349955,0cyclictest0-21swapper/209:12:002
108349955,0cyclictest0-21swapper/208:55:462
108349955,0cyclictest0-21swapper/207:53:482
108349955,0cyclictest0-21swapper/206:58:372
108349950,0cyclictest0-21swapper/211:15:362
108349950,0cyclictest0-21swapper/210:59:412
108349950,0cyclictest0-21swapper/210:24:502
108349950,0cyclictest0-21swapper/208:49:372
108329955,0cyclictest0-21swapper/110:49:431
108329955,0cyclictest0-21swapper/109:57:041
108329950,0cyclictest0-21swapper/111:54:031
108329950,0cyclictest0-21swapper/110:20:331
108329950,0cyclictest0-21swapper/106:58:541
108319955,0cyclictest0-21swapper/012:15:430
339940,0migration/37103-21runrttasks09:04:483
339940,0migration/332038-21irqcore07:03:423
339940,0migration/324767-21kthreadcore08:33:403
339940,0migration/318551-21kthreadcore08:03:433
339940,0migration/316395-21kthreadcore08:28:423
339940,0migration/315362-21latency_hist09:53:243
29725040,0irq/27-eth0-tx-6800-21ssh09:25:102
29725040,0irq/27-eth0-tx-5964-21ssh10:48:392
29725040,0irq/27-eth0-tx-5445-21ssh10:05:002
29725040,0irq/27-eth0-tx-26223-21ssh08:58:412
29725040,0irq/27-eth0-tx-22094-21ssh10:38:302
29725040,0irq/27-eth0-tx-0-21swapper/212:13:392
29725040,0irq/27-eth0-tx-0-21swapper/211:38:362
29725040,0irq/27-eth0-tx-0-21swapper/211:08:302
29725040,0irq/27-eth0-tx-0-21swapper/210:43:382
29725040,0irq/27-eth0-tx-0-21swapper/209:43:482
29725040,0irq/27-eth0-tx-0-21swapper/209:33:412
29725040,0irq/27-eth0-tx-0-21swapper/209:28:422
29715040,0irq/26-eth0-rx-17733-21munin-node06:53:373
29715040,0irq/26-eth0-rx-0-21swapper/311:58:343
29715040,0irq/26-eth0-rx-0-21swapper/311:18:313
29715040,0irq/26-eth0-rx-0-21swapper/310:18:443
29715040,0irq/26-eth0-rx-0-21swapper/310:03:343
29715040,0irq/26-eth0-rx-0-21swapper/309:59:093
29715040,0irq/26-eth0-rx-0-21swapper/309:51:213
29715040,0irq/26-eth0-rx-0-21swapper/309:40:323
29715040,0irq/26-eth0-rx-0-21swapper/308:59:473
27140,0ktimersoftd/20-21swapper/210:13:292
259940,0migration/26706-21taskset09:03:482
259940,0migration/229978-21munin-node11:03:392
259940,0migration/228299-21aten2.4-expect08:38:372
259940,0migration/227197-21kthreadcore07:23:422
259940,0migration/218726-21aten_r1power_fr07:18:372
259940,0migration/217118-21kthreadcore07:13:432
259940,0migration/211985-21switchtime07:33:482
249940,0watchdog/224366-21iostat09:58:382
249940,0watchdog/218713-21kthreadcore08:03:432
249940,0watchdog/215445-21munin-node08:28:392
249940,0watchdog/20-21swapper/211:48:422
249940,0watchdog/20-21swapper/208:08:432
249940,0watchdog/20-21swapper/207:28:432
179940,0migration/1931-21kthreadcore10:03:401
179940,0migration/18629-21latency_hist09:08:241
179940,0migration/15999-21kthreadcore08:43:421
179940,0migration/15110-21kthreadcore12:08:431
179940,0migration/14901-21fschecks_time11:28:371
179940,0migration/14261-21kthreadcore09:43:421
179940,0migration/132548-21kthreadcore11:43:411
179940,0migration/131606-21fschecks_time07:03:391
179940,0migration/131178-21kthreadcore07:48:421
179940,0migration/119929-21kthreadcore08:28:431
179940,0migration/118497-21hddtemp_smartct06:53:401
179940,0migration/113186-21irqrtprio07:13:411
179940,0migration/112877-21latency_hist07:38:241
179940,0migration/112216-21irqrtprio06:48:411
169940,0watchdog/13514-21snmpd08:14:471
169940,0watchdog/126268-21kthreadcore09:38:431
169940,0watchdog/123975-21kthreadcore08:08:431
169940,0watchdog/121531-21ssh10:15:341
169940,0watchdog/120585-21ssh10:34:341
169940,0watchdog/113929-21timerandwakeup08:23:471
169940,0watchdog/113597-21fschecks_time11:13:381
169940,0watchdog/112649-21cut09:28:431
169940,0watchdog/10-21swapper/112:03:261
169940,0watchdog/10-21swapper/111:58:381
169940,0watchdog/10-21swapper/111:33:301
169940,0watchdog/10-21swapper/110:08:421
169940,0watchdog/10-21swapper/108:48:431
169940,0watchdog/10-21swapper/108:03:391
169940,0watchdog/10-21swapper/107:33:431
149940,0migration/09222-21runrttasks12:08:540
149940,0migration/06700-21fschecks_count10:28:380
149940,0migration/04050-21sendmail_mailtr10:23:450
149940,0migration/030960-21kthreadcore11:23:420
149940,0migration/027633-21kthreadcore06:58:430
149940,0migration/027195-21sh12:03:230
149940,0migration/023980-21kthreadcore08:08:430
149940,0migration/02310-21kthreadcore09:43:420
149940,0migration/014852-21kthreadcore11:53:420
108349944,0cyclictest0-21swapper/211:18:262
108349943,0cyclictest3556-21lldpd07:39:122
108349943,0cyclictest3556-21lldpd06:48:422
108349943,0cyclictest3514-21snmpd07:09:512
108349943,0cyclictest3514-21snmpd06:53:362
108349943,0cyclictest3334-21awk08:43:402
108349943,0cyclictest3241-21irqbalance10:28:332
108349943,0cyclictest31961-21awk07:03:412
108349943,0cyclictest29686-21awk11:23:402
108349943,0cyclictest28157-21awk08:13:402
108349943,0cyclictest27903-21sadc08:38:242
108349943,0cyclictest23981-21munin-node09:38:372
108349943,0cyclictest2275-21awk08:18:412
108349943,0cyclictest17652-21awk09:13:412
108349940,0cyclictest0-21swapper/210:08:382
108329944,0cyclictest0-21swapper/111:23:271
108329944,0cyclictest0-21swapper/111:03:261
108329943,0cyclictest8107-21awk07:58:391
108329943,0cyclictest7114-21awk10:28:391
108329943,0cyclictest3514-21snmpd11:08:361
108329943,0cyclictest3514-21snmpd10:58:361
108329943,0cyclictest3514-21snmpd10:54:361
108329943,0cyclictest3514-21snmpd10:25:361
108329943,0cyclictest3514-21snmpd09:14:361
108329943,0cyclictest3514-21snmpd07:21:061
108329943,0cyclictest2306-21awk08:18:411
108329943,0cyclictest17831-21awk08:53:381
108319944,0cyclictest0-21swapper/011:47:290
108319943,0cyclictest8405-21awk09:48:390
108319943,0cyclictest3514-21snmpd08:56:510
108319943,0cyclictest3286-21awk08:43:400
108319943,0cyclictest3241-21irqbalance11:40:320
108319943,0cyclictest3241-21irqbalance11:18:420
108319943,0cyclictest3241-21irqbalance10:40:320
108319943,0cyclictest3241-21irqbalance10:05:530
108319943,0cyclictest3241-21irqbalance09:36:130
108319943,0cyclictest3241-21irqbalance09:15:030
108319943,0cyclictest31913-21awk07:03:410
108319943,0cyclictest22484-21awk08:33:380
108319943,0cyclictest15856-21awk10:13:400
108319943,0cyclictest1425-21awk09:03:400
108319943,0cyclictest14087-21kworker/0:209:41:060
108319943,0cyclictest12026-21munin-node07:13:440
29725030,0irq/27-eth0-tx-28792-21rsyslogd06:48:360
29725030,0irq/27-eth0-tx-27266-21aten2.4-expect08:13:360
29715030,0irq/26-eth0-rx-0-21swapper/308:18:383
29715030,0irq/26-eth0-rx-0-21swapper/307:56:553
29715030,0irq/26-eth0-rx-0-21swapper/307:48:313
29715030,0irq/26-eth0-rx-0-21swapper/307:38:373
29715030,0irq/26-eth0-rx-0-21swapper/307:27:003
29715030,0irq/26-eth0-rx-0-21swapper/307:21:113
29715030,0irq/26-eth0-rx-0-21swapper/307:10:593
249930,0watchdog/223097-21kthreadcore07:43:432
179930,0migration/130969-21switchtime07:23:471
169930,0watchdog/10-21swapper/111:18:301
169930,0watchdog/10-21swapper/109:48:391
169930,0watchdog/10-21swapper/107:28:431
108349932,0cyclictest7240-21cut07:58:352
108349932,0cyclictest27152-21awk07:48:392
108329932,0cyclictest5850-21memory07:53:431
108329932,0cyclictest3514-21snmpd08:42:361
108329930,0cyclictest525-21munin-node09:03:361
108319933,0cyclictest14087-21kworker/0:212:04:130
108319933,0cyclictest14087-21kworker/0:208:58:360
108319933,0cyclictest14087-21kworker/0:207:53:320
108319933,0cyclictest14087-21kworker/0:206:56:440
108319932,0cyclictest5911-21awk11:08:400
108319930,0cyclictest2796-21python11:03:480
108319930,0cyclictest14087-21kworker/0:209:28:420
29715020,0irq/26-eth0-rx-0-21swapper/307:13:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional