You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 13:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Aug 10, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2803425857,0sleep00-21swapper/006:45:000
2803525655,0sleep10-21swapper/106:45:011
304450530,0irq/25-eth10-21swapper/306:46:273
2789723726,0sleep20-21swapper/206:43:222
283059976,0cyclictest8556-21users08:52:420
339960,0migration/36742-21sh10:35:033
339960,0migration/323175-21sh10:24:543
339960,0migration/322333-21missed_timers10:02:343
29725060,0irq/27-eth0-tx-3807-21munin-node07:17:310
29715060,0irq/26-eth0-rx-7601-21kthreadcore11:57:333
29715060,0irq/26-eth0-rx-32364-21kthreadcore12:12:313
29715060,0irq/26-eth0-rx-31928-21diskstats08:02:283
283089960,0cyclictest0-21swapper/208:55:102
283059965,0cyclictest17923-21kworker/0:211:33:070
283059960,0cyclictest0-21swapper/011:37:370
283059960,0cyclictest0-21swapper/009:11:180
149960,0migration/028942-21fschecks_count06:47:280
8215050,0irq/24-0000:00:8484-21kthreadcore11:57:332
339950,0migration/38820-21kthreadcore07:17:333
339950,0migration/37328-21kthreadcore08:07:333
339950,0migration/36338-21taskset08:28:433
339950,0migration/34791-21kthreadcore08:52:353
339950,0migration/33386-21taskset07:15:333
339950,0migration/331606-21kthreadcore11:52:293
339950,0migration/331301-21switchtime09:47:393
339950,0migration/329592-21kthreadcore09:07:343
339950,0migration/326178-21kthreadcore11:07:333
339950,0migration/324406-21kthreadcore11:27:333
339950,0migration/324063-21irqrtprio07:07:313
339950,0migration/321917-21aten2.4-expect11:47:273
339950,0migration/321285-21pmu-power10:42:363
339950,0migration/320803-21sh11:23:123
339950,0migration/318710-21fschecks_count07:52:293
339950,0migration/316782-21taskset09:18:393
339950,0migration/315112-21kthreadcore07:22:323
339950,0migration/313124-21kthreadcore09:37:343
339950,0migration/31162-21kthreadcore10:52:323
339950,0migration/310915-21taskset07:42:473
29725050,0irq/27-eth0-tx-8415-21fschecks_time10:37:282
29725050,0irq/27-eth0-tx-8183-21swap09:12:372
29725050,0irq/27-eth0-tx-3514-21snmpd11:46:562
29725050,0irq/27-eth0-tx-31981-21iostat11:12:322
29725050,0irq/27-eth0-tx-25880-21munin-node08:22:390
29725050,0irq/27-eth0-tx-23844-21munin-node07:32:300
29725050,0irq/27-eth0-tx-22382-21ssh11:27:212
29725050,0irq/27-eth0-tx-18638-21munin-node09:02:312
29725050,0irq/27-eth0-tx-17320-21ssh09:42:132
29725050,0irq/27-eth0-tx-12678-21ssh11:39:252
29725050,0irq/27-eth0-tx-11548-21munin-node07:47:370
29725050,0irq/27-eth0-tx-0-21swapper/212:11:182
29725050,0irq/27-eth0-tx-0-21swapper/211:22:202
29725050,0irq/27-eth0-tx-0-21swapper/210:50:392
29725050,0irq/27-eth0-tx-0-21swapper/209:27:042
29715050,0irq/26-eth0-rx-6559-21runrttasks09:25:313
29715050,0irq/26-eth0-rx-6453-21grep11:37:303
29715050,0irq/26-eth0-rx-3527-21kthreadcore10:12:333
29715050,0irq/26-eth0-rx-31511-21fschecks_time11:12:293
29715050,0irq/26-eth0-rx-28775-21grep06:47:273
29715050,0irq/26-eth0-rx-2841-21aten_r1power_en06:52:273
29715050,0irq/26-eth0-rx-26880-21port_sshpriv12:07:373
29715050,0irq/26-eth0-rx-25447-21kthreadcore10:47:313
29715050,0irq/26-eth0-rx-21613-21kthreadcore08:42:313
29715050,0irq/26-eth0-rx-1703-21ssh09:32:283
29715050,0irq/26-eth0-rx-15497-21cat11:42:313
29715050,0irq/26-eth0-rx-11716-21irqrtprio08:57:323
29715050,0irq/26-eth0-rx-0-21swapper/311:17:333
29715050,0irq/26-eth0-rx-0-21swapper/311:02:363
29715050,0irq/26-eth0-rx-0-21swapper/311:02:363
29715050,0irq/26-eth0-rx-0-21swapper/311:00:533
29715050,0irq/26-eth0-rx-0-21swapper/310:37:323
29715050,0irq/26-eth0-rx-0-21swapper/309:57:363
29715050,0irq/26-eth0-rx-0-21swapper/309:57:003
29715050,0irq/26-eth0-rx-0-21swapper/309:30:203
29715050,0irq/26-eth0-rx-0-21swapper/309:12:193
29715050,0irq/26-eth0-rx-0-21swapper/308:37:283
283089954,0cyclictest32306-21crond08:27:162
283089953,0cyclictest23794-21awk07:07:302
283089950,0cyclictest0-21swapper/210:43:572
283079955,0cyclictest0-21swapper/111:51:531
283079955,0cyclictest0-21swapper/111:45:441
283079950,0cyclictest0-21swapper/112:09:421
283079950,0cyclictest0-21swapper/110:52:551
283079950,0cyclictest0-21swapper/110:26:071
283079950,0cyclictest0-21swapper/109:58:501
283059955,0cyclictest26662-21diskmemload10:17:410
283059955,0cyclictest17923-21kworker/0:212:11:500
283059955,0cyclictest17923-21kworker/0:212:02:200
283059955,0cyclictest17923-21kworker/0:211:57:300
283059955,0cyclictest17923-21kworker/0:211:48:440
283059955,0cyclictest17923-21kworker/0:211:42:310
283059955,0cyclictest17923-21kworker/0:211:27:170
283059955,0cyclictest17923-21kworker/0:211:22:510
283059955,0cyclictest17923-21kworker/0:211:17:230
283059955,0cyclictest17923-21kworker/0:211:13:490
283059955,0cyclictest17923-21kworker/0:211:07:310
283059955,0cyclictest17923-21kworker/0:211:02:270
283059955,0cyclictest17923-21kworker/0:211:02:270
283059955,0cyclictest17923-21kworker/0:210:47:270
283059955,0cyclictest17923-21kworker/0:210:42:270
283059955,0cyclictest17923-21kworker/0:210:36:230
283059955,0cyclictest17923-21kworker/0:210:22:270
283059955,0cyclictest17923-21kworker/0:210:13:510
283059955,0cyclictest17923-21kworker/0:210:07:230
283059955,0cyclictest17923-21kworker/0:210:02:270
283059955,0cyclictest17923-21kworker/0:209:57:510
283059955,0cyclictest17923-21kworker/0:209:52:430
283059955,0cyclictest17923-21kworker/0:209:32:310
283059955,0cyclictest17923-21kworker/0:209:28:250
283059955,0cyclictest17923-21kworker/0:209:22:270
283059955,0cyclictest17923-21kworker/0:209:12:350
283059955,0cyclictest17923-21kworker/0:209:02:530
283059955,0cyclictest17923-21kworker/0:208:57:290
283059955,0cyclictest17923-21kworker/0:208:48:010
283059955,0cyclictest17923-21kworker/0:208:19:030
283059955,0cyclictest17923-21kworker/0:208:07:330
283059955,0cyclictest0-21swapper/009:43:280
283059954,0cyclictest17923-21kworker/0:209:17:250
283059950,0cyclictest0-21swapper/008:27:190
27150,0ktimersoftd/20-21swapper/211:06:472
27150,0ktimersoftd/20-21swapper/211:06:472
27150,0ktimersoftd/20-21swapper/210:12:202
259950,0migration/24517-21gltestperf07:17:292
259950,0migration/224026-21kthreadcore08:17:342
259950,0migration/21593-21fschecks_time09:52:282
259950,0migration/215592-21kthreadcore12:02:322
259950,0migration/211579-21irqcore08:57:322
249950,0watchdog/24577-21missed_timers10:52:342
249950,0watchdog/24409-21cat09:32:342
249950,0watchdog/227657-21sed08:47:302
249950,0watchdog/226321-21kthreadcore11:07:332
249950,0watchdog/20-21swapper/211:52:292
249950,0watchdog/20-21swapper/210:17:302
19150,0ktimersoftd/10-21swapper/110:12:201
179950,0migration/19709-21taskset08:55:431
179950,0migration/18714-21if_eth110:37:301
179950,0migration/1773-21kthreadcore06:47:321
179950,0migration/16759-21kthreadcore09:12:321
179950,0migration/131925-21taskset09:48:331
179950,0migration/129080-21latency_hist12:12:151
179950,0migration/118246-21munin-node09:22:271
179950,0migration/116334-21kthreadcore12:02:331
179950,0migration/112301-21taskset08:12:081
169950,0watchdog/127660-21gltestperf08:47:301
169950,0watchdog/116331-21kthreadcore08:37:341
149950,0migration/09686-21kthreadcore10:57:340
149950,0migration/06352-21kthreadcore07:42:340
149950,0migration/04494-21latency10:52:330
149950,0migration/03387-21unixbench_multi11:52:350
149950,0migration/031220-21kthreadcore12:12:310
149950,0migration/030850-21kthreadcore07:12:330
149950,0migration/029602-21kthreadcore09:47:340
149950,0migration/02867-21aten_r1power_fr06:52:270
149950,0migration/027896-21kthreadcore10:27:330
149950,0migration/021816-21kthreadcore08:42:310
149950,0migration/019860-21taskset08:40:290
149950,0migration/018881-21kthreadcore07:27:320
149950,0migration/017652-21kthreadcore07:02:340
149950,0migration/016997-21kthreadcore08:12:340
149950,0migration/013978-21kthreadcore07:22:320
149950,0migration/013289-21kthreadcore09:37:340
149950,0migration/012784-21kthreadcore10:37:320
149950,0migration/012359-21ntp_offset08:32:390
8215040,0irq/24-0000:00:31301-21latency_hist08:02:162
339940,0migration/39201-21kthreadcore08:32:353
339940,0migration/329550-21kthreadcore08:47:333
339940,0migration/324181-21kthreadcore08:17:343
339940,0migration/315628-21kthreadcore12:02:323
29725040,0irq/27-eth0-tx-26699-21ssh09:07:282
29725040,0irq/27-eth0-tx-26662-21diskmemload10:08:262
29725040,0irq/27-eth0-tx-17769-21telnet09:42:272
29725040,0irq/27-eth0-tx-16308-21munin-node10:22:352
29725040,0irq/27-eth0-tx-12333-21sensors_fan11:17:372
29725040,0irq/27-eth0-tx-0-21swapper/212:12:172
29725040,0irq/27-eth0-tx-0-21swapper/211:47:242
29725040,0irq/27-eth0-tx-0-21swapper/210:02:322
29725040,0irq/27-eth0-tx-0-21swapper/209:49:542
29725040,0irq/27-eth0-tx-0-21swapper/209:27:202
29725040,0irq/27-eth0-tx-0-21swapper/209:17:522
29725040,0irq/27-eth0-tx-0-21swapper/008:02:230
29715040,0irq/26-eth0-rx-24886-21aten_r1power_cu07:57:273
29715040,0irq/26-eth0-rx-0-21swapper/311:32:463
29715040,0irq/26-eth0-rx-0-21swapper/310:28:023
29715040,0irq/26-eth0-rx-0-21swapper/310:18:223
29715040,0irq/26-eth0-rx-0-21swapper/310:08:543
29715040,0irq/26-eth0-rx-0-21swapper/309:42:273
29715040,0irq/26-eth0-rx-0-21swapper/309:02:343
283089943,0cyclictest7776-21awk08:32:332
283089943,0cyclictest3556-21lldpd07:48:202
283089943,0cyclictest3556-21lldpd06:48:202
283089943,0cyclictest25087-21awk10:27:312
283089943,0cyclictest10351-21awk06:57:312
283089940,0cyclictest0-21swapper/208:37:392
283079944,0cyclictest0-21swapper/111:56:461
283079944,0cyclictest0-21swapper/111:00:291
283079944,0cyclictest0-21swapper/109:32:311
283079944,0cyclictest0-21swapper/109:27:471
283079943,0cyclictest3556-21lldpd07:17:191
283079943,0cyclictest3241-21irqbalance11:37:241
283079943,0cyclictest3241-21irqbalance11:22:241
283079943,0cyclictest31366-21awk07:37:321
283079943,0cyclictest25821-21awk10:07:331
283079943,0cyclictest21136-21awk08:42:301
283079943,0cyclictest18105-21awk07:27:311
283079943,0cyclictest15991-21awk11:02:301
283079943,0cyclictest15991-21awk11:02:301
283079943,0cyclictest11185-21awk09:17:301
283079943,0cyclictest1039-21awk08:27:321
283059944,0cyclictest26355-21kworker/0:106:57:280
283059944,0cyclictest17923-21kworker/0:207:57:270
283059944,0cyclictest17923-21kworker/0:207:37:290
283059943,0cyclictest23676-21awk07:07:290
283059941,0cyclictest0-21swapper/007:52:270
259940,0migration/27759-21kthreadcore08:07:342
259940,0migration/26042-21irqrtprio07:42:332
259940,0migration/2523-21munin-node10:32:292
259940,0migration/218872-21kthreadcore07:02:352
259940,0migration/217236-21aten_r1power_fr07:27:272
259940,0migration/215168-21kthreadcore08:12:332
259940,0migration/213061-21kthreadcore09:57:322
259940,0migration/211106-21kthreadcore10:57:352
249940,0watchdog/230042-21tr07:57:342
249940,0watchdog/223971-21aten_r1power_po07:32:262
249940,0watchdog/22155-21kthreadcore07:12:342
249940,0watchdog/21426-21kthreadcore11:32:332
249940,0watchdog/20-21swapper/207:37:342
179940,0migration/16142-21munin-node07:42:341
179940,0migration/15586-21kthreadcore06:52:331
179940,0migration/130239-21latency_hist11:32:161
179940,0migration/127678-21kthreadcore07:57:341
179940,0migration/123139-21gltestperf11:27:291
179940,0migration/116940-21irqrtprio10:42:321
179940,0migration/116897-21turbostat.cron07:27:111
179940,0migration/115675-21taskset06:59:061
179940,0migration/113397-21kthreadcore07:47:331
169940,0watchdog/16559-21runrttasks11:57:211
169940,0watchdog/1583-21if_eth110:32:301
169940,0watchdog/130910-21ssh11:12:171
169940,0watchdog/126662-21diskmemload11:21:091
169940,0watchdog/124941-21perl10:27:301
169940,0watchdog/119537-21if_eth009:02:301
169940,0watchdog/117713-21ssh10:02:301
169940,0watchdog/112327-21kthreadcore09:37:341
169940,0watchdog/111499-21kthreadcore10:17:341
169940,0watchdog/11133-21ssh09:09:341
169940,0watchdog/10-21swapper/111:07:331
169940,0watchdog/10-21swapper/109:52:381
339930,0migration/318660-21runrttasks08:13:473
29715030,0irq/26-eth0-rx-0-21swapper/308:22:273
29715030,0irq/26-eth0-rx-0-21swapper/307:47:283
29715030,0irq/26-eth0-rx-0-21swapper/307:27:273
29715030,0irq/26-eth0-rx-0-21swapper/307:03:103
29715030,0irq/26-eth0-rx-0-21swapper/306:57:493
283089932,0cyclictest3556-21lldpd08:43:202
283089932,0cyclictest3556-21lldpd08:27:202
283089932,0cyclictest19424-21sed07:52:322
283079933,0cyclictest13435-21awk08:12:311
283079932,0cyclictest31565-21aten_r1power_en08:02:261
283079932,0cyclictest30408-21awk07:12:321
283079932,0cyclictest26787-21awk08:22:301
283079932,0cyclictest24638-21sadc07:57:161
283079932,0cyclictest23934-21rm10:47:271
283079932,0cyclictest13039-21grep08:57:321
249930,0watchdog/20-21swapper/207:22:342
179930,0migration/129035-21runrttasks07:09:411
169930,0watchdog/126662-21diskmemload09:42:341
169930,0watchdog/123972-21aten_r1power_po07:32:261
169930,0watchdog/10-21swapper/108:17:341
169930,0watchdog/10-21swapper/107:02:341
29715020,0irq/26-eth0-rx-0-21swapper/307:37:203
29715020,0irq/26-eth0-rx-0-21swapper/307:32:183
283089920,0cyclictest2732-21cut06:52:162
283079921,0cyclictest0-21swapper/108:32:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional