You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 15:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Apr 06, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
550227473,0sleep00-21swapper/006:55:020
550227473,0sleep00-21swapper/006:55:020
582924434,0sleep30-21swapper/306:58:493
582924434,0sleep30-21swapper/306:58:493
559623423,0sleep20-21swapper/206:56:082
559623423,0sleep20-21swapper/206:56:082
547823329,0sleep10-21swapper/106:54:431
547823329,0sleep10-21swapper/106:54:431
59429966,0cyclictest0-21swapper/211:21:112
59429965,0cyclictest3780-21ssh12:22:302
59409963,0cyclictest22372-21munin-run10:34:140
4160,0ktimersoftd/00-21swapper/010:52:050
339960,0migration/35861-21sh10:22:493
339960,0migration/327550-21sh09:30:573
339960,0migration/327398-21sh12:15:173
339960,0migration/320543-21sh11:10:393
339960,0migration/314321-21sh10:07:583
29715060,0irq/26-eth0-rx-24543-21kthreadcore11:14:313
29715060,0irq/26-eth0-rx-21686-21munin-node11:34:363
29715060,0irq/26-eth0-rx-10589-21netstat12:04:343
149960,0migration/020788-21sh11:32:270
149960,0migration/013088-21sh12:09:250
149960,0migration/011868-21munin-node10:44:340
8215050,0irq/24-0000:00:24699-21cat10:34:342
59429955,0cyclictest0-21swapper/212:10:502
59429955,0cyclictest0-21swapper/211:50:212
59429955,0cyclictest0-21swapper/211:12:402
59429955,0cyclictest0-21swapper/210:27:532
59429955,0cyclictest0-21swapper/209:58:242
59429955,0cyclictest0-21swapper/209:19:472
59429950,0cyclictest0-21swapper/209:06:232
59419955,0cyclictest0-21swapper/111:56:441
59419955,0cyclictest0-21swapper/109:24:261
59419955,0cyclictest0-21swapper/106:59:331
59419950,0cyclictest0-21swapper/109:14:301
339950,0migration/37993-21kernelversion10:24:313
339950,0migration/34855-21aten_r1power_fr09:19:253
339950,0migration/33652-21latency10:39:323
339950,0migration/332222-21kthreadcore11:39:303
339950,0migration/331865-21kthreadcore08:29:323
339950,0migration/328284-21unixbench-2d08:24:363
339950,0migration/326053-21munin-node09:09:323
339950,0migration/32562-21munin-node07:44:303
339950,0migration/325308-21kthreadcore10:34:343
339950,0migration/32354-21latency_hist08:09:143
339950,0migration/320979-21munin-node09:49:283
339950,0migration/320647-21munin-node10:09:343
339950,0migration/319715-21munin-node10:49:323
339950,0migration/319407-21taskset09:46:243
339950,0migration/318959-21kthreadcore07:54:333
339950,0migration/318481-21kthreadcore11:49:313
339950,0migration/31633-21kthreadcore09:14:333
339950,0migration/315790-21kthreadcore12:09:313
339950,0migration/31431-21kthreadcore12:19:303
29725050,0irq/27-eth0-tx-4155-21diskmemload11:46:432
29725050,0irq/27-eth0-tx-381-21munin-node07:19:320
29725050,0irq/27-eth0-tx-22411-21munin-node08:24:320
29725050,0irq/27-eth0-tx-21969-21iostat_ios09:29:282
29725050,0irq/27-eth0-tx-21504-21munin-node07:59:260
29725050,0irq/27-eth0-tx-20452-21python10:29:372
29725050,0irq/27-eth0-tx-0-21swapper/210:48:482
29725050,0irq/27-eth0-tx-0-21swapper/209:17:542
29715050,0irq/26-eth0-rx-6157-21cpu11:04:263
29715050,0irq/26-eth0-rx-30021-21munin-node11:19:363
29715050,0irq/26-eth0-rx-29251-21cpuspeed_turbos09:34:273
29715050,0irq/26-eth0-rx-22562-21irqcore07:59:303
29715050,0irq/26-eth0-rx-22053-21load08:44:343
29715050,0irq/26-eth0-rx-1796-21kthreadcore10:59:333
29715050,0irq/26-eth0-rx-10777-21vmstat09:39:393
29715050,0irq/26-eth0-rx-0-21swapper/312:25:153
29715050,0irq/26-eth0-rx-0-21swapper/312:04:013
29715050,0irq/26-eth0-rx-0-21swapper/311:54:183
29715050,0irq/26-eth0-rx-0-21swapper/311:46:033
29715050,0irq/26-eth0-rx-0-21swapper/310:44:313
29715050,0irq/26-eth0-rx-0-21swapper/310:18:443
29715050,0irq/26-eth0-rx-0-21swapper/309:59:313
29715050,0irq/26-eth0-rx-0-21swapper/309:04:433
29715050,0irq/26-eth0-rx-0-21swapper/309:02:173
29715050,0irq/26-eth0-rx-0-21swapper/307:49:383
27150,0ktimersoftd/20-21swapper/211:17:332
259950,0migration/25789-21munin-node07:19:322
19150,0ktimersoftd/14155-21diskmemload10:22:181
179950,0migration/14445-21taskset12:03:211
179950,0migration/128762-21sendmail_mailst10:14:351
179950,0migration/127853-21kthreadcore07:14:311
179950,0migration/123693-21kthreadcore12:14:311
179950,0migration/12337-21munin-node09:54:381
179950,0migration/115539-21munin-node08:39:331
179950,0migration/115371-21kthreadcore09:44:321
169950,0watchdog/124542-21kthreadcore09:49:331
149950,0migration/08662-21kthreadcore10:24:310
149950,0migration/08157-21kthreadcore12:24:320
149950,0migration/04206-21sh10:59:540
149950,0migration/032643-21kthreadcore10:39:310
149950,0migration/032157-21kthreadcore12:19:300
149950,0migration/031757-21kthreadcore11:19:310
149950,0migration/031155-21kthreadcore08:29:310
149950,0migration/028416-21latency_hist09:54:140
149950,0migration/028100-21kthreadcore07:14:320
149950,0migration/028097-21taskset09:12:520
149950,0migration/021784-21taskset08:19:450
149950,0migration/020673-21sh11:11:030
149950,0migration/018787-21runrttasks09:04:580
149950,0migration/018743-21unixbench_singl09:44:380
149950,0migration/01856-21fschecks_count07:44:270
149950,0migration/014800-21kthreadcore09:24:310
149950,0migration/012030-21latency_hist10:04:140
149950,0migration/010353-21kthreadcore11:24:310
59429943,0cyclictest7069-21awk06:59:292
59429943,0cyclictest3556-21lldpd12:24:482
59429943,0cyclictest3556-21lldpd12:14:172
59429943,0cyclictest3556-21lldpd11:24:172
59429943,0cyclictest3556-21lldpd10:59:172
59429943,0cyclictest3556-21lldpd10:14:462
59429943,0cyclictest3556-21lldpd10:10:462
59429943,0cyclictest3556-21lldpd09:44:172
59429943,0cyclictest3556-21lldpd07:59:472
59429943,0cyclictest3556-21lldpd07:35:472
59429943,0cyclictest3556-21lldpd07:11:162
59429943,0cyclictest3514-21snmpd08:19:432
59429943,0cyclictest3241-21irqbalance10:49:232
59429943,0cyclictest3241-21irqbalance08:54:232
59429943,0cyclictest3241-21irqbalance08:45:232
59429943,0cyclictest3241-21irqbalance08:39:232
59429943,0cyclictest3241-21irqbalance08:29:232
59429943,0cyclictest3241-21irqbalance08:24:232
59429943,0cyclictest3241-21irqbalance08:14:332
59429943,0cyclictest3241-21irqbalance08:12:232
59429943,0cyclictest30388-21awk11:59:292
59429943,0cyclictest22309-21awk11:54:292
59429943,0cyclictest13681-21awk07:04:292
59429943,0cyclictest13137-21awk10:04:302
59419944,0cyclictest0-21swapper/109:59:261
59419944,0cyclictest0-21swapper/109:38:001
59419944,0cyclictest0-21swapper/109:07:441
59419943,0cyclictest9140-21awk07:49:301
59419943,0cyclictest8032-21awk07:24:291
59419943,0cyclictest6587-21awk11:24:281
59419943,0cyclictest4273-21awk08:34:301
59419943,0cyclictest3556-21lldpd10:40:161
59419943,0cyclictest3556-21lldpd10:31:161
59419943,0cyclictest3556-21lldpd09:30:461
59419943,0cyclictest3556-21lldpd08:09:171
59419943,0cyclictest3556-21lldpd07:57:171
59419943,0cyclictest3556-21lldpd07:40:471
59419943,0cyclictest3556-21lldpd07:09:461
59419943,0cyclictest3514-21snmpd12:20:131
59419943,0cyclictest3514-21snmpd11:17:281
59419943,0cyclictest30909-21awk11:19:291
59419940,0cyclictest0-21swapper/110:10:281
59409944,0cyclictest9959-21kworker/0:111:54:270
59409944,0cyclictest0-21swapper/011:08:490
59409944,0cyclictest0-21swapper/009:34:520
59409943,0cyclictest8077-21awk07:24:300
59409943,0cyclictest3556-21lldpd11:40:470
59409943,0cyclictest3556-21lldpd11:34:170
59409943,0cyclictest3556-21lldpd10:23:160
59409943,0cyclictest3556-21lldpd08:34:470
59409943,0cyclictest3514-21snmpd09:23:130
59409943,0cyclictest3514-21snmpd07:31:120
59409943,0cyclictest30338-21awk11:59:290
59409943,0cyclictest29918-21awk09:14:310
59409943,0cyclictest23239-21awk10:54:290
59409943,0cyclictest15550-21sadc08:19:140
59409940,0cyclictest19892-40yum-updatesd-he08:44:340
339940,0migration/3846-21kthreadcore08:04:323
339940,0migration/326439-21kthreadcore08:49:303
339940,0migration/325569-21kthreadcore10:54:313
339940,0migration/316564-21kthreadcore09:24:313
29725040,0irq/27-eth0-tx-5284-21munin-node09:59:302
29725040,0irq/27-eth0-tx-4396-21munin-node08:59:240
29725040,0irq/27-eth0-tx-31014-21munin-node10:19:302
29725040,0irq/27-eth0-tx-22175-21fschecks_count11:34:272
29725040,0irq/27-eth0-tx-12934-21ssh09:24:192
29725040,0irq/27-eth0-tx-10619-21ssh08:59:492
29725040,0irq/27-eth0-tx-0-21swapper/211:30:092
29725040,0irq/27-eth0-tx-0-21swapper/210:54:172
29725040,0irq/27-eth0-tx-0-21swapper/209:39:342
29725040,0irq/27-eth0-tx-0-21swapper/209:34:242
29725040,0irq/27-eth0-tx-0-21swapper/007:49:330
29725040,0irq/27-eth0-tx-0-21swapper/006:59:310
29715040,0irq/26-eth0-rx-0-21swapper/311:29:303
29715040,0irq/26-eth0-rx-0-21swapper/311:24:303
29715040,0irq/26-eth0-rx-0-21swapper/310:31:233
29715040,0irq/26-eth0-rx-0-21swapper/309:55:053
29715040,0irq/26-eth0-rx-0-21swapper/308:19:293
29715040,0irq/26-eth0-rx-0-21swapper/307:29:323
29715040,0irq/26-eth0-rx-0-21swapper/307:24:273
259940,0migration/27499-21kthreadcore12:04:322
259940,0migration/26740-21kthreadcore08:34:322
259940,0migration/26731-21gltestperf11:04:272
259940,0migration/25340-21kthreadcore07:44:312
259940,0migration/231208-21fschecks_time10:39:282
259940,0migration/228644-21kthreadcore08:49:312
259940,0migration/22400-21kthreadcore11:39:302
259940,0migration/218492-21kthreadcore07:29:322
259940,0migration/217842-21kthreadcore07:54:322
249940,0watchdog/224544-21kthreadcore09:49:332
249940,0watchdog/20-21swapper/209:09:292
249940,0watchdog/20-21swapper/207:24:372
179940,0migration/18677-21kthreadcore08:59:301
179940,0migration/17347-21kthreadcore09:19:311
179940,0migration/127653-21kthreadcore08:49:311
179940,0migration/127642-21runrttasks09:11:391
179940,0migration/126776-21taskset07:37:591
179940,0migration/124844-21kthreadcore08:24:301
179940,0migration/123643-21munin-node10:34:331
179940,0migration/122797-21kernelversion07:59:301
179940,0migration/119891-21ksmtuned07:30:131
179940,0migration/119832-21kthreadcore08:19:311
179940,0migration/118392-21kthreadcore11:09:311
179940,0migration/116398-21kthreadcore11:49:311
179940,0migration/110600-21kthreadcore10:24:321
169940,0watchdog/18874-21kthreadcore12:24:321
169940,0watchdog/17840-21tr11:44:321
169940,0watchdog/130640-21ssh11:39:281
169940,0watchdog/128928-21ssh10:56:041
169940,0watchdog/126967-21cat11:34:321
169940,0watchdog/120972-21kthreadcore08:44:331
169940,0watchdog/120766-21ssh10:50:281
169940,0watchdog/119756-21ssh12:11:121
169940,0watchdog/10-21swapper/112:04:281
169940,0watchdog/10-21swapper/111:29:241
149940,0migration/06570-21kthreadcore09:39:310
149940,0migration/04665-21kthreadcore08:09:310
149940,0migration/030445-21kthreadcore09:54:310
149940,0migration/030355-21kthreadcore07:39:320
149940,0migration/027887-21switchtime11:14:370
149940,0migration/026308-21kthreadcore10:14:320
149940,0migration/022783-21kthreadcore07:09:310
149940,0migration/021826-21runrttasks10:11:290
149940,0migration/013038-21sh11:49:020
59429932,0cyclictest3556-21lldpd07:39:472
59429932,0cyclictest3556-21lldpd07:14:172
59429932,0cyclictest28887-21grep08:04:282
59419933,0cyclictest3556-21lldpd07:05:461
59419932,0cyclictest3556-21lldpd10:44:171
59419932,0cyclictest3556-21lldpd09:40:471
59419932,0cyclictest3514-21snmpd07:22:121
59419932,0cyclictest29020-21awk08:04:291
59419932,0cyclictest2330-21awk07:44:291
59419932,0cyclictest11193-21kthreadcore11:04:311
59409933,0cyclictest9959-21kworker/0:109:29:260
59409933,0cyclictest9959-21kworker/0:107:34:320
59409933,0cyclictest3556-21lldpd10:05:460
59409932,0cyclictest28153-21munin-node08:04:350
59409932,0cyclictest27716-21sh12:16:140
59409932,0cyclictest25517-21grep10:34:340
59409932,0cyclictest16549-21kthreadcore11:49:310
59409931,0cyclictest2459-21kthreadcore08:54:330
59409930,0cyclictest0-21swapper/008:49:270
339930,0migration/3366-21runrttasks07:19:173
29725030,0irq/27-eth0-tx-0-21swapper/008:39:270
29725030,0irq/27-eth0-tx-0-21swapper/007:04:250
29715030,0irq/26-eth0-rx-0-21swapper/308:41:153
29715030,0irq/26-eth0-rx-0-21swapper/308:34:243
29715030,0irq/26-eth0-rx-0-21swapper/308:14:263
29715030,0irq/26-eth0-rx-0-21swapper/307:09:273
29715030,0irq/26-eth0-rx-0-21swapper/307:04:263
259930,0migration/211598-21kthreadcore07:49:322
179930,0migration/11328-21kthreadcore08:54:331
169930,0watchdog/10-21swapper/110:59:161
169930,0watchdog/10-21swapper/110:05:051
169930,0watchdog/10-21swapper/108:29:291
149930,0migration/020980-21runrttasks07:56:000
59409921,0cyclictest4906-21latency_hist12:04:140
339920,0migration/326572-21diskstats07:14:283
29715020,0irq/26-eth0-rx-0-21swapper/308:55:273
29715020,0irq/26-eth0-rx-0-21swapper/307:39:253
29715020,0irq/26-eth0-rx-0-21swapper/307:35:003
29715020,0irq/26-eth0-rx-0-21swapper/306:59:313
169920,0watchdog/10-21swapper/108:14:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional