You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 21:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Apr 15, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
268224940,0sleep20-21swapper/206:55:142
272823829,0sleep30-21swapper/306:55:473
256823624,0sleep00-21swapper/006:53:560
267023425,0sleep10-21swapper/106:55:051
339960,0migration/38008-21sh08:59:483
339960,0migration/37694-21sh11:01:133
339960,0migration/37385-21sh11:21:103
339960,0migration/332633-21sh09:14:563
339960,0migration/331180-21sh11:14:423
339960,0migration/324565-21sh10:32:043
339960,0migration/324348-21sh09:28:503
339960,0migration/322510-21sh12:09:573
339960,0migration/317014-21sh10:07:343
339960,0migration/315873-21sh11:06:443
339960,0migration/315749-21kthreadcore07:53:413
339960,0migration/315700-21sh11:47:433
339960,0migration/315475-21sh12:07:533
30339966,0cyclictest0-21swapper/210:16:182
30309960,0cyclictest0-21swapper/009:58:230
29715060,0irq/26-eth0-rx-26266-21diskstats09:53:353
29715060,0irq/26-eth0-rx-24789-21munin-run10:53:233
8215050,0irq/24-0000:00:10750-21latency_hist07:28:242
4150,0ktimersoftd/00-21swapper/011:45:080
339950,0migration/38362-21runrttasks09:39:403
339950,0migration/36239-21kthreadcore07:23:403
339950,0migration/34874-21missed_timers08:08:423
339950,0migration/34692-21kthreadcore10:38:403
339950,0migration/3420-21aten2.4-expect08:33:343
339950,0migration/328878-21kthreadcore10:53:403
339950,0migration/328248-21kthreadcore12:13:413
339950,0migration/326415-21munin-node08:03:403
339950,0migration/325573-21munin-node07:38:403
339950,0migration/324877-21diskmemload10:12:073
339950,0migration/322902-21ksmtuned07:11:473
339950,0migration/321550-21kthreadcore08:23:393
339950,0migration/319439-21proc_pri08:43:453
339950,0migration/318557-21latency_hist07:58:243
339950,0migration/317443-21munin-node11:08:363
339950,0migration/315265-21munin-node07:03:413
339950,0migration/314976-21kthreadcore09:43:413
339950,0migration/314621-21kthreadcore07:28:413
339950,0migration/314621-21kthreadcore07:28:413
339950,0migration/31190-21aten_r1power_en10:18:343
339950,0migration/311615-21taskset07:51:553
30339955,0cyclictest0-21swapper/211:05:292
30339950,0cyclictest0-21swapper/210:02:262
30319950,0cyclictest23385-21ssh12:12:301
30319950,0cyclictest0-21swapper/110:02:451
30319950,0cyclictest0-21swapper/109:40:031
30309955,0cyclictest0-21swapper/011:18:380
30309955,0cyclictest0-21swapper/009:28:260
30309955,0cyclictest0-21swapper/009:09:400
30309950,0cyclictest0-21swapper/011:49:230
30309950,0cyclictest0-21swapper/010:56:150
30309950,0cyclictest0-21swapper/009:45:180
30309950,0cyclictest0-21swapper/009:33:480
29725050,0irq/27-eth0-tx-5338-21needreboot11:58:402
29725050,0irq/27-eth0-tx-5098-21cut11:38:402
29725050,0irq/27-eth0-tx-25858-21munin-node09:53:452
29725050,0irq/27-eth0-tx-1764-21munin-node09:38:462
29725050,0irq/27-eth0-tx-0-21swapper/210:09:132
29725050,0irq/27-eth0-tx-0-21swapper/210:03:332
29725050,0irq/27-eth0-tx-0-21swapper/209:33:482
29725050,0irq/27-eth0-tx-0-21swapper/008:28:470
29715050,0irq/26-eth0-rx-6559-21runrttasks07:33:453
29715050,0irq/26-eth0-rx-27979-21tr11:33:393
29715050,0irq/26-eth0-rx-25702-21df_abs10:33:373
29715050,0irq/26-eth0-rx-12877-21python08:38:443
29715050,0irq/26-eth0-rx-1036-21interrupts11:38:383
29715050,0irq/26-eth0-rx-0-21swapper/311:28:373
29715050,0irq/26-eth0-rx-0-21swapper/311:23:433
29715050,0irq/26-eth0-rx-0-21swapper/310:43:253
29715050,0irq/26-eth0-rx-0-21swapper/310:26:033
29715050,0irq/26-eth0-rx-0-21swapper/309:58:563
29715050,0irq/26-eth0-rx-0-21swapper/309:50:053
29715050,0irq/26-eth0-rx-0-21swapper/309:25:273
29715050,0irq/26-eth0-rx-0-21swapper/309:03:353
27150,0ktimersoftd/20-21swapper/209:49:012
259950,0migration/24808-21kthreadcore09:18:402
259950,0migration/23765-21kthreadcore11:18:402
259950,0migration/231956-21sh10:56:072
259950,0migration/230082-21timerandwakeup07:38:462
259950,0migration/229061-21kthreadcore08:53:402
259950,0migration/228814-21kthreadcore11:13:402
259950,0migration/218824-21kthreadcore10:48:412
259950,0migration/218757-21timerwakeupswit08:18:472
259950,0migration/216718-21sh09:25:012
259950,0migration/216341-21latency_hist11:28:232
259950,0migration/216335-21taskset10:47:122
259950,0migration/216176-21sh09:44:152
259950,0migration/215519-21sh11:26:372
259950,0migration/211221-21cpuspeed_turbos07:28:362
259950,0migration/211221-21cpuspeed_turbos07:28:362
249950,0watchdog/29741-21fschecks_count10:23:382
249950,0watchdog/231155-21ssh11:35:292
249950,0watchdog/222590-21grep07:08:462
19150,0ktimersoftd/10-21swapper/111:36:181
179950,0migration/17991-21cpuspeed_turbos12:23:351
179950,0migration/117038-21aten_r1power_cu10:48:351
179950,0migration/11624-21kernelversion11:18:391
179950,0migration/114594-21taskset12:05:201
149950,0migration/08776-21sh09:40:520
149950,0migration/08573-21sh09:01:240
149950,0migration/032524-21sh09:14:410
149950,0migration/024587-21taskset10:52:510
149950,0migration/020209-21kthreadcore12:08:400
149950,0migration/013356-21kthreadcore09:03:410
149950,0migration/010143-21sh09:23:320
339940,0migration/39699-21kthreadcore12:23:393
339940,0migration/318232-21kthreadcore11:48:393
30339944,0cyclictest0-21swapper/211:48:322
30339943,0cyclictest8047-21awk08:38:372
30339943,0cyclictest4172-21awk06:58:392
30339943,0cyclictest3556-21lldpd11:43:312
30339943,0cyclictest3514-21snmpd12:18:352
30339943,0cyclictest27167-21awk08:28:402
30339943,0cyclictest20464-21awk08:23:372
30339943,0cyclictest16807-21awk12:08:382
30319943,0cyclictest3556-21lldpd11:16:011
30319943,0cyclictest3556-21lldpd09:30:001
30319943,0cyclictest3556-21lldpd09:06:001
30319943,0cyclictest3556-21lldpd08:58:301
30319943,0cyclictest3556-21lldpd08:13:311
30319943,0cyclictest31147-21tail08:03:471
30319943,0cyclictest26476-21awk10:13:381
30319943,0cyclictest26302-21awk10:33:401
30319943,0cyclictest18462-21awk10:08:361
30319943,0cyclictest17511-21awk07:08:381
30319943,0cyclictest13816-21awk08:18:391
30319943,0cyclictest1213-21sadc08:58:231
30319943,0cyclictest11865-21awk07:28:391
30319943,0cyclictest11865-21awk07:28:391
30319943,0cyclictest10525-21awk10:03:371
30319940,0cyclictest0-21swapper/110:44:221
30309943,0cyclictest3556-21lldpd11:08:310
30309943,0cyclictest3514-21snmpd10:19:200
30309943,0cyclictest3241-21irqbalance12:18:510
30309943,0cyclictest3241-21irqbalance11:38:320
30309943,0cyclictest3241-21irqbalance08:54:220
30309943,0cyclictest3241-21irqbalance08:48:420
30309943,0cyclictest3241-21irqbalance08:41:520
30309943,0cyclictest3241-21irqbalance07:23:330
30309943,0cyclictest3241-21irqbalance07:18:330
30309943,0cyclictest3241-21irqbalance06:58:330
30309943,0cyclictest31890-21awk07:43:400
30309943,0cyclictest18157-21awk10:28:380
30309943,0cyclictest16737-21sadc10:48:230
30309943,0cyclictest1429-21awk08:33:380
30309943,0cyclictest13841-21awk08:18:390
30309943,0cyclictest12814-21awk07:53:390
30309943,0cyclictest11889-21awk07:28:390
30309943,0cyclictest11889-21awk07:28:390
29725040,0irq/27-eth0-tx-9998-21sshd07:03:340
29725040,0irq/27-eth0-tx-7930-21ssh08:59:352
29725040,0irq/27-eth0-tx-18615-21smartctl09:08:362
29725040,0irq/27-eth0-tx-1764-21irqcore10:58:392
29725040,0irq/27-eth0-tx-1220-21diskmemload09:03:282
29725040,0irq/27-eth0-tx-0-21swapper/212:23:342
29725040,0irq/27-eth0-tx-0-21swapper/212:13:292
29725040,0irq/27-eth0-tx-0-21swapper/212:03:322
29725040,0irq/27-eth0-tx-0-21swapper/211:53:332
29725040,0irq/27-eth0-tx-0-21swapper/211:08:302
29725040,0irq/27-eth0-tx-0-21swapper/210:39:282
29725040,0irq/27-eth0-tx-0-21swapper/210:33:252
29725040,0irq/27-eth0-tx-0-21swapper/210:28:582
29725040,0irq/27-eth0-tx-0-21swapper/210:18:352
29725040,0irq/27-eth0-tx-0-21swapper/209:13:382
29725040,0irq/27-eth0-tx-0-21swapper/008:43:420
29715040,0irq/26-eth0-rx-0-21swapper/312:19:353
29715040,0irq/26-eth0-rx-0-21swapper/311:59:593
29715040,0irq/26-eth0-rx-0-21swapper/311:55:173
29715040,0irq/26-eth0-rx-0-21swapper/310:14:323
29715040,0irq/26-eth0-rx-0-21swapper/309:33:403
29715040,0irq/26-eth0-rx-0-21swapper/309:19:403
29715040,0irq/26-eth0-rx-0-21swapper/309:09:173
29715040,0irq/26-eth0-rx-0-21swapper/307:43:433
259940,0migration/26905-21kthreadcore07:48:412
259940,0migration/23817-21runrttasks07:20:412
259940,0migration/229143-21munin-node07:13:462
259940,0migration/222059-21kthreadcore07:58:402
259940,0migration/218135-21runrttasks09:28:312
259940,0migration/214964-21kthreadcore07:53:412
249940,0watchdog/211520-21cat08:13:422
249940,0watchdog/20-21swapper/208:08:462
179940,0migration/19747-21runrttasks09:23:061
179940,0migration/132572-21sh09:34:361
179940,0migration/132497-21kthreadcore07:43:421
179940,0migration/129714-21idleruntime-cro07:18:241
179940,0migration/125627-21fschecks_time10:53:361
179940,0migration/125161-21latency_hist08:03:241
179940,0migration/123039-21munin-node10:28:451
179940,0migration/122573-21runrttasks11:49:201
179940,0migration/118721-21kthreadcore11:08:391
179940,0migration/118444-21idleruntime07:33:391
179940,0migration/118349-21fschecks_count09:08:351
179940,0migration/11757-21kthreadcore08:33:401
179940,0migration/116229-21sh11:07:461
179940,0migration/115412-21sh11:46:501
179940,0migration/113355-21kthreadcore09:23:401
179940,0migration/11333-21kthreadcore08:08:401
179940,0migration/111387-21run-parts07:49:241
179940,0migration/111207-21kthreadcore11:23:401
179940,0migration/110128-21timerandwakeup07:23:461
169940,0watchdog/18275-21ssh10:21:181
169940,0watchdog/132508-21ssh09:14:381
169940,0watchdog/124888-21fschecks_time11:53:371
169940,0watchdog/10-21swapper/111:38:371
169940,0watchdog/10-21swapper/110:23:381
149940,0migration/07526-21munin-node09:18:430
149940,0migration/031658-21runrttasks11:16:040
149940,0migration/030533-21taskset11:54:180
149940,0migration/028410-21kthreadcore11:33:390
149940,0migration/026455-21irqcore10:33:410
149940,0migration/025491-21kthreadcore07:13:400
149940,0migration/024931-21diskmemload12:13:390
149940,0migration/023812-21taskset10:09:020
149940,0migration/019046-21kthreadcore07:08:400
149940,0migration/018787-21kthreadcore11:28:410
149940,0migration/011645-21munin-node08:13:430
30339932,0cyclictest850-21grep08:33:362
30339932,0cyclictest3556-21lldpd08:45:012
30339932,0cyclictest12842-21kthreadcore07:03:402
30339930,0cyclictest26444-21irqrtprio08:03:402
30319933,0cyclictest3556-21lldpd08:38:311
30319932,0cyclictest5455-21sensors12:18:431
30319932,0cyclictest3556-21lldpd06:58:281
30319932,0cyclictest31863-21sensors08:28:461
30319932,0cyclictest30784-21awk07:18:371
30319932,0cyclictest13900-21aten_r1power_en08:43:351
30319930,0cyclictest13247-21irqstats07:53:401
30309933,0cyclictest0-21swapper/011:24:380
30309932,0cyclictest9606-21awk11:03:360
30309932,0cyclictest8446-21crond11:03:230
30309932,0cyclictest402-21munin-node11:58:350
30309932,0cyclictest3514-21snmpd07:43:200
30309932,0cyclictest3241-21irqbalance07:33:320
30309932,0cyclictest32188-21tr08:08:360
30309932,0cyclictest27771-21grep08:03:410
30309932,0cyclictest2314-21awk09:58:380
30309932,0cyclictest19560-21awk07:58:390
30309932,0cyclictest17778-21latency_hist09:48:230
30309932,0cyclictest1775-21awk10:38:370
30309932,0cyclictest10209-21awk10:23:400
30309930,0cyclictest9951-21diskstats10:03:350
30309930,0cyclictest5274-21munin-node07:48:410
30309930,0cyclictest26238-21perl10:13:360
30309930,0cyclictest0-21swapper/012:03:390
30309930,0cyclictest0-21swapper/008:23:400
29715030,0irq/26-eth0-rx-0-21swapper/308:53:363
29715030,0irq/26-eth0-rx-0-21swapper/308:52:193
29715030,0irq/26-eth0-rx-0-21swapper/308:29:463
29715030,0irq/26-eth0-rx-0-21swapper/308:13:493
29715030,0irq/26-eth0-rx-0-21swapper/307:18:343
29715030,0irq/26-eth0-rx-0-21swapper/306:58:453
249930,0watchdog/223319-21smartctl07:33:462
249930,0watchdog/20-21swapper/207:43:422
179930,0migration/113908-21kthreadcore09:43:411
169930,0watchdog/120541-21munin-node08:48:421
169930,0watchdog/11220-21diskmemload12:13:411
169930,0watchdog/11220-21diskmemload11:58:371
169930,0watchdog/10-21swapper/111:28:371
169930,0watchdog/10-21swapper/110:58:251
169930,0watchdog/10-21swapper/110:40:301
169930,0watchdog/10-21swapper/109:53:341
169930,0watchdog/10-21swapper/109:48:341
169930,0watchdog/10-21swapper/108:23:461
149930,0migration/013942-21sh12:24:030
29715020,0irq/26-eth0-rx-0-21swapper/308:18:353
29715020,0irq/26-eth0-rx-0-21swapper/307:13:343
249920,0watchdog/20-21swapper/208:48:262
169920,0watchdog/10-21swapper/107:38:261
169920,0watchdog/10-21swapper/107:03:261
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional