You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 17:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Sep 20, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319523523,0sleep00-21swapper/006:39:160
304450350,0irq/25-eth10-21swapper/306:39:123
288323320,0sleep20-21swapper/206:38:502
330723122,0sleep10-21swapper/106:40:291
29715070,0irq/26-eth0-rx-24874-21sed07:43:453
149970,0migration/07223-21ntp_offset09:23:400
4160,0ktimersoftd/00-21swapper/009:28:220
36549961,0cyclictest778-21awk08:18:220
36549961,0cyclictest778-21awk08:18:220
339960,0migration/39016-21sh09:05:553
339960,0migration/330118-21sh11:21:533
339960,0migration/31932-21df_abs09:23:333
339960,0migration/319001-21pmu-power08:03:453
339960,0migration/317359-21munin-node10:33:383
339960,0migration/315117-21sh10:31:203
339960,0migration/313181-21sh11:30:143
29715060,0irq/26-eth0-rx-17707-21fschecks_time09:53:353
149960,0migration/07780-21sh10:28:090
149960,0migration/022441-21latency09:53:390
149960,0migration/022439-21taskset11:17:380
149960,0migration/012644-21sh11:08:400
8215050,0irq/24-0000:00:9340-21latency_hist09:28:212
8215050,0irq/24-0000:00:24246-21latency_hist10:18:212
36559955,0cyclictest0-21swapper/110:20:101
36559955,0cyclictest0-21swapper/108:59:361
36559950,0cyclictest0-21swapper/111:55:141
36559950,0cyclictest0-21swapper/111:45:371
36559950,0cyclictest0-21swapper/111:34:531
36549950,0cyclictest0-21swapper/011:28:370
36549950,0cyclictest0-21swapper/009:10:210
339950,0migration/38614-21latency_hist10:08:213
339950,0migration/38054-21if_eth011:08:363
339950,0migration/35671-21kthreadcore06:43:393
339950,0migration/32926-21ntp_offset12:03:423
339950,0migration/328479-21gltestperf08:38:353
339950,0migration/327333-21munin-node11:58:403
339950,0migration/326887-21kthreadcore10:58:383
339950,0migration/324646-21diskmemload08:54:223
339950,0migration/324571-21taskset07:23:143
339950,0migration/324504-21fschecks_count10:38:353
339950,0migration/317208-21kthreadcore07:38:403
339950,0migration/31715-21kthreadcore10:23:383
339950,0migration/316973-21taskset09:10:503
339950,0migration/316798-21munin-node10:13:343
339950,0migration/316507-21kthreadcore11:13:383
339950,0migration/310711-21kthreadcore08:23:393
339950,0migration/310309-21kthreadcore07:58:403
29725050,0irq/27-eth0-tx-7958-21ssh09:45:382
29725050,0irq/27-eth0-tx-7540-21ssh10:05:482
29725050,0irq/27-eth0-tx-6497-21ssh10:24:172
29725050,0irq/27-eth0-tx-32455-21munin-node07:53:340
29725050,0irq/27-eth0-tx-30881-21munin-node11:23:382
29725050,0irq/27-eth0-tx-29744-21munin-node12:03:352
29725050,0irq/27-eth0-tx-26398-21munin-node08:58:402
29725050,0irq/27-eth0-tx-25414-21ssh09:17:192
29725050,0irq/27-eth0-tx-17283-21cpu09:53:332
29725050,0irq/27-eth0-tx-17127-21ssh08:51:072
29725050,0irq/27-eth0-tx-10404-21cut11:28:392
29725050,0irq/27-eth0-tx-0-21swapper/212:09:382
29725050,0irq/27-eth0-tx-0-21swapper/211:13:362
29725050,0irq/27-eth0-tx-0-21swapper/211:08:012
29725050,0irq/27-eth0-tx-0-21swapper/210:34:462
29725050,0irq/27-eth0-tx-0-21swapper/210:09:142
29725050,0irq/27-eth0-tx-0-21swapper/209:04:142
29725050,0irq/27-eth0-tx-0-21swapper/008:44:120
29725050,0irq/27-eth0-tx-0-21swapper/008:25:360
29715050,0irq/26-eth0-rx-6559-21runrttasks08:43:343
29715050,0irq/26-eth0-rx-5464-21grep08:18:393
29715050,0irq/26-eth0-rx-4896-21awk07:08:353
29715050,0irq/26-eth0-rx-32304-21basename07:28:373
29715050,0irq/26-eth0-rx-26807-21cut08:13:353
29715050,0irq/26-eth0-rx-26807-21cut08:13:353
29715050,0irq/26-eth0-rx-2556-21kthreadcore09:43:383
29715050,0irq/26-eth0-rx-10731-21irqcore09:28:373
29715050,0irq/26-eth0-rx-0-21swapper/311:53:333
29715050,0irq/26-eth0-rx-0-21swapper/310:19:343
29715050,0irq/26-eth0-rx-0-21swapper/309:58:393
29715050,0irq/26-eth0-rx-0-21swapper/309:50:383
29715050,0irq/26-eth0-rx-0-21swapper/309:34:173
29715050,0irq/26-eth0-rx-0-21swapper/308:48:363
259950,0migration/227505-21gltestperf08:13:372
259950,0migration/227505-21gltestperf08:13:372
259950,0migration/225303-21fschecks_count07:23:352
259950,0migration/223802-21munin-node08:53:402
259950,0migration/216193-21sendmail_mailqu06:48:432
259950,0migration/210252-21kthreadcore10:28:382
249950,0watchdog/226457-21diskstats09:18:362
249950,0watchdog/219871-21grep11:53:432
249950,0watchdog/210136-21munin-node09:08:362
249950,0watchdog/20-21swapper/210:40:352
179950,0migration/111924-21munin-node07:13:341
149950,0migration/08630-21kthreadcore06:43:400
149950,0migration/07122-21taskset08:18:480
149950,0migration/06177-21taskset11:06:200
149950,0migration/03625-21kthreadcore09:03:380
149950,0migration/031300-21taskset10:42:030
149950,0migration/030129-21taskset07:01:540
149950,0migration/029348-21taskset11:41:160
149950,0migration/025885-21kthreadcore11:18:380
149950,0migration/024548-21munin-node10:58:370
149950,0migration/022231-21fschecks_count11:58:350
149950,0migration/02218-21sh10:03:390
149950,0migration/021534-21munin-node10:33:400
149950,0migration/021163-21sh11:57:180
149950,0migration/019355-21kthreadcore06:53:390
149950,0migration/017645-21sh08:52:370
149950,0migration/014560-21kthreadcore07:13:380
149950,0migration/010523-21latency_hist06:48:220
149950,0migration/01017-21sh09:01:310
8215040,0irq/24-0000:00:0-21swapper/209:33:212
36569943,0cyclictest31352-21awk07:03:372
36569943,0cyclictest2890-21awk08:43:362
36569943,0cyclictest26375-21awk09:38:352
36569943,0cyclictest10018-21awk09:48:372
36559944,0cyclictest0-21swapper/111:21:581
36559944,0cyclictest0-21swapper/109:59:211
36559943,0cyclictest7799-21awk07:58:381
36559943,0cyclictest4805-21awk06:43:381
36559943,0cyclictest3556-21lldpd11:38:291
36559943,0cyclictest3556-21lldpd11:03:291
36559943,0cyclictest3556-21lldpd10:58:591
36559943,0cyclictest3556-21lldpd10:13:281
36559943,0cyclictest3556-21lldpd09:06:291
36559943,0cyclictest3556-21lldpd08:32:291
36559943,0cyclictest3556-21lldpd08:13:291
36559943,0cyclictest3556-21lldpd08:13:291
36559943,0cyclictest3556-21lldpd07:57:281
36559943,0cyclictest3556-21lldpd07:46:281
36559943,0cyclictest3556-21lldpd07:33:271
36559943,0cyclictest3556-21lldpd07:20:281
36559943,0cyclictest3556-21lldpd06:52:281
36559943,0cyclictest26707-21awk07:48:381
36559943,0cyclictest19107-21awk08:53:361
36559943,0cyclictest19057-21awk09:13:371
36559943,0cyclictest13574-21sadc11:53:211
36549944,0cyclictest0-21swapper/012:06:460
36549944,0cyclictest0-21swapper/010:28:520
36549944,0cyclictest0-21swapper/010:01:450
36549943,0cyclictest5762-21awk07:08:390
36549943,0cyclictest3556-21lldpd07:51:580
36549943,0cyclictest3514-21snmpd09:45:410
36549943,0cyclictest3514-21snmpd09:33:560
36549943,0cyclictest3514-21snmpd07:20:540
36549943,0cyclictest26391-21awk09:38:350
36549943,0cyclictest21955-21awk08:33:380
36549943,0cyclictest0-21swapper/009:13:400
339940,0migration/38448-21hddtemp_smartct10:48:343
339940,0migration/36578-21sh07:33:363
339940,0migration/332052-21taskset07:51:333
339940,0migration/316135-21kthreadcore07:13:393
339940,0migration/31606-21kthreadcore07:53:383
339940,0migration/314639-21aten_r1power_vo11:33:323
29725040,0irq/27-eth0-tx-5097-21missed_timers10:43:412
29725040,0irq/27-eth0-tx-12517-21munin-node07:38:370
29725040,0irq/27-eth0-tx-12015-40yum-updatesd-he07:35:210
29725040,0irq/27-eth0-tx-0-21swapper/211:58:222
29725040,0irq/27-eth0-tx-0-21swapper/211:48:392
29725040,0irq/27-eth0-tx-0-21swapper/211:43:402
29725040,0irq/27-eth0-tx-0-21swapper/211:18:312
29725040,0irq/27-eth0-tx-0-21swapper/210:58:492
29725040,0irq/27-eth0-tx-0-21swapper/210:53:282
29725040,0irq/27-eth0-tx-0-21swapper/210:18:212
29725040,0irq/27-eth0-tx-0-21swapper/209:23:392
29725040,0irq/27-eth0-tx-0-21swapper/008:08:450
29725040,0irq/27-eth0-tx-0-21swapper/007:58:400
29715040,0irq/26-eth0-rx-0-21swapper/312:08:353
29715040,0irq/26-eth0-rx-0-21swapper/311:48:463
29715040,0irq/26-eth0-rx-0-21swapper/311:43:233
29715040,0irq/26-eth0-rx-0-21swapper/311:40:493
29715040,0irq/26-eth0-rx-0-21swapper/311:23:373
29715040,0irq/26-eth0-rx-0-21swapper/311:03:313
29715040,0irq/26-eth0-rx-0-21swapper/310:53:223
29715040,0irq/26-eth0-rx-0-21swapper/310:44:503
29715040,0irq/26-eth0-rx-0-21swapper/310:03:363
29715040,0irq/26-eth0-rx-0-21swapper/309:43:063
29715040,0irq/26-eth0-rx-0-21swapper/309:22:363
29715040,0irq/26-eth0-rx-0-21swapper/309:13:393
29715040,0irq/26-eth0-rx-0-21swapper/308:58:323
29715040,0irq/26-eth0-rx-0-21swapper/308:37:473
29715040,0irq/26-eth0-rx-0-21swapper/306:52:163
259940,0migration/29935-21kthreadcore07:58:402
259940,0migration/28576-21kthreadcore06:43:402
259940,0migration/27626-21kthreadcore07:33:392
259940,0migration/27613-21fschecks_count11:08:342
259940,0migration/230025-21kthreadcore08:38:382
259940,0migration/22795-21kthreadcore08:18:382
259940,0migration/227833-21kthreadcore09:58:392
259940,0migration/227501-21kthreadcore06:58:402
259940,0migration/218727-21fschecks_count07:18:352
259940,0migration/216033-21kthreadcore11:33:382
259940,0migration/215420-21irqcore08:28:382
259940,0migration/214936-21kthreadcore07:38:392
249940,0watchdog/27792-21chrt10:48:312
249940,0watchdog/26695-21cat07:08:402
249940,0watchdog/23780-21kthreadcore07:28:402
249940,0watchdog/218009-21sed06:53:362
249940,0watchdog/20-21swapper/211:38:352
249940,0watchdog/20-21swapper/207:48:402
179940,0migration/19007-21sh08:46:151
179940,0migration/18825-21irqcore08:23:381
179940,0migration/17941-21ksmtuned09:24:101
179940,0migration/17505-21taskset08:23:131
179940,0migration/14009-21kthreadcore10:23:391
179940,0migration/13894-21kthreadcore09:43:381
179940,0migration/13661-21munin-node07:03:421
179940,0migration/128216-21kthreadcore06:58:401
179940,0migration/127959-21kthreadcore09:18:401
179940,0migration/120814-21python11:13:431
179940,0migration/117257-21aten_r1power_en06:53:331
179940,0migration/115899-21cpuspeed_turbos10:53:321
179940,0migration/112822-21runrttasks11:29:101
179940,0migration/112507-21missed_timers11:08:391
179940,0migration/112062-21kthreadcore10:48:371
179940,0migration/110121-21kthreadcore10:28:381
169940,0watchdog/13778-21kthreadcore07:28:401
169940,0watchdog/132146-21ssh09:40:121
169940,0watchdog/127206-21kthreadcore10:38:391
169940,0watchdog/122530-21gltestperf11:58:351
169940,0watchdog/116793-21ssh08:50:161
169940,0watchdog/11633-21grep11:23:391
169940,0watchdog/114636-21irqrtprio08:03:401
169940,0watchdog/111327-21cat10:08:401
169940,0watchdog/10-21swapper/112:08:431
169940,0watchdog/10-21swapper/109:55:001
169940,0watchdog/10-21swapper/109:08:361
169940,0watchdog/10-21swapper/108:33:401
169940,0watchdog/10-21swapper/107:08:401
149940,0migration/027978-21kthreadcore10:18:390
149940,0migration/023479-21sh10:16:070
149940,0migration/018136-21kthreadcore10:53:360
149940,0migration/012848-21kthreadcore10:48:370
149940,0migration/010028-21kthreadcore10:08:390
8215030,0irq/24-0000:00:0-21swapper/207:43:582
36569933,0cyclictest3556-21lldpd07:56:282
36569932,0cyclictest8773-21irqcore08:23:382
36569932,0cyclictest14309-21awk08:03:392
36569932,0cyclictest11519-21munin-node07:13:432
36569931,0cyclictest22564-21kthreadcore08:33:392
36559932,0cyclictest25755-21awk07:23:371
36559932,0cyclictest21139-21sed08:08:381
36559932,0cyclictest18435-21awk09:33:371
36559932,0cyclictest16681-21kthreadcore07:38:401
36559932,0cyclictest10494-21awk09:28:361
36549933,0cyclictest24064-21kworker/0:012:08:220
36549933,0cyclictest24064-21kworker/0:011:48:220
36549933,0cyclictest24064-21kworker/0:011:34:120
36549933,0cyclictest24064-21kworker/0:010:43:350
36549933,0cyclictest24064-21kworker/0:009:48:350
36549933,0cyclictest24064-21kworker/0:008:53:470
36549933,0cyclictest18825-21kworker/0:107:23:350
36549933,0cyclictest18825-21kworker/0:107:03:350
36549932,0cyclictest32240-21kworker/0:208:28:370
36549932,0cyclictest31286-21awk11:43:390
36549932,0cyclictest26091-21basename09:18:340
36549931,0cyclictest32126-21irqrtprio11:23:380
36549930,0cyclictest0-21swapper/008:38:350
36549930,0cyclictest0-21swapper/008:03:370
36549930,0cyclictest0-21swapper/007:43:400
29725030,0irq/27-eth0-tx-0-21swapper/007:28:350
29715030,0irq/26-eth0-rx-0-21swapper/308:12:523
29715030,0irq/26-eth0-rx-0-21swapper/307:23:243
29715030,0irq/26-eth0-rx-0-21swapper/307:03:333
29715030,0irq/26-eth0-rx-0-21swapper/306:58:333
29715030,0irq/26-eth0-rx-0-21swapper/306:56:313
259930,0migration/221891-21kthreadcore08:08:392
179930,0migration/12153-21kthreadcore10:43:391
179930,0migration/11045-21fschecks_count10:03:351
169930,0watchdog/131710-21kthreadcore12:03:391
169930,0watchdog/10-21swapper/110:33:391
169930,0watchdog/10-21swapper/109:48:401
36559921,0cyclictest27514-21latency_hist08:38:221
35120,0ktimersoftd/318776-21kthreadcore08:28:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional