You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 15:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Apr 04, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
351670,0ktimersoftd/32185-21perf06:59:173
872226261,0sleep00-21swapper/006:58:010
854223627,0sleep20-21swapper/206:55:552
849423223,0sleep10-21swapper/106:55:221
89179976,0cyclictest3514-21snmpd07:48:552
89179965,0cyclictest14231-21grep07:49:452
89169966,0cyclictest0-21swapper/109:04:501
89169960,0cyclictest0-21swapper/108:09:391
339960,0migration/329712-21sh09:50:113
339960,0migration/328365-21sh12:12:423
339960,0migration/321415-21sh10:47:163
339960,0migration/315784-21aten_r1power_cu09:24:373
339960,0migration/315186-21dump-pmu-power09:44:263
339960,0migration/312914-21runrttasks11:01:383
339960,0migration/311733-21sh12:21:483
29715060,0irq/26-eth0-rx-5657-21sh09:15:023
29715060,0irq/26-eth0-rx-30848-21irqstats11:54:423
29715060,0irq/26-eth0-rx-18524-21port_sshpriv12:24:453
19160,0ktimersoftd/17115-21diskmemload10:21:271
149960,0migration/021468-21sh11:08:220
149960,0migration/016112-21kthreadcore11:44:420
149960,0migration/014190-21sh10:02:440
89169955,0cyclictest0-21swapper/112:00:471
89169955,0cyclictest0-21swapper/109:15:141
89169950,0cyclictest0-21swapper/112:10:521
89169950,0cyclictest0-21swapper/111:57:471
89169950,0cyclictest0-21swapper/111:02:271
89169950,0cyclictest0-21swapper/110:44:281
89169950,0cyclictest0-21swapper/109:29:251
89159955,0cyclictest6235-21kworker/0:212:24:410
89159955,0cyclictest6235-21kworker/0:212:19:450
89159955,0cyclictest6235-21kworker/0:212:15:450
89159955,0cyclictest6235-21kworker/0:212:11:230
89159955,0cyclictest6235-21kworker/0:212:08:050
89159955,0cyclictest6235-21kworker/0:211:59:530
89159955,0cyclictest6235-21kworker/0:211:54:550
89159955,0cyclictest6235-21kworker/0:211:50:470
89159955,0cyclictest14718-21kworker/0:111:26:050
89159955,0cyclictest14718-21kworker/0:111:14:430
89159955,0cyclictest14718-21kworker/0:111:10:050
89159955,0cyclictest14718-21kworker/0:111:03:270
89159955,0cyclictest14718-21kworker/0:110:49:510
89159955,0cyclictest14718-21kworker/0:110:46:450
89159955,0cyclictest14718-21kworker/0:110:40:270
89159955,0cyclictest14718-21kworker/0:110:34:290
89159955,0cyclictest14718-21kworker/0:110:29:290
89159955,0cyclictest14718-21kworker/0:110:29:210
89159955,0cyclictest14718-21kworker/0:110:21:490
89159955,0cyclictest14718-21kworker/0:110:10:230
89159955,0cyclictest14718-21kworker/0:110:04:490
89159955,0cyclictest14718-21kworker/0:109:49:530
89159955,0cyclictest14718-21kworker/0:109:44:310
89159955,0cyclictest14718-21kworker/0:109:39:430
89159955,0cyclictest14718-21kworker/0:109:34:450
89159955,0cyclictest14718-21kworker/0:109:25:070
89159955,0cyclictest14718-21kworker/0:109:20:010
89159955,0cyclictest14718-21kworker/0:109:14:590
89159955,0cyclictest14718-21kworker/0:109:00:010
89159955,0cyclictest14718-21kworker/0:108:55:570
89159955,0cyclictest14718-21kworker/0:108:49:410
89159955,0cyclictest14718-21kworker/0:108:45:010
89159955,0cyclictest14718-21kworker/0:108:34:380
89159955,0cyclictest14718-21kworker/0:108:30:320
89159955,0cyclictest14718-21kworker/0:108:24:320
89159955,0cyclictest14718-21kworker/0:108:19:500
89159955,0cyclictest14718-21kworker/0:108:14:340
89159955,0cyclictest14718-21kworker/0:108:10:360
89159955,0cyclictest14718-21kworker/0:108:04:560
89159955,0cyclictest14718-21kworker/0:107:49:580
89159955,0cyclictest14718-21kworker/0:107:44:360
89159955,0cyclictest14718-21kworker/0:107:39:380
89159955,0cyclictest14718-21kworker/0:107:34:380
89159955,0cyclictest14718-21kworker/0:107:30:000
89159955,0cyclictest14718-21kworker/0:107:24:500
89159955,0cyclictest14718-21kworker/0:107:14:320
89159955,0cyclictest14718-21kworker/0:107:09:300
89159955,0cyclictest14718-21kworker/0:107:04:300
89159955,0cyclictest14718-21kworker/0:107:00:020
89159955,0cyclictest0-21swapper/011:30:170
89159950,0cyclictest0-21swapper/011:40:220
339950,0migration/39639-21kthreadcore10:39:433
339950,0migration/38265-21munin-node09:59:393
339950,0migration/33376-21pmu-power11:14:473
339950,0migration/331663-21kthreadcore07:39:443
339950,0migration/329360-21runrttasks10:10:123
339950,0migration/328901-21munin-node07:34:473
339950,0migration/327674-21munin-node07:09:453
339950,0migration/326323-21kthreadcore09:29:423
339950,0migration/324625-21irqcore09:09:413
339950,0migration/323096-21irqrtprio11:29:413
339950,0migration/322655-21runrttasks10:09:043
339950,0migration/319073-21kthreadcore09:04:443
339950,0migration/318631-21latency_hist08:19:263
339950,0migration/317172-21run-parts07:50:263
339950,0migration/316696-21runrttasks07:29:263
339950,0migration/31265-21kthreadcore11:34:423
339950,0migration/311533-21kthreadcore07:24:423
29725050,0irq/27-eth0-tx-0-21swapper/007:54:380
29715050,0irq/26-eth0-rx-9788-21kthreadcore11:39:433
29715050,0irq/26-eth0-rx-8798-21kthreadcore11:59:423
29715050,0irq/26-eth0-rx-8392-21grep08:59:423
29715050,0irq/26-eth0-rx-22857-21munin-node10:49:393
29715050,0irq/26-eth0-rx-17972-21kthreadcore07:04:443
29715050,0irq/26-eth0-rx-16300-21if_err_eth009:44:413
29715050,0irq/26-eth0-rx-14354-40yum-updatesd-he11:44:393
29715050,0irq/26-eth0-rx-0-21swapper/311:49:423
29715050,0irq/26-eth0-rx-0-21swapper/311:09:583
29715050,0irq/26-eth0-rx-0-21swapper/311:06:353
29715050,0irq/26-eth0-rx-0-21swapper/310:58:463
29715050,0irq/26-eth0-rx-0-21swapper/310:20:063
29715050,0irq/26-eth0-rx-0-21swapper/309:34:423
29715050,0irq/26-eth0-rx-0-21swapper/309:19:293
29715050,0irq/26-eth0-rx-0-21swapper/308:04:403
19150,0ktimersoftd/10-21swapper/111:42:011
179950,0migration/17358-21taskset08:59:341
179950,0migration/130880-21latency_hist10:14:261
179950,0migration/125970-21kthreadcore07:09:441
179950,0migration/123473-21kthreadcore11:29:421
179950,0migration/121389-21latency_hist11:49:261
179950,0migration/120947-21runrttasks10:24:501
179950,0migration/116845-21kthreadcore12:04:431
179950,0migration/112135-21irqcore07:49:431
169950,0watchdog/19178-21kthreadcore09:59:401
169950,0watchdog/128200-21rm11:51:161
149950,0migration/0787-21kthreadcore09:54:430
149950,0migration/04953-21kthreadcore07:19:430
149950,0migration/03781-21proc_pri10:54:460
149950,0migration/031509-21fschecks_count10:14:380
149950,0migration/030548-21gltestperf11:34:380
149950,0migration/029140-21munin-node09:09:440
149950,0migration/028099-21kthreadcore09:29:430
149950,0migration/025000-21fschecks_time07:59:400
149950,0migration/016990-21kthreadcore09:04:430
149950,0migration/013584-21fschecks_count08:39:400
89179944,0cyclictest0-21swapper/209:35:132
89179943,0cyclictest8285-21awk08:59:412
89179943,0cyclictest3556-21lldpd09:14:552
89179943,0cyclictest3514-21snmpd10:36:442
89179943,0cyclictest3514-21snmpd09:59:292
89179943,0cyclictest3514-21snmpd08:55:292
89179943,0cyclictest3241-21irqbalance11:24:342
89179943,0cyclictest3241-21irqbalance09:24:342
89179943,0cyclictest3241-21irqbalance08:34:452
89179943,0cyclictest3241-21irqbalance08:29:552
89179943,0cyclictest31975-21awk08:04:422
89179943,0cyclictest30034-21awk07:14:422
89179943,0cyclictest26222-21awk08:24:402
89179943,0cyclictest25320-21awk07:59:412
89179943,0cyclictest24702-21awk09:29:412
89179943,0cyclictest23729-21awk10:29:402
89179943,0cyclictest22985-21awk11:09:382
89179943,0cyclictest19672-21awk08:19:412
89179943,0cyclictest10106-21awk06:59:412
89179940,0cyclictest0-21swapper/212:09:422
89179940,0cyclictest0-21swapper/211:44:412
89169944,0cyclictest0-21swapper/110:40:411
89169944,0cyclictest0-21swapper/110:30:071
89169944,0cyclictest0-21swapper/107:04:511
89169943,0cyclictest3556-21lldpd10:56:551
89169943,0cyclictest3556-21lldpd09:11:251
89169943,0cyclictest3556-21lldpd08:48:251
89169943,0cyclictest3556-21lldpd07:14:531
89169943,0cyclictest3556-21lldpd06:59:541
89169943,0cyclictest3514-21snmpd10:14:441
89169943,0cyclictest3241-21irqbalance09:38:441
89169943,0cyclictest31814-21sadc08:29:261
89169943,0cyclictest25295-21awk07:59:411
89169943,0cyclictest1567-21awk08:54:401
89169943,0cyclictest13899-21awk08:39:411
89159944,0cyclictest14718-21kworker/0:111:19:550
8215040,0irq/24-0000:00:4779-21cat12:19:262
339940,0migration/39660-21kthreadcore08:34:433
339940,0migration/3939-21kthreadcore07:14:443
339940,0migration/39231-21kthreadcore08:09:443
339940,0migration/36462-21fschecks_time11:19:373
339940,0migration/331633-21cpu09:54:393
339940,0migration/328295-21kthreadcore08:49:413
339940,0migration/326939-21kthreadcore08:24:423
339940,0migration/325099-21fschecks_time07:59:403
339940,0migration/315433-21kthreadcore08:14:433
339940,0migration/313311-21aten_r1power_fr12:04:373
29725040,0irq/27-eth0-tx-8767-21kthreadcore09:39:442
29725040,0irq/27-eth0-tx-7115-21diskmemload10:49:352
29725040,0irq/27-eth0-tx-29382-21python09:09:472
29725040,0irq/27-eth0-tx-27322-21ssh11:49:472
29725040,0irq/27-eth0-tx-15425-21munin-node09:04:462
29725040,0irq/27-eth0-tx-13632-21ssh10:21:492
29725040,0irq/27-eth0-tx-13303-21diskstats12:24:372
29725040,0irq/27-eth0-tx-12664-21ssh11:00:552
29725040,0irq/27-eth0-tx-0-21swapper/212:14:342
29725040,0irq/27-eth0-tx-0-21swapper/212:02:292
29725040,0irq/27-eth0-tx-0-21swapper/211:39:392
29725040,0irq/27-eth0-tx-0-21swapper/211:34:332
29725040,0irq/27-eth0-tx-0-21swapper/211:30:102
29725040,0irq/27-eth0-tx-0-21swapper/211:19:372
29725040,0irq/27-eth0-tx-0-21swapper/210:54:532
29725040,0irq/27-eth0-tx-0-21swapper/210:39:502
29725040,0irq/27-eth0-tx-0-21swapper/210:25:482
29725040,0irq/27-eth0-tx-0-21swapper/210:14:452
29725040,0irq/27-eth0-tx-0-21swapper/210:09:552
29725040,0irq/27-eth0-tx-0-21swapper/210:04:402
29725040,0irq/27-eth0-tx-0-21swapper/209:54:422
29725040,0irq/27-eth0-tx-0-21swapper/209:49:392
29715040,0irq/26-eth0-rx-0-21swapper/312:14:583
29715040,0irq/26-eth0-rx-0-21swapper/311:24:383
29715040,0irq/26-eth0-rx-0-21swapper/310:34:363
29715040,0irq/26-eth0-rx-0-21swapper/310:29:423
29715040,0irq/26-eth0-rx-0-21swapper/310:24:323
29715040,0irq/26-eth0-rx-0-21swapper/310:14:413
259940,0migration/214332-21latency_hist10:44:262
249940,0watchdog/29188-21cat07:19:492
249940,0watchdog/230757-21tune2fs07:39:412
249940,0watchdog/2301-21kthreadcore11:14:442
249940,0watchdog/229077-21python07:34:492
249940,0watchdog/221736-21ssh09:45:122
249940,0watchdog/217363-21kthreadcore08:39:442
249940,0watchdog/213968-21gltestperf12:04:402
249940,0watchdog/20-21swapper/211:04:322
249940,0watchdog/20-21swapper/209:19:482
249940,0watchdog/20-21swapper/207:09:492
249940,0watchdog/20-21swapper/207:04:452
179940,0migration/17538-21latency_hist09:19:261
179940,0migration/15894-21aten_r1power_po11:19:351
179940,0migration/15457-21runrttasks10:37:281
179940,0migration/131757-21gltestperf08:04:401
179940,0migration/131689-21kthreadcore12:14:441
179940,0migration/128921-21kthreadcore08:49:421
179940,0migration/127182-21kthreadcore10:49:441
179940,0migration/123867-21df_inode09:49:381
179940,0migration/118271-21kthreadcore10:04:421
179940,0migration/118016-21kthreadcore11:24:421
179940,0migration/116912-21kthreadcore08:14:431
179940,0migration/111639-21kthreadcore07:24:421
179940,0migration/111163-21kthreadcore08:34:431
169940,0watchdog/13857-21ssh11:35:361
169940,0watchdog/130759-21cut07:39:411
169940,0watchdog/129581-21switchtime09:29:481
169940,0watchdog/119205-21ssh12:25:191
169940,0watchdog/118590-21kthreadcore09:44:441
169940,0watchdog/114122-21rm11:04:321
169940,0watchdog/111094-21ssh12:19:551
169940,0watchdog/10-21swapper/111:11:161
169940,0watchdog/10-21swapper/109:39:441
89179933,0cyclictest3556-21lldpd08:14:542
89179932,0cyclictest7911-21grep08:09:432
89179932,0cyclictest3514-21snmpd07:29:292
89179932,0cyclictest30437-21awk11:54:402
89179932,0cyclictest27192-21awk08:49:392
89179932,0cyclictest20553-21awk08:44:402
89179932,0cyclictest18667-21awk07:54:412
89179930,0cyclictest10755-21perl07:24:402
89169932,0cyclictest5343-21kthreadcore07:19:431
89169932,0cyclictest449-21awk08:29:411
89169932,0cyclictest32333-21awk09:54:411
89169932,0cyclictest31097-21awk11:14:421
29715030,0irq/26-eth0-rx-0-21swapper/308:46:523
29715030,0irq/26-eth0-rx-0-21swapper/308:41:053
29715030,0irq/26-eth0-rx-0-21swapper/308:29:593
29715030,0irq/26-eth0-rx-0-21swapper/307:54:503
29715030,0irq/26-eth0-rx-0-21swapper/307:48:353
29715030,0irq/26-eth0-rx-0-21swapper/307:22:593
29715030,0irq/26-eth0-rx-0-21swapper/306:59:373
169930,0watchdog/10-21swapper/107:44:371
169930,0watchdog/10-21swapper/107:34:491
89169921,0cyclictest18664-21latency_hist08:19:261
329920,0watchdog/30-21swapper/308:54:453
169920,0watchdog/10-21swapper/107:54:321
169920,0watchdog/10-21swapper/107:29:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional