You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 22:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Jun 04, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450730,0irq/25-eth10-21swapper/306:49:103
2737123723,0sleep00-21swapper/006:53:230
2723723324,0sleep10-21swapper/106:51:481
2707323127,0sleep20-21swapper/206:49:532
274729976,0cyclictest8930-40yum-updatesd-he09:41:221
4160,0ktimersoftd/00-21swapper/010:18:060
35160,0ktimersoftd/30-21swapper/310:18:063
339960,0migration/38795-21sh10:01:243
339960,0migration/332720-21sh09:34:523
339960,0migration/332525-21sh10:35:573
339960,0migration/332092-21sh11:15:443
339960,0migration/331507-21sh12:16:483
339960,0migration/315877-21sh10:24:133
339960,0migration/310812-21munin-node10:03:533
29725060,0irq/27-eth0-tx-27684-21munin-node06:53:530
29715060,0irq/26-eth0-rx-31947-21awk09:13:593
29715060,0irq/26-eth0-rx-23923-21sh11:52:163
29715060,0irq/26-eth0-rx-22765-21munin-run07:38:403
274739960,0cyclictest0-21swapper/210:09:002
274729960,0cyclictest0-21swapper/111:20:321
274729960,0cyclictest0-21swapper/108:08:581
274729960,0cyclictest0-21swapper/108:08:581
274719960,0cyclictest0-21swapper/009:54:380
19160,0ktimersoftd/10-21swapper/110:18:061
179960,0migration/18521-21kthreadcore07:48:571
149960,0migration/07744-21sh10:59:490
149960,0migration/025394-21sh09:11:520
8215050,0irq/24-0000:00:25818-21idleruntime-cro09:53:392
339950,0migration/35838-21kthreadcore06:58:573
339950,0migration/35153-21munin-node07:48:563
339950,0migration/33188-21kthreadcore10:18:553
339950,0migration/331867-21taskset10:54:303
339950,0migration/33161-21kthreadcore11:18:543
339950,0migration/330951-21taskset08:29:413
339950,0migration/33092-21kthreadcore11:58:553
339950,0migration/329473-21munin-node07:18:523
339950,0migration/327018-21munin-node09:53:543
339950,0migration/326266-21kthreadcore07:38:563
339950,0migration/32600-21kthreadcore10:58:543
339950,0migration/325307-21cpuspeed_turbos11:33:513
339950,0migration/324182-21munin-node09:29:023
339950,0migration/323979-21aten_r1power_cu08:03:513
339950,0migration/321151-21kthreadcore09:08:563
339950,0migration/31934-21kthreadcore08:33:563
339950,0migration/314792-21taskset12:04:533
339950,0migration/314333-21kthreadcore09:43:563
339950,0migration/313821-21munin-node08:43:543
339950,0migration/311059-21munin-node07:53:523
339950,0migration/310433-21if_eth1.210:43:523
339950,0migration/310186-21fschecks_time07:28:533
29725050,0irq/27-eth0-tx-3438-21kernelversion09:18:562
29725050,0irq/27-eth0-tx-3265-21ssh10:38:552
29725050,0irq/27-eth0-tx-24685-21munin-node11:54:012
29725050,0irq/27-eth0-tx-0-21swapper/211:18:482
29725050,0irq/27-eth0-tx-0-21swapper/209:03:532
29725050,0irq/27-eth0-tx-0-21swapper/209:01:022
29725050,0irq/27-eth0-tx-0-21swapper/008:43:080
29725050,0irq/27-eth0-tx-0-21swapper/008:31:270
29725050,0irq/27-eth0-tx-0-21swapper/007:42:040
29715050,0irq/26-eth0-rx-24153-21ssh11:31:553
29715050,0irq/26-eth0-rx-23327-21cut09:48:573
29715050,0irq/26-eth0-rx-21394-21tr10:08:563
29715050,0irq/26-eth0-rx-1908-21grep07:43:593
29715050,0irq/26-eth0-rx-18992-21irqstats10:28:553
29715050,0irq/26-eth0-rx-17949-21diskstats10:48:513
29715050,0irq/26-eth0-rx-1714-21df_abs10:38:503
29715050,0irq/26-eth0-rx-16593-21ssh11:28:113
29715050,0irq/26-eth0-rx-14092-21munin-node11:43:573
29715050,0irq/26-eth0-rx-0-21swapper/312:18:453
29715050,0irq/26-eth0-rx-0-21swapper/312:12:483
29715050,0irq/26-eth0-rx-0-21swapper/311:12:173
29715050,0irq/26-eth0-rx-0-21swapper/309:39:093
29715050,0irq/26-eth0-rx-0-21swapper/309:27:073
29715050,0irq/26-eth0-rx-0-21swapper/309:04:343
29715050,0irq/26-eth0-rx-0-21swapper/308:58:553
29715050,0irq/26-eth0-rx-0-21swapper/308:38:553
274729950,0cyclictest0-21swapper/111:51:071
274729950,0cyclictest0-21swapper/110:27:521
274729950,0cyclictest0-21swapper/109:50:021
274719950,0cyclictest376-21ssh12:18:530
274719950,0cyclictest0-21swapper/011:15:590
259950,0migration/225194-21sh10:33:012
259950,0migration/214939-21missed_timers07:28:582
249950,0watchdog/20-21swapper/209:28:542
19150,0ktimersoftd/10-21swapper/109:11:061
179950,0migration/16079-21taskset11:59:001
179950,0migration/127873-21kthreadcore08:03:571
179950,0migration/124590-21latency_hist11:53:391
179950,0migration/120363-21kthreadcore10:48:551
179950,0migration/119389-21kthreadcore11:28:551
169950,0watchdog/18676-21munin-node07:03:541
149950,0migration/09940-21fschecks_time11:03:520
149950,0migration/05007-21kthreadcore09:18:560
149950,0migration/032252-21kthreadcore07:43:590
149950,0migration/03021-21kernelversion08:58:540
149950,0migration/029206-21kthreadcore09:33:560
149950,0migration/028571-21kthreadcore10:33:560
149950,0migration/028055-21taskset07:14:380
149950,0migration/026909-21fschecks_time09:13:520
149950,0migration/024911-21latency_hist11:33:390
149950,0migration/024378-21taskset10:10:040
149950,0migration/022960-21missed_timers10:48:570
149950,0migration/021399-21kthreadcore07:33:560
149950,0migration/02028-21munin-node09:38:510
149950,0migration/01880-21aten2.4-expect09:58:500
149950,0migration/018262-21switchtime08:44:000
149950,0migration/017866-21latency_hist09:48:390
149950,0migration/017815-21kthreadcore12:08:540
149950,0migration/017628-21latency_hist10:28:390
149950,0migration/01357-21aten_r1power_cu10:38:490
149950,0migration/011723-21kthreadcore07:28:560
149950,0migration/010570-21irqcore10:43:530
8215040,0irq/24-0000:00:0-21swapper/207:53:402
339940,0migration/32774-21kthreadcore11:38:563
339940,0migration/319354-21aten_r1power_vo08:48:503
339940,0migration/310252-21kthreadcore07:03:553
29725040,0irq/27-eth0-tx-8348-21munin-node12:03:542
29725040,0irq/27-eth0-tx-32660-21ssh11:58:472
29725040,0irq/27-eth0-tx-30659-21ssh12:14:202
29725040,0irq/27-eth0-tx-26796-21ssh09:53:522
29725040,0irq/27-eth0-tx-26332-21munin-node09:13:552
29725040,0irq/27-eth0-tx-23689-21ssh11:09:252
29725040,0irq/27-eth0-tx-16355-21ssh12:08:482
29725040,0irq/27-eth0-tx-0-21swapper/211:48:572
29725040,0irq/27-eth0-tx-0-21swapper/211:43:562
29725040,0irq/27-eth0-tx-0-21swapper/211:13:402
29725040,0irq/27-eth0-tx-0-21swapper/211:04:162
29725040,0irq/27-eth0-tx-0-21swapper/210:58:442
29725040,0irq/27-eth0-tx-0-21swapper/210:53:412
29725040,0irq/27-eth0-tx-0-21swapper/210:48:562
29725040,0irq/27-eth0-tx-0-21swapper/210:43:442
29725040,0irq/27-eth0-tx-0-21swapper/210:34:392
29725040,0irq/27-eth0-tx-0-21swapper/210:24:122
29725040,0irq/27-eth0-tx-0-21swapper/210:19:102
29725040,0irq/27-eth0-tx-0-21swapper/210:03:392
29725040,0irq/27-eth0-tx-0-21swapper/209:43:512
29725040,0irq/27-eth0-tx-0-21swapper/209:38:512
29725040,0irq/27-eth0-tx-0-21swapper/209:08:512
29725040,0irq/27-eth0-tx-0-21swapper/007:10:040
29715040,0irq/26-eth0-rx-3317-21munin-node07:23:543
29715040,0irq/26-eth0-rx-0-21swapper/311:54:253
29715040,0irq/26-eth0-rx-0-21swapper/311:03:483
29715040,0irq/26-eth0-rx-0-21swapper/309:19:093
29715040,0irq/26-eth0-rx-0-21swapper/308:53:533
29715040,0irq/26-eth0-rx-0-21swapper/308:08:513
29715040,0irq/26-eth0-rx-0-21swapper/308:08:513
274739944,0cyclictest0-21swapper/211:33:402
274739943,0cyclictest3514-21snmpd08:39:062
274739943,0cyclictest3514-21snmpd06:58:512
274739943,0cyclictest27232-21awk09:33:542
274739943,0cyclictest26841-21awk08:53:542
274739943,0cyclictest23840-21awk07:38:542
274739943,0cyclictest19109-21awk08:23:532
274739943,0cyclictest17171-21awk07:33:532
274739943,0cyclictest1532-21awk11:38:542
274739943,0cyclictest13435-21awk08:43:532
274739943,0cyclictest12569-21awk08:18:552
274729944,0cyclictest0-21swapper/110:34:391
274729944,0cyclictest0-21swapper/109:43:531
274729943,0cyclictest3556-21lldpd12:22:351
274729943,0cyclictest3556-21lldpd11:24:051
274729943,0cyclictest3556-21lldpd10:43:051
274729943,0cyclictest3556-21lldpd09:15:331
274729943,0cyclictest3556-21lldpd08:45:331
274729943,0cyclictest3556-21lldpd07:56:331
274729943,0cyclictest3556-21lldpd06:56:341
274729943,0cyclictest3514-21snmpd11:44:071
274729943,0cyclictest3062-21awk09:18:541
274729943,0cyclictest2792-21awk06:58:551
274729943,0cyclictest27182-21awk09:33:541
274729943,0cyclictest25253-21awk12:13:511
274729943,0cyclictest10347-21awk10:43:521
274719944,0cyclictest0-21swapper/008:53:460
274719943,0cyclictest9250-21awk12:03:540
274719943,0cyclictest8755-21sadc11:23:390
274719943,0cyclictest3241-21irqbalance10:57:370
274719943,0cyclictest25759-21kworker/0:009:29:590
274719943,0cyclictest24749-21sadc11:33:390
274719943,0cyclictest1944-21munin-node06:59:030
274719943,0cyclictest15889-21grep10:04:020
274719943,0cyclictest10804-21awk09:03:530
274719943,0cyclictest10425-21sadc07:53:400
274719940,0cyclictest0-21swapper/008:28:400
259940,0migration/29141-21kthreadcore07:48:572
259940,0migration/25959-21kthreadcore07:23:582
259940,0migration/232424-21runrttasks10:15:012
259940,0migration/228718-21aten_r1power_fr07:18:492
259940,0migration/22796-21pmu-power07:44:022
259940,0migration/223938-21latency_hist08:03:402
259940,0migration/22290-21kthreadcore08:33:562
259940,0migration/222786-21kthreadcore08:48:562
259940,0migration/22248-21kthreadcore08:08:572
259940,0migration/22248-21kthreadcore08:08:572
259940,0migration/222338-21kthreadcore11:28:562
259940,0migration/213226-21kthreadcore09:23:572
259940,0migration/211400-21kthreadcore11:23:562
249940,0watchdog/232426-21ssh12:18:492
249940,0watchdog/225891-21iostat08:28:542
249940,0watchdog/21679-21ssh09:58:412
249940,0watchdog/20-21swapper/207:03:542
179940,0migration/18370-21munin-node07:23:591
179940,0migration/17918-21kthreadcore08:38:551
179940,0migration/14586-21kthreadcore09:58:561
179940,0migration/14465-21latency08:33:571
179940,0migration/13959-21kthreadcore11:38:561
179940,0migration/131632-21sendmail_mailst08:54:011
179940,0migration/128282-21kthreadcore11:13:561
179940,0migration/127802-21kthreadcore10:53:551
179940,0migration/124200-21irqrtprio07:38:551
179940,0migration/124195-21taskset11:10:541
179940,0migration/123179-21irqrtprio07:13:561
179940,0migration/118165-21fschecks_count10:28:521
179940,0migration/117349-21if_eth1.312:08:531
179940,0migration/115642-21munin-node10:04:001
179940,0migration/115498-21aten_r1power_vo07:08:521
179940,0migration/114931-21kthreadcore09:23:571
179940,0migration/113160-21kthreadcore08:18:571
179940,0migration/112591-21kthreadcore12:03:561
179940,0migration/110039-21munin-node09:03:501
169940,0watchdog/15046-21aten2.4-expect08:13:501
169940,0watchdog/1393-21ssh09:55:501
169940,0watchdog/130392-21kthreadcore07:18:541
169940,0watchdog/124926-21ssh10:11:371
169940,0watchdog/1248912chrt08:28:461
169940,0watchdog/124676-21ntp_kernel_pll_08:48:581
169940,0watchdog/115356-21timerwakeupswit11:04:011
169940,0watchdog/10-21swapper/109:28:541
169940,0watchdog/10-21swapper/107:58:541
169940,0watchdog/10-21swapper/107:43:581
149940,0migration/04487-21kthreadcore11:58:550
149940,0migration/029994-21kthreadcore11:53:580
149940,0migration/014720-21kthreadcore10:23:560
149940,0migration/011602-21kthreadcore07:03:550
29715030,0irq/26-eth0-rx-0-21swapper/308:24:003
29715030,0irq/26-eth0-rx-0-21swapper/308:14:283
29715030,0irq/26-eth0-rx-0-21swapper/308:02:253
29715030,0irq/26-eth0-rx-0-21swapper/307:09:033
274739932,0cyclictest3514-21snmpd07:58:512
274739932,0cyclictest25154-21kthreadcore07:13:572
274739930,0cyclictest28287-21perl06:53:532
274729932,0cyclictest3556-21lldpd09:00:031
274729932,0cyclictest23353-21kthreadcore08:23:561
274719933,0cyclictest25759-21kworker/0:012:13:400
274719933,0cyclictest25759-21kworker/0:011:43:400
274719933,0cyclictest25759-21kworker/0:011:38:400
274719933,0cyclictest25759-21kworker/0:011:23:400
274719933,0cyclictest25759-21kworker/0:011:08:440
274719933,0cyclictest25759-21kworker/0:010:18:410
274719933,0cyclictest25759-21kworker/0:009:48:430
274719933,0cyclictest25759-21kworker/0:009:23:410
274719933,0cyclictest25759-21kworker/0:008:48:410
274719933,0cyclictest25759-21kworker/0:008:33:410
274719933,0cyclictest25759-21kworker/0:008:18:510
274719933,0cyclictest25759-21kworker/0:008:13:410
274719933,0cyclictest25759-21kworker/0:008:08:430
274719933,0cyclictest25759-21kworker/0:008:08:430
274719933,0cyclictest25759-21kworker/0:008:03:410
274719933,0cyclictest25759-21kworker/0:007:58:410
274719933,0cyclictest25759-21kworker/0:007:53:490
274719933,0cyclictest25759-21kworker/0:007:23:530
274719932,0cyclictest28639-21munin-node07:18:510
249930,0watchdog/20-21swapper/208:13:502
249930,0watchdog/20-21swapper/207:09:022
169930,0watchdog/12258-21sed10:58:531
169930,0watchdog/10-21swapper/111:33:411
169930,0watchdog/10-21swapper/110:18:571
169930,0watchdog/10-21swapper/107:28:541
149930,0migration/016653-21sh11:48:400
29715020,0irq/26-eth0-rx-0-21swapper/308:18:403
29715020,0irq/26-eth0-rx-0-21swapper/307:14:013
29715020,0irq/26-eth0-rx-0-21swapper/306:53:493
169920,0watchdog/10-21swapper/107:33:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional