You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 23:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Dec 14, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
130826968,0sleep00-21swapper/007:06:320
131423624,0sleep10-21swapper/107:06:371
2804823526,0sleep30-21swapper/307:05:033
148223430,0sleep20-21swapper/207:08:342
339960,0migration/326131-21sh11:50:393
339960,0migration/31889-21sh10:40:183
339960,0migration/313874-21sh11:07:243
29715060,0irq/26-eth0-rx-7120-21smartctl09:50:053
29715060,0irq/26-eth0-rx-442-21ssh12:34:563
29715060,0irq/26-eth0-rx-4163-21munin-node09:30:073
29715060,0irq/26-eth0-rx-27988-21kthreadcore11:35:083
29715060,0irq/26-eth0-rx-19030-21perf08:59:523
29715060,0irq/26-eth0-rx-0-21swapper/310:20:343
16659960,0cyclictest0-21swapper/209:41:562
16649960,0cyclictest0-21swapper/110:54:261
149960,0migration/08701-21kthreadcore08:00:090
8215050,0irq/24-0000:00:8304-21latency_hist10:09:522
8215050,0irq/24-0000:00:13190-21latency_hist12:04:512
4150,0ktimersoftd/00-21swapper/011:57:230
339950,0migration/39806-21irqrtprio10:10:073
339950,0migration/35985-21taskset11:04:023
339950,0migration/33512-21kthreadcore12:15:103
339950,0migration/331683-21sh12:32:483
339950,0migration/331474-21kthreadcore09:25:093
339950,0migration/329997-21sh09:44:593
339950,0migration/329571-21sendmail_mailqu08:15:123
339950,0migration/329030-21taskset07:51:223
339950,0migration/328538-21aten_r1power_po11:55:023
339950,0migration/328364-21taskset07:29:493
339950,0migration/327183-21kthreadcore11:15:093
339950,0migration/323143-21sh12:10:073
339950,0migration/320761-21munin-node09:55:133
339950,0migration/320497-21irqcore10:35:073
339950,0migration/318327-21kthreadcore12:25:083
339950,0migration/31812-21kthreadcore11:20:093
339950,0migration/317705-21kthreadcore11:10:083
339950,0migration/316765-21kthreadcore07:20:103
339950,0migration/31564-21kthreadcore08:20:103
339950,0migration/314171-21kthreadcore08:30:093
339950,0migration/313478-21munin-node09:35:083
339950,0migration/310978-21sh10:46:043
29725050,0irq/27-eth0-tx-9941-21grep12:00:092
29725050,0irq/27-eth0-tx-9595-21munin-node07:40:080
29725050,0irq/27-eth0-tx-6510-21cut10:25:092
29725050,0irq/27-eth0-tx-565-21cut09:45:092
29725050,0irq/27-eth0-tx-4803-21grep11:40:092
29725050,0irq/27-eth0-tx-3425-21kthreadcore12:35:092
29725050,0irq/27-eth0-tx-3049-21ssh11:56:562
29725050,0irq/27-eth0-tx-30375-21ssh10:01:262
29725050,0irq/27-eth0-tx-20703-21kthreadcore11:30:082
29725050,0irq/27-eth0-tx-19546-21ssh10:50:512
29725050,0irq/27-eth0-tx-18459-21grep09:20:062
29725050,0irq/27-eth0-tx-17226-21unixbench_singl11:45:142
29725050,0irq/27-eth0-tx-16291-21munin-node07:45:130
29725050,0irq/27-eth0-tx-14989-21munin-node09:55:062
29725050,0irq/27-eth0-tx-0-21swapper/212:17:192
29725050,0irq/27-eth0-tx-0-21swapper/211:50:132
29725050,0irq/27-eth0-tx-0-21swapper/211:15:152
29725050,0irq/27-eth0-tx-0-21swapper/210:35:092
29725050,0irq/27-eth0-tx-0-21swapper/209:49:532
29725050,0irq/27-eth0-tx-0-21swapper/008:15:030
29715050,0irq/26-eth0-rx-7692-21perl12:20:043
29715050,0irq/26-eth0-rx-7656-21sensors_fan07:10:093
29715050,0irq/26-eth0-rx-7001-21ssh09:11:583
29715050,0irq/26-eth0-rx-25390-21kthreadcore10:55:093
29715050,0irq/26-eth0-rx-22989-21kthreadcore09:20:103
29715050,0irq/26-eth0-rx-22625-21kthreadcore09:40:083
29715050,0irq/26-eth0-rx-13736-21cpuspeed_turbos12:05:053
29715050,0irq/26-eth0-rx-0-21swapper/311:48:213
29715050,0irq/26-eth0-rx-0-21swapper/311:25:033
29715050,0irq/26-eth0-rx-0-21swapper/310:34:363
29715050,0irq/26-eth0-rx-0-21swapper/310:25:093
29715050,0irq/26-eth0-rx-0-21swapper/310:19:323
29715050,0irq/26-eth0-rx-0-21swapper/310:08:543
29715050,0irq/26-eth0-rx-0-21swapper/310:02:083
259950,0migration/24015-21aten2.4-expect08:00:032
259950,0migration/226302-21kthreadcore08:40:082
259950,0migration/226165-21latency_hist11:34:512
259950,0migration/224280-21kthreadcore07:50:082
259950,0migration/223037-21taskset12:27:472
259950,0migration/218910-21sh09:36:072
259950,0migration/215009-21sh12:24:062
249950,0watchdog/231801-21tail09:05:152
19150,0ktimersoftd/10-21swapper/112:25:151
19150,0ktimersoftd/10-21swapper/111:08:091
19150,0ktimersoftd/10-21swapper/109:47:541
179950,0migration/131049-21fschecks_time11:00:051
179950,0migration/118984-21kthreadcore09:55:091
179950,0migration/117921-21kthreadcore12:05:101
16659955,0cyclictest0-21swapper/207:35:102
16649955,0cyclictest0-21swapper/109:32:361
16649954,0cyclictest5326-21awk10:45:091
16649950,0cyclictest0-21swapper/109:35:081
16639955,0cyclictest15216-21kworker/0:109:04:560
16639955,0cyclictest15216-21kworker/0:108:59:560
16639955,0cyclictest15216-21kworker/0:108:54:580
16639955,0cyclictest15216-21kworker/0:108:50:000
16639955,0cyclictest15216-21kworker/0:108:44:580
16639955,0cyclictest15216-21kworker/0:108:39:560
16639955,0cyclictest15216-21kworker/0:108:34:560
16639955,0cyclictest15216-21kworker/0:108:29:560
16639955,0cyclictest15216-21kworker/0:108:24:560
16639955,0cyclictest15216-21kworker/0:108:20:000
16639955,0cyclictest15216-21kworker/0:108:09:540
16639955,0cyclictest15216-21kworker/0:108:04:560
16639955,0cyclictest15216-21kworker/0:107:54:580
16639955,0cyclictest15216-21kworker/0:107:49:560
16639955,0cyclictest15216-21kworker/0:107:34:560
16639955,0cyclictest15216-21kworker/0:107:29:540
16639955,0cyclictest15216-21kworker/0:107:19:580
16639955,0cyclictest15216-21kworker/0:107:14:570
16639955,0cyclictest15216-21kworker/0:107:09:570
16639955,0cyclictest0-21swapper/010:35:150
149950,0migration/0924-21gltestperf09:10:060
149950,0migration/08761-21latency_hist11:24:510
149950,0migration/07178-21fschecks_count11:05:050
149950,0migration/06338-21sh12:19:020
149950,0migration/05821-21irqcore12:00:070
149950,0migration/031860-21sh10:04:350
149950,0migration/029178-21sh10:58:000
149950,0migration/028430-21df_abs10:40:020
149950,0migration/027913-21kthreadcore10:20:090
149950,0migration/024588-21sh11:31:580
149950,0migration/021946-21latency_hist07:24:530
149950,0migration/019782-21kthreadcore09:55:090
149950,0migration/017127-21sh09:19:130
149950,0migration/015221-21sh10:11:140
339940,0migration/39739-21if_err_eth1.209:15:073
339940,0migration/38795-21kthreadcore08:00:093
339940,0migration/324455-21taskset08:37:173
339940,0migration/318675-21diskmemload10:50:123
339940,0migration/31394-21kthreadcore08:45:093
29725040,0irq/27-eth0-tx-0-21swapper/212:30:012
29725040,0irq/27-eth0-tx-0-21swapper/212:10:402
29725040,0irq/27-eth0-tx-0-21swapper/211:25:002
29725040,0irq/27-eth0-tx-0-21swapper/211:20:272
29725040,0irq/27-eth0-tx-0-21swapper/211:10:452
29725040,0irq/27-eth0-tx-0-21swapper/211:05:012
29725040,0irq/27-eth0-tx-0-21swapper/210:30:582
29725040,0irq/27-eth0-tx-0-21swapper/210:15:082
29725040,0irq/27-eth0-tx-0-21swapper/210:09:522
29725040,0irq/27-eth0-tx-0-21swapper/209:25:052
29725040,0irq/27-eth0-tx-0-21swapper/209:15:022
29715040,0irq/26-eth0-rx-16265-21munin-node08:05:133
29715040,0irq/26-eth0-rx-0-21swapper/312:00:153
29715040,0irq/26-eth0-rx-0-21swapper/311:42:103
29715040,0irq/26-eth0-rx-0-21swapper/311:30:003
29715040,0irq/26-eth0-rx-0-21swapper/307:55:093
29715040,0irq/26-eth0-rx-0-21swapper/307:15:043
259940,0migration/26107-21cpuspeed_turbos08:50:062
259940,0migration/23255-21kthreadcore09:10:102
259940,0migration/231355-21kthreadcore07:55:082
259940,0migration/222216-21fschecks_count10:55:052
259940,0migration/22134-21kthreadcore11:00:092
259940,0migration/218350-21kthreadcore07:45:082
249940,0watchdog/26559-21runrttasks10:44:542
249940,0watchdog/231280-21munin-node10:20:112
249940,0watchdog/228467-21df_inode10:40:022
249940,0watchdog/21871-21python07:30:152
249940,0watchdog/20-21swapper/207:20:112
179940,0migration/19610-21ksmtuned10:27:561
179940,0migration/19463-21fschecks_count11:25:051
179940,0migration/19383-21kthreadcore12:20:071
179940,0migration/18999-21kthreadcore08:50:111
179940,0migration/15702-21hddtemp_smartct08:25:071
179940,0migration/15555-21pmu-power10:05:121
179940,0migration/14896-21kthreadcore07:10:061
179940,0migration/14735-21kthreadcore11:40:091
179940,0migration/129605-21sh07:55:031
179940,0migration/12906-21sh10:42:271
179940,0migration/128614-21kthreadcore10:20:091
179940,0migration/128556-21kthreadcore11:35:081
179940,0migration/125327-21munin-node12:30:061
179940,0migration/124211-21kernelversion07:50:081
179940,0migration/123549-21kthreadcore10:35:091
179940,0migration/122576-21fschecks_time07:25:081
179940,0migration/122393-21irqcore09:40:071
179940,0migration/121723-21kthreadcore09:00:081
179940,0migration/118929-21kthreadcore08:10:091
179940,0migration/113625-21taskset09:52:381
179940,0migration/110453-21kthreadcore09:15:091
16659943,0cyclictest3556-21lldpd09:29:592
16659943,0cyclictest3556-21lldpd08:54:582
16659943,0cyclictest3556-21lldpd08:24:272
16659943,0cyclictest3556-21lldpd08:16:272
16659943,0cyclictest3556-21lldpd08:09:582
16659943,0cyclictest3556-21lldpd08:07:572
16659943,0cyclictest31641-21basename08:45:042
16659943,0cyclictest2873-21awk07:10:042
16659943,0cyclictest22869-21awk07:25:102
16649944,0cyclictest0-21swapper/108:40:061
16649943,0cyclictest9489-21awk10:10:051
16649943,0cyclictest3556-21lldpd11:47:021
16649943,0cyclictest3556-21lldpd10:17:311
16649943,0cyclictest3556-21lldpd09:24:591
16649943,0cyclictest3556-21lldpd08:35:571
16649943,0cyclictest3556-21lldpd08:08:271
16649943,0cyclictest3514-21snmpd11:15:491
16649943,0cyclictest3514-21snmpd10:30:041
16649943,0cyclictest3514-21snmpd08:34:041
16649943,0cyclictest3514-21snmpd08:22:191
16649943,0cyclictest3514-21snmpd08:00:491
16649943,0cyclictest3514-21snmpd07:46:041
16649943,0cyclictest3514-21snmpd07:35:491
16649943,0cyclictest3514-21snmpd07:20:041
16649943,0cyclictest3514-21snmpd07:16:041
16649943,0cyclictest32425-21awk08:45:071
16649943,0cyclictest29569-21awk07:30:081
16649943,0cyclictest24896-21awk08:15:071
16649943,0cyclictest23046-21awk12:10:071
16649943,0cyclictest22724-21awk10:55:071
16649943,0cyclictest20688-21awk11:50:051
16649943,0cyclictest18494-21awk11:30:061
16639943,0cyclictest3556-21lldpd11:54:020
16639943,0cyclictest3556-21lldpd11:16:310
16639943,0cyclictest3556-21lldpd09:52:290
16639943,0cyclictest3514-21snmpd10:31:490
16639943,0cyclictest3514-21snmpd10:18:340
16639943,0cyclictest27486-21awk09:25:060
16639943,0cyclictest25289-21awk12:30:050
16639943,0cyclictest23022-21awk12:10:060
16639943,0cyclictest18787-21awk09:20:080
16639943,0cyclictest1460-21awk12:35:070
16639943,0cyclictest14456-21awk12:05:080
16639940,0cyclictest0-21swapper/012:27:390
16639940,0cyclictest0-21swapper/011:12:370
16639940,0cyclictest0-21swapper/009:49:520
169940,0watchdog/18944-21sh12:39:461
169940,0watchdog/18183-21ssh11:23:541
169940,0watchdog/131799-21grep09:05:151
169940,0watchdog/129867-21ssh10:00:231
169940,0watchdog/124647-21ssh09:21:351
169940,0watchdog/115062-21awk07:40:111
169940,0watchdog/10-21swapper/109:12:351
149940,0migration/0327-21diskmemload10:05:050
149940,0migration/029069-21sh09:43:290
339930,0migration/323322-21runrttasks08:10:293
29715030,0irq/26-eth0-rx-0-21swapper/309:00:093
29715030,0irq/26-eth0-rx-0-21swapper/308:54:233
29715030,0irq/26-eth0-rx-0-21swapper/308:40:033
29715030,0irq/26-eth0-rx-0-21swapper/308:25:113
29715030,0irq/26-eth0-rx-0-21swapper/307:40:043
29715030,0irq/26-eth0-rx-0-21swapper/307:30:043
259930,0migration/29837-21kthreadcore08:25:102
249930,0watchdog/20-21swapper/207:15:072
16659933,0cyclictest3556-21lldpd07:39:582
16659933,0cyclictest3241-21irqbalance08:37:122
16659932,0cyclictest3556-21lldpd08:29:572
16659932,0cyclictest20209-21awk09:00:072
16649933,0cyclictest3556-21lldpd11:11:011
16649932,0cyclictest3556-21lldpd12:16:061
16639933,0cyclictest932-21kworker/0:111:44:510
16639933,0cyclictest932-21kworker/0:111:40:010
16639933,0cyclictest932-21kworker/0:111:34:510
16639933,0cyclictest932-21kworker/0:111:25:090
16639933,0cyclictest5213-21kworker/0:010:59:560
16639933,0cyclictest5213-21kworker/0:010:49:560
16639933,0cyclictest2916-21kworker/0:210:44:540
16639933,0cyclictest23653-21kworker/0:010:24:540
16639933,0cyclictest23653-21kworker/0:009:34:540
16639933,0cyclictest23653-21kworker/0:009:29:540
169930,0watchdog/10-21swapper/112:00:261
169930,0watchdog/10-21swapper/111:55:101
149930,0migration/07195-21aten_r1power_vo12:20:020
29715020,0irq/26-eth0-rx-0-21swapper/309:05:053
29715020,0irq/26-eth0-rx-0-21swapper/307:45:053
29715020,0irq/26-eth0-rx-0-21swapper/307:35:043
169920,0watchdog/10-21swapper/108:55:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional