You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 18:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Tue May 12, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
234423626,0sleep30-21swapper/306:53:263
219423627,0sleep20-21swapper/206:51:372
3245823228,0sleep00-21swapper/006:51:110
242823119,0sleep10-21swapper/106:54:241
339960,0migration/3894-21irqcore11:56:053
339960,0migration/37697-21sh11:40:153
339960,0migration/323954-21sh09:47:033
339960,0migration/323582-21sh10:06:393
339960,0migration/316720-21sh09:44:233
339960,0migration/316123-21sh11:05:153
29725060,0irq/27-eth0-tx-2854-21munin-node06:56:120
29715060,0irq/26-eth0-rx-22241-21grep09:26:083
26399965,0cyclictest25594-21munin-node11:31:061
26399960,0cyclictest0-21swapper/111:36:191
26379960,0cyclictest0-21swapper/010:31:050
149960,0migration/025491-21idleruntime11:11:050
149960,0migration/015229-21sh10:21:240
149960,0migration/013931-21ntp_offset11:21:110
339950,0migration/39258-21taskset06:59:153
339950,0migration/38458-21aten_r1power_en11:21:033
339950,0migration/38190-21sh11:41:013
339950,0migration/37249-21munin-node09:36:123
339950,0migration/36308-21df_abs08:11:033
339950,0migration/332246-21aten_r1power_vo12:16:013
339950,0migration/332219-21taskset09:11:453
339950,0migration/331489-21taskset11:54:233
339950,0migration/33027-21kthreadcore09:16:073
339950,0migration/326629-21kthreadcore07:36:093
339950,0migration/325820-21aten2.4-expect09:31:013
339950,0migration/324443-21kthreadcore07:11:093
339950,0migration/321793-21munin-node12:06:113
339950,0migration/317238-21latency_hist07:30:513
339950,0migration/317009-21kthreadcore08:41:083
339950,0migration/312610-21kthreadcore10:01:083
339950,0migration/311814-21kthreadcore07:01:073
339950,0migration/310224-21fschecks_count09:21:043
29725050,0irq/27-eth0-tx-9037-21munin-node10:21:152
29725050,0irq/27-eth0-tx-8205-21munin-node11:41:102
29725050,0irq/27-eth0-tx-7224-21ssh11:38:522
29725050,0irq/27-eth0-tx-30641-21kthreadcore09:51:092
29725050,0irq/27-eth0-tx-24543-21ssh10:09:272
29725050,0irq/27-eth0-tx-24060-21munin-node12:11:012
29725050,0irq/27-eth0-tx-23419-21ssh10:47:262
29725050,0irq/27-eth0-tx-17781-21munin-node09:26:032
29725050,0irq/27-eth0-tx-17077-21munin-node10:26:132
29725050,0irq/27-eth0-tx-16181-21munin-node11:46:072
29725050,0irq/27-eth0-tx-1115-21munin-node08:56:100
29725050,0irq/27-eth0-tx-0-21swapper/211:52:142
29725050,0irq/27-eth0-tx-0-21swapper/211:26:102
29725050,0irq/27-eth0-tx-0-21swapper/210:53:072
29725050,0irq/27-eth0-tx-0-21swapper/209:07:442
29725050,0irq/27-eth0-tx-0-21swapper/008:31:080
29715050,0irq/26-eth0-rx-7981-21ssh09:57:553
29715050,0irq/26-eth0-rx-6402-21python10:56:133
29715050,0irq/26-eth0-rx-31560-21ssh10:52:503
29715050,0irq/26-eth0-rx-30877-21ssh10:11:103
29715050,0irq/26-eth0-rx-27132-21cut10:31:073
29715050,0irq/26-eth0-rx-24192-21sh10:28:583
29715050,0irq/26-eth0-rx-0-21swapper/312:24:303
29715050,0irq/26-eth0-rx-0-21swapper/312:11:573
29715050,0irq/26-eth0-rx-0-21swapper/312:01:073
29715050,0irq/26-eth0-rx-0-21swapper/311:16:123
29715050,0irq/26-eth0-rx-0-21swapper/311:10:563
29715050,0irq/26-eth0-rx-0-21swapper/311:06:153
29715050,0irq/26-eth0-rx-0-21swapper/310:43:133
29715050,0irq/26-eth0-rx-0-21swapper/310:16:073
29715050,0irq/26-eth0-rx-0-21swapper/309:51:093
29715050,0irq/26-eth0-rx-0-21swapper/309:01:023
29715050,0irq/26-eth0-rx-0-21swapper/308:59:373
26409955,0cyclictest0-21swapper/210:16:142
26399955,0cyclictest0-21swapper/110:45:331
26399955,0cyclictest0-21swapper/109:30:581
26399950,0cyclictest0-21swapper/111:18:111
26399950,0cyclictest0-21swapper/110:16:411
26399950,0cyclictest0-21swapper/109:06:321
26399950,0cyclictest0-21swapper/106:56:091
26379955,0cyclictest16951-21kworker/0:209:21:160
26379950,0cyclictest0-21swapper/011:47:140
26379950,0cyclictest0-21swapper/009:10:500
259950,0migration/29414-21fschecks_count10:41:042
259950,0migration/26835-21sh11:58:112
259950,0migration/25537-21kthreadcore11:16:082
259950,0migration/24838-21munin-node07:21:072
259950,0migration/232246-21latency_hist11:35:502
259950,0migration/231273-21needreboot08:26:102
259950,0migration/221392-21munin-node12:06:072
259950,0migration/218677-21munin-node07:56:032
259950,0migration/215188-21missed_timers09:21:102
259950,0migration/21491-21df_abs09:56:042
259950,0migration/213546-21munin-node08:41:012
259950,0migration/213463-21missed_timers12:01:082
249950,0watchdog/28654-21munin-node11:01:122
249950,0watchdog/226247-21kthreadcore07:36:092
249950,0watchdog/210630-21kthreadcore08:36:092
19150,0ktimersoftd/10-21swapper/112:19:111
19150,0ktimersoftd/10-21swapper/109:28:361
179950,0migration/17411-21runrttasks09:56:171
179950,0migration/132245-21taskset08:29:591
179950,0migration/13134-21kthreadcore08:06:061
179950,0migration/12622-21munin-node07:16:121
179950,0migration/118204-21latency_hist07:55:511
179950,0migration/117023-21munin-run10:05:501
179950,0migration/117018-21munin-node12:06:051
179950,0migration/116378-21munin-node07:06:041
179950,0migration/115258-21runrttasks10:21:281
179950,0migration/11490-21munin-node09:36:021
169950,0watchdog/127050-21cat08:01:091
169950,0watchdog/124301-21kthreadcore07:11:091
169950,0watchdog/118482-21cut10:46:081
149950,0migration/09074-21sh11:41:070
149950,0migration/08612-21taskset09:59:440
149950,0migration/07975-21taskset09:37:130
149950,0migration/06994-21kthreadcore07:21:090
149950,0migration/05434-21kthreadcore09:16:080
149950,0migration/04649-21kthreadcore10:16:070
149950,0migration/032165-21kthreadcore07:41:070
149950,0migration/029424-21kthreadcore09:31:080
149950,0migration/027419-21runrttasks09:51:080
149950,0migration/026017-21kthreadcore11:51:090
149950,0migration/025831-21fschecks_count10:11:030
149950,0migration/023670-21missed_timers07:56:090
149950,0migration/021883-21munin-node07:06:130
149950,0migration/020110-21kthreadcore10:26:080
149950,0migration/018223-21fschecks_time09:46:050
149950,0migration/017300-21sh07:31:030
149950,0migration/016825-21sh10:45:580
149950,0migration/016374-21kthreadcore08:41:070
149950,0migration/01555-21kthreadcore12:16:060
149950,0migration/014088-21kthreadcore07:01:080
149950,0migration/011609-21kthreadcore09:41:080
149950,0migration/010910-21kthreadcore12:21:080
149950,0migration/010552-21kthreadcore08:11:080
149950,0migration/010308-21kthreadcore11:01:070
8215040,0irq/24-0000:00:0-21swapper/208:30:512
339940,0migration/38971-21diskmemload10:20:513
339940,0migration/38704-21kthreadcore07:21:103
339940,0migration/38662-21kthreadcore07:46:093
339940,0migration/330761-21irqrtprio07:16:093
339940,0migration/329435-21kthreadcore08:26:083
339940,0migration/322780-21kthreadcore08:46:093
339940,0migration/322648-21diskmemload11:47:033
339940,0migration/32063-21kthreadcore07:41:073
339940,0migration/318074-21fschecks_count09:06:043
29725040,0irq/27-eth0-tx-0-21swapper/212:16:072
29725040,0irq/27-eth0-tx-0-21swapper/210:31:132
29725040,0irq/27-eth0-tx-0-21swapper/210:10:532
29725040,0irq/27-eth0-tx-0-21swapper/210:00:572
29725040,0irq/27-eth0-tx-0-21swapper/209:45:552
29725040,0irq/27-eth0-tx-0-21swapper/209:40:542
29725040,0irq/27-eth0-tx-0-21swapper/209:36:052
29725040,0irq/27-eth0-tx-0-21swapper/209:31:132
29725040,0irq/27-eth0-tx-0-21swapper/209:15:572
29715040,0irq/26-eth0-rx-16117-21latency_hist11:25:503
29715040,0irq/26-eth0-rx-0-21swapper/311:31:373
29715040,0irq/26-eth0-rx-0-21swapper/310:45:523
29715040,0irq/26-eth0-rx-0-21swapper/310:37:253
29715040,0irq/26-eth0-rx-0-21swapper/308:24:273
26409943,0cyclictest9394-21awk11:21:072
26409943,0cyclictest3556-21lldpd09:01:292
26409943,0cyclictest3514-21snmpd10:56:042
26409943,0cyclictest3514-21snmpd08:52:192
26409943,0cyclictest3514-21snmpd08:23:342
26409943,0cyclictest3514-21snmpd08:17:042
26409943,0cyclictest3514-21snmpd08:06:042
26409943,0cyclictest3514-21snmpd07:44:342
26409943,0cyclictest3514-21snmpd07:33:342
26409943,0cyclictest3514-21snmpd07:01:342
26409943,0cyclictest26735-21awk09:11:052
26409943,0cyclictest25932-21awk08:01:082
26409943,0cyclictest2009-21awk08:56:072
26409943,0cyclictest1703-21awk10:36:052
26399944,0cyclictest0-21swapper/112:21:521
26399944,0cyclictest0-21swapper/112:15:241
26399944,0cyclictest0-21swapper/111:59:571
26399944,0cyclictest0-21swapper/111:52:041
26399944,0cyclictest0-21swapper/111:44:111
26399943,0cyclictest6864-21awk08:11:061
26399943,0cyclictest3556-21lldpd08:40:581
26399943,0cyclictest3556-21lldpd08:35:591
26399943,0cyclictest3556-21lldpd08:21:581
26399943,0cyclictest3241-21irqbalance11:26:381
26399943,0cyclictest3241-21irqbalance10:39:491
26399943,0cyclictest3241-21irqbalance09:50:091
26399943,0cyclictest3241-21irqbalance07:41:091
26399943,0cyclictest2630-21awk09:16:061
26399940,0cyclictest0-21swapper/109:42:391
26379944,0cyclictest16951-21kworker/0:212:11:250
26379944,0cyclictest16951-21kworker/0:212:06:130
26379944,0cyclictest16951-21kworker/0:211:35:550
26379944,0cyclictest16951-21kworker/0:211:32:170
26379944,0cyclictest16951-21kworker/0:211:26:050
26379944,0cyclictest16951-21kworker/0:211:16:000
26379944,0cyclictest16951-21kworker/0:211:05:580
26379944,0cyclictest16951-21kworker/0:210:51:340
26379944,0cyclictest16951-21kworker/0:210:41:480
26379944,0cyclictest16951-21kworker/0:210:37:140
26379944,0cyclictest16951-21kworker/0:210:08:520
26379944,0cyclictest16951-21kworker/0:210:03:100
26379944,0cyclictest16951-21kworker/0:209:26:000
26379944,0cyclictest16951-21kworker/0:209:01:140
26379944,0cyclictest16951-21kworker/0:208:50:540
26379944,0cyclictest16951-21kworker/0:208:45:520
26379944,0cyclictest16951-21kworker/0:208:16:260
26379944,0cyclictest16951-21kworker/0:207:46:340
26379944,0cyclictest16951-21kworker/0:207:36:140
26379944,0cyclictest16951-21kworker/0:207:15:520
26379944,0cyclictest16951-21kworker/0:207:11:200
26379943,0cyclictest7793-21awk08:36:070
26379943,0cyclictest26867-21awk08:26:060
26379943,0cyclictest26840-21awk09:11:060
26379943,0cyclictest11480-21awk07:26:070
259940,0migration/225262-21fschecks_time11:11:042
259940,0migration/220436-21cpuspeed_turbos08:46:042
259940,0migration/218609-21kthreadcore07:06:092
259940,0migration/214600-21kthreadcore07:51:082
259940,0migration/214357-21kthreadcore07:26:092
249940,0watchdog/28463-21fschecks_time12:21:042
249940,0watchdog/27989-21kthreadcore07:46:092
249940,0watchdog/222387-21sensors11:06:122
249940,0watchdog/20-21swapper/207:16:092
249940,0watchdog/20-21swapper/207:11:092
249940,0watchdog/20-21swapper/206:56:092
179940,0migration/19249-21latency_hist09:00:511
179940,0migration/1517-21fschecks_count08:31:041
179940,0migration/118263-21taskset10:06:051
179940,0migration/118144-21latency_hist07:55:511
179940,0migration/114852-21missed_timers09:01:091
179940,0migration/113177-21kthreadcore07:26:091
179940,0migration/112084-21kthreadcore09:21:081
179940,0migration/112028-21kthreadcore12:01:071
169940,0watchdog/17990-21kthreadcore07:46:091
169940,0watchdog/126249-21kthreadcore07:36:091
169940,0watchdog/121562-21grep11:06:081
169940,0watchdog/116126-21ssh11:45:521
169940,0watchdog/115696-21ssh11:24:401
169940,0watchdog/114370-21ssh11:01:121
169940,0watchdog/11307-21ssh10:56:041
169940,0watchdog/10-21swapper/111:11:081
169940,0watchdog/10-21swapper/110:51:081
149940,0migration/0560-21kthreadcore08:06:060
149940,0migration/04482-21kthreadcore11:56:070
149940,0migration/03590-21kthreadcore10:56:080
149940,0migration/026780-21kthreadcore08:01:090
149940,0migration/021961-21kthreadcore08:21:070
149940,0migration/013811-21kthreadcore07:51:070
149940,0migration/011061-21kthreadcore12:01:070
29715030,0irq/26-eth0-rx-0-21swapper/308:36:033
29715030,0irq/26-eth0-rx-0-21swapper/308:31:363
29715030,0irq/26-eth0-rx-0-21swapper/308:16:013
29715030,0irq/26-eth0-rx-0-21swapper/308:06:013
29715030,0irq/26-eth0-rx-0-21swapper/308:01:043
29715030,0irq/26-eth0-rx-0-21swapper/307:56:163
29715030,0irq/26-eth0-rx-0-21swapper/307:51:063
29715030,0irq/26-eth0-rx-0-21swapper/307:26:033
26409933,0cyclictest6879-21awk08:11:062
26399932,0cyclictest4743-21awk07:21:061
26399932,0cyclictest3556-21lldpd08:15:581
26399932,0cyclictest26209-21awk10:11:051
26399932,0cyclictest26180-21tail10:31:061
26399932,0cyclictest25688-21basename09:51:031
26399932,0cyclictest21070-21awk08:46:071
26399932,0cyclictest18139-21awk07:31:081
26399930,0cyclictest0-21swapper/107:04:021
179930,0migration/127733-21if_err_eth1.208:51:051
169930,0watchdog/10-21swapper/110:26:091
169930,0watchdog/10-21swapper/109:10:571
329920,0watchdog/326963-21munin-node08:51:023
29715020,0irq/26-eth0-rx-0-21swapper/307:06:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional