You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 13:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Jul 12, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1904923826,0sleep20-21swapper/206:45:452
1904923826,0sleep20-21swapper/206:45:452
1903523626,0sleep30-21swapper/306:45:343
1903523626,0sleep30-21swapper/306:45:343
1929623329,0sleep10-21swapper/106:48:361
1929623329,0sleep10-21swapper/106:48:361
1927123329,0sleep00-21swapper/006:48:190
1927123329,0sleep00-21swapper/006:48:190
194939976,0cyclictest25207-21ssh08:54:200
339960,0migration/320451-21gltestperf06:50:173
29715060,0irq/26-eth0-rx-31723-21sh11:15:363
149960,0migration/024702-21sh09:52:100
8215050,0irq/24-0000:00:9922-21cat09:25:012
8215050,0irq/24-0000:00:8372-21grep08:15:192
35150,0ktimersoftd/30-21swapper/311:09:433
339950,0migration/38315-21sh10:22:043
339950,0migration/37988-21taskset12:02:373
339950,0migration/37519-21kthreadcore08:40:203
339950,0migration/33308-21kthreadcore07:25:183
339950,0migration/330103-21kthreadcore11:35:183
339950,0migration/328956-21gltestperf07:45:153
339950,0migration/324023-21sh10:30:473
339950,0migration/323692-21munin-node09:50:233
339950,0migration/320282-21sshd07:13:473
339950,0migration/318449-21munin-node08:50:143
339950,0migration/318237-21munin-node11:50:173
339950,0migration/31757-21fschecks_time11:40:143
339950,0migration/316278-21kthreadcore07:35:193
339950,0migration/315650-21munin-node09:05:243
29725050,0irq/27-eth0-tx-921-21ssh09:18:172
29725050,0irq/27-eth0-tx-25945-21ssh12:15:152
29725050,0irq/27-eth0-tx-17768-21munin-node10:10:282
29725050,0irq/27-eth0-tx-16183-21ssh09:45:542
29725050,0irq/27-eth0-tx-1521-21munin-node07:25:250
29725050,0irq/27-eth0-tx-0-21swapper/008:37:330
29725050,0irq/27-eth0-tx-0-21swapper/008:30:160
29725050,0irq/27-eth0-tx-0-21swapper/007:02:150
29715050,0irq/26-eth0-rx-5818-21kthreadcore09:40:203
29715050,0irq/26-eth0-rx-4523-21kthreadcore09:20:193
29715050,0irq/26-eth0-rx-4388-21kthreadcore10:00:203
29715050,0irq/26-eth0-rx-31473-21ssh11:55:253
29715050,0irq/26-eth0-rx-31439-21port_sshpriv10:15:223
29715050,0irq/26-eth0-rx-31358-21mdstat09:55:193
29715050,0irq/26-eth0-rx-22953-21swap12:10:223
29715050,0irq/26-eth0-rx-13667-21cut11:45:193
29715050,0irq/26-eth0-rx-12463-21cut07:30:203
29715050,0irq/26-eth0-rx-0-21swapper/312:15:423
29715050,0irq/26-eth0-rx-0-21swapper/312:05:193
29715050,0irq/26-eth0-rx-0-21swapper/311:33:383
29715050,0irq/26-eth0-rx-0-21swapper/310:55:143
29715050,0irq/26-eth0-rx-0-21swapper/310:27:153
29715050,0irq/26-eth0-rx-0-21swapper/310:10:223
29715050,0irq/26-eth0-rx-0-21swapper/309:45:193
29715050,0irq/26-eth0-rx-0-21swapper/309:35:183
29715050,0irq/26-eth0-rx-0-21swapper/309:16:463
29715050,0irq/26-eth0-rx-0-21swapper/309:10:193
27150,0ktimersoftd/20-21swapper/212:13:152
27150,0ktimersoftd/20-21swapper/212:06:412
259950,0migration/231872-21sh09:35:232
259950,0migration/230131-21kthreadcore07:45:182
259950,0migration/226517-21irqcore11:55:172
259950,0migration/220698-21timerwakeupswit07:35:252
259950,0migration/210049-21idleruntime11:45:162
194969955,0cyclictest17562-21diskmemload11:53:042
194969955,0cyclictest0-21swapper/211:05:462
194969955,0cyclictest0-21swapper/210:42:362
194969955,0cyclictest0-21swapper/209:08:092
194969955,0cyclictest0-21swapper/208:40:242
194969950,0cyclictest0-21swapper/210:54:532
194969950,0cyclictest0-21swapper/210:36:552
194949955,0cyclictest25377-21ssh10:55:011
194949955,0cyclictest0-21swapper/110:26:471
194949955,0cyclictest0-21swapper/110:17:581
194949955,0cyclictest0-21swapper/109:28:181
194949950,0cyclictest0-21swapper/111:53:301
194949950,0cyclictest0-21swapper/111:16:461
194949950,0cyclictest0-21swapper/111:09:031
194939955,0cyclictest0-21swapper/012:18:120
194939955,0cyclictest0-21swapper/011:05:120
194939955,0cyclictest0-21swapper/009:36:260
194939950,0cyclictest0-21swapper/011:55:390
194939950,0cyclictest0-21swapper/010:40:360
194939950,0cyclictest0-21swapper/009:07:160
19150,0ktimersoftd/10-21swapper/112:06:411
179950,0migration/18703-21sh11:24:071
179950,0migration/16159-21kthreadcore11:00:201
179950,0migration/129516-21kthreadcore10:55:201
179950,0migration/127326-21kthreadcore09:55:181
179950,0migration/12287-21idleruntime10:20:151
179950,0migration/119733-21kthreadcore08:00:191
179950,0migration/115121-21munin-node10:45:211
149950,0migration/09964-21aten_r1power_fr09:45:130
149950,0migration/09482-21cpuspeed_turbos07:55:130
149950,0migration/08615-21sh09:21:570
149950,0migration/08201-21taskset09:01:260
149950,0migration/07968-21kthreadcore08:15:190
149950,0migration/07516-21runrttasks11:00:260
149950,0migration/05764-21kthreadcore10:20:190
149950,0migration/031741-21munin-node10:55:260
149950,0migration/030976-21kthreadcore10:35:200
149950,0migration/029945-21idleruntime08:10:160
149950,0migration/028272-21timerandwakeup08:05:250
149950,0migration/027528-21kthreadcore08:55:190
149950,0migration/025395-21latency_hist11:15:010
149950,0migration/025352-21sh10:54:570
149950,0migration/024503-21kthreadcore06:50:210
149950,0migration/022902-21kthreadcore07:15:180
149950,0migration/021480-21kthreadcore10:10:210
149950,0migration/020202-21kthreadcore08:00:190
149950,0migration/01229-21latency_hist10:20:010
149950,0migration/011890-21kthreadcore10:05:160
149950,0migration/010021-21sh09:25:110
339940,0migration/3681-21kthreadcore08:10:203
339940,0migration/36746-21latency11:00:203
339940,0migration/34754-21kthreadcore07:50:203
339940,0migration/33265-21kthreadcore10:40:193
339940,0migration/32906-21kthreadcore11:20:173
339940,0migration/32618-21kthreadcore07:00:193
339940,0migration/316270-21taskset08:21:543
339940,0migration/313627-21kthreadcore08:45:183
339940,0migration/311521-21kthreadcore10:05:163
29725040,0irq/27-eth0-tx-18446-21ssh11:10:172
29725040,0irq/27-eth0-tx-18226-21rm09:10:132
29725040,0irq/27-eth0-tx-0-21swapper/211:15:102
29725040,0irq/27-eth0-tx-0-21swapper/211:00:132
29725040,0irq/27-eth0-tx-0-21swapper/210:30:162
29725040,0irq/27-eth0-tx-0-21swapper/210:15:122
29725040,0irq/27-eth0-tx-0-21swapper/209:31:052
29725040,0irq/27-eth0-tx-0-21swapper/209:00:042
29725040,0irq/27-eth0-tx-0-21swapper/208:55:262
29725040,0irq/27-eth0-tx-0-21swapper/008:40:250
29725040,0irq/27-eth0-tx-0-21swapper/007:42:230
29725040,0irq/27-eth0-tx-0-21swapper/007:22:190
29715040,0irq/26-eth0-rx-25014-21kthreadcore08:30:193
29715040,0irq/26-eth0-rx-20690-21aten2.4-expect07:15:123
29715040,0irq/26-eth0-rx-0-21swapper/311:26:093
29715040,0irq/26-eth0-rx-0-21swapper/311:10:033
29715040,0irq/26-eth0-rx-0-21swapper/310:50:413
29715040,0irq/26-eth0-rx-0-21swapper/310:45:193
29715040,0irq/26-eth0-rx-0-21swapper/310:39:133
29715040,0irq/26-eth0-rx-0-21swapper/309:30:143
29715040,0irq/26-eth0-rx-0-21swapper/309:25:113
29715040,0irq/26-eth0-rx-0-21swapper/309:00:223
29715040,0irq/26-eth0-rx-0-21swapper/308:55:163
29715040,0irq/26-eth0-rx-0-21swapper/308:00:183
29715040,0irq/26-eth0-rx-0-21swapper/307:05:133
259940,0migration/29649-21latency_hist10:05:012
259940,0migration/2885-21latency_hist12:00:012
259940,0migration/28638-21runrttasks09:42:172
259940,0migration/2523-21latency_hist07:00:032
259940,0migration/24663-21kthreadcore11:40:182
259940,0migration/24398-21kthreadcore09:20:192
259940,0migration/232187-21kthreadcore08:35:202
259940,0migration/231304-21kthreadcore07:20:202
259940,0migration/231098-21kthreadcore09:55:192
259940,0migration/224142-21munin-node08:30:162
259940,0migration/223204-21fschecks_time08:05:162
259940,0migration/21663-21munin-node07:25:132
259940,0migration/215142-21needreboot10:25:202
259940,0migration/21304-21latency_hist10:20:012
259940,0migration/211423-21kthreadcore08:20:172
249940,0watchdog/23423-21kthreadcore10:00:202
249940,0watchdog/232113-21cat06:55:242
249940,0watchdog/228588-21kthreadcore10:55:192
249940,0watchdog/22048-21if_err_eth1.311:20:152
249940,0watchdog/217872-21ssh08:50:122
249940,0watchdog/20-21swapper/206:50:202
194969943,0cyclictest8210-21awk07:05:162
194969943,0cyclictest3556-21lldpd11:30:022
194969943,0cyclictest3556-21lldpd08:49:302
194969943,0cyclictest3556-21lldpd07:11:292
194969943,0cyclictest3514-21snmpd11:25:072
194969943,0cyclictest3514-21snmpd08:01:522
194969943,0cyclictest3514-21snmpd07:41:522
194969943,0cyclictest3241-21irqbalance11:35:292
194969943,0cyclictest3241-21irqbalance09:50:102
194969943,0cyclictest3241-21irqbalance07:50:202
194969943,0cyclictest21612-21awk07:15:162
194969943,0cyclictest10394-21awk10:45:152
194949944,0cyclictest0-21swapper/111:30:101
194949943,0cyclictest9105-21awk07:30:171
194949943,0cyclictest5333-21awk08:40:191
194949943,0cyclictest3514-21snmpd09:53:071
194949943,0cyclictest3514-21snmpd08:25:221
194949943,0cyclictest3241-21irqbalance11:10:101
194949943,0cyclictest3241-21irqbalance08:53:001
194949943,0cyclictest30025-21awk08:10:171
194949943,0cyclictest2697-21sed07:25:171
194949943,0cyclictest26133-21awk12:15:161
194949943,0cyclictest24281-21awk08:30:171
194949943,0cyclictest17551-21sadc08:50:011
194949943,0cyclictest10571-21awk10:05:141
194949940,0cyclictest0-21swapper/106:53:481
194939944,0cyclictest0-21swapper/012:00:130
194939944,0cyclictest0-21swapper/011:41:090
194939944,0cyclictest0-21swapper/011:30:540
194939944,0cyclictest0-21swapper/008:20:170
194939943,0cyclictest2718-21awk09:40:180
194939943,0cyclictest26890-21awk09:55:160
194939943,0cyclictest19071-21awk09:10:170
194939943,0cyclictest18968-21awk09:30:160
194939943,0cyclictest12038-21awk08:45:160
194939943,0cyclictest10315-21awk11:25:170
194939940,0cyclictest26353-21munin-node06:55:150
179940,0migration/17232-21mdstat09:40:211
179940,0migration/130786-21kthreadcore10:35:191
179940,0migration/127991-21taskset07:45:011
179940,0migration/12521-21kthreadcore11:40:181
179940,0migration/124269-21munin-node09:10:271
179940,0migration/122436-21kthreadcore12:10:171
179940,0migration/12167-21taskset07:49:171
179940,0migration/120158-21taskset07:12:191
179940,0migration/11979-21if_eth1.312:00:161
179940,0migration/119451-21kthreadcore09:30:181
179940,0migration/118614-21diskmemload10:30:171
179940,0migration/115910-21runrttasks07:35:181
179940,0migration/11408-21idleruntime07:00:171
179940,0migration/110134-21cpuspeed_turbos09:05:141
169940,0watchdog/19167-21ssh10:44:471
169940,0watchdog/18386-21ssh09:02:001
169940,0watchdog/13424-21kthreadcore10:00:201
169940,0watchdog/132564-21kthreadcore08:35:201
169940,0watchdog/131645-21ssh11:55:511
169940,0watchdog/13129-21perl07:50:161
169940,0watchdog/130932-21kthreadcore08:55:201
169940,0watchdog/127234-21kthreadcore08:05:201
169940,0watchdog/125453-21ssh11:35:111
169940,0watchdog/117562-21diskmemload09:35:241
169940,0watchdog/11462-21ssh09:19:481
169940,0watchdog/10-21swapper/111:45:191
169940,0watchdog/10-21swapper/111:25:191
169940,0watchdog/10-21swapper/107:15:241
149940,0migration/027510-21kthreadcore11:35:170
149940,0migration/027238-21runrttasks09:15:180
149940,0migration/023015-21processes11:50:230
149940,0migration/021208-21kthreadcore12:10:170
149940,0migration/014619-21kthreadcore10:45:190
149940,0migration/012760-21ntp_kernel_pll_07:05:210
149940,0migration/012307-21kthreadcore12:05:190
29725030,0irq/27-eth0-tx-0-21swapper/007:45:130
29725030,0irq/27-eth0-tx-0-21swapper/007:10:170
29715030,0irq/26-eth0-rx-0-21swapper/308:35:153
29715030,0irq/26-eth0-rx-0-21swapper/307:55:133
194969932,0cyclictest9135-21awk07:30:172
194969932,0cyclictest30049-21awk08:10:172
194969932,0cyclictest17666-21awk08:25:172
194969932,0cyclictest10108-21awk07:55:162
194949932,0cyclictest3241-21irqbalance06:55:211
194949932,0cyclictest31292-21kthreadcore07:20:201
194949932,0cyclictest2776-21awk09:20:171
194949932,0cyclictest20645-21grep10:10:211
194949932,0cyclictest14675-21ntpq07:55:211
194949932,0cyclictest11269-21cut07:05:191
194939932,0cyclictest2479-21munin-node07:50:270
194939932,0cyclictest23996-21ssh11:11:300
194939932,0cyclictest18598-21awk10:30:170
194939932,0cyclictest13891-21sendmail_mailst07:30:240
194939932,0cyclictest11755-21kthreadcore10:25:180
194939932,0cyclictest10225-21awk11:45:170
194939930,0cyclictest3607-21grep11:20:170
194939930,0cyclictest15305-21diskstats07:35:150
19130,0ktimersoftd/10-21swapper/108:19:341
169930,0watchdog/10-21swapper/109:45:161
149930,0migration/08043-21ksmtuned10:01:030
29715020,0irq/26-eth0-rx-0-21swapper/308:25:133
29715020,0irq/26-eth0-rx-0-21swapper/308:15:253
29715020,0irq/26-eth0-rx-0-21swapper/308:05:063
29715020,0irq/26-eth0-rx-0-21swapper/307:40:023
29715020,0irq/26-eth0-rx-0-21swapper/307:20:073
29715020,0irq/26-eth0-rx-0-21swapper/306:55:143
194949920,0cyclictest0-21swapper/108:20:011
194939921,0cyclictest0-21swapper/008:25:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional