You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 18:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Sep 02, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3044501040,0irq/25-eth10-21swapper/306:41:313
1956426463,0sleep00-21swapper/006:44:300
1935424948,0sleep10-21swapper/106:42:031
1959823726,0sleep20-21swapper/206:44:562
196869970,0cyclictest21396-21ssh11:06:171
196869970,0cyclictest0-21swapper/109:51:331
339960,0migration/38565-21kthreadcore12:00:203
339960,0migration/36645-21switchtime06:55:283
339960,0migration/35800-21sh10:35:393
339960,0migration/34147-21sh11:35:333
339960,0migration/315060-21sh10:22:563
339960,0migration/314500-21sh10:42:553
339960,0migration/313257-21sh11:00:473
29715060,0irq/26-eth0-rx-6120-21kthreadcore09:15:223
29715060,0irq/26-eth0-rx-28961-21munin-run12:15:033
29715060,0irq/26-eth0-rx-25176-21ls06:45:223
29715060,0irq/26-eth0-rx-11905-21memory11:20:203
196869960,0cyclictest0-21swapper/109:31:031
196859966,0cyclictest10-21rcuc/009:10:260
196859965,0cyclictest25891-21tail10:10:200
196859960,0cyclictest0-21swapper/010:15:140
149960,0migration/05327-21sh10:55:580
149960,0migration/016763-21taskset09:23:310
149960,0migration/015086-21sh10:44:410
8215050,0irq/24-0000:00:3448-21kthreadcore09:35:202
8215050,0irq/24-0000:00:15947-21latency_hist07:55:052
8215050,0irq/24-0000:00:13996-21turbostat07:05:052
4150,0ktimersoftd/00-21swapper/011:54:540
339950,0migration/34882-21kthreadcore09:55:223
339950,0migration/33138-21taskset08:05:353
339950,0migration/330768-21munin-node08:30:183
339950,0migration/330648-21kthreadcore09:10:233
339950,0migration/329438-21sh11:33:173
339950,0migration/327692-21munin-node10:10:213
339950,0migration/325640-21kthreadcore08:25:203
339950,0migration/323445-21fschecks_time08:00:193
339950,0migration/322590-21munin-node11:50:183
339950,0migration/321789-21latency_hist07:35:053
339950,0migration/320783-21latency_hist07:10:053
339950,0migration/320502-21taskset07:08:323
339950,0migration/319778-21switchtime11:45:263
339950,0migration/319083-21kthreadcore09:45:213
339950,0migration/316376-21kthreadcore11:05:203
339950,0migration/312239-21kthreadcore09:20:223
339950,0migration/310865-21kthreadcore07:25:223
339950,0migration/310506-21aten_r1power_cu08:15:153
29725050,0irq/27-eth0-tx-32561-21ssh08:51:202
29725050,0irq/27-eth0-tx-2620-21kthreadcore11:55:212
29725050,0irq/27-eth0-tx-24318-21ssh08:45:380
29725050,0irq/27-eth0-tx-22401-21munin-node11:30:242
29725050,0irq/27-eth0-tx-21369-21ssh11:06:122
29725050,0irq/27-eth0-tx-0-21swapper/212:12:152
29725050,0irq/27-eth0-tx-0-21swapper/211:23:472
29725050,0irq/27-eth0-tx-0-21swapper/210:56:032
29725050,0irq/27-eth0-tx-0-21swapper/210:11:472
29725050,0irq/27-eth0-tx-0-21swapper/209:25:182
29725050,0irq/27-eth0-tx-0-21swapper/008:40:170
29725050,0irq/27-eth0-tx-0-21swapper/008:16:270
29725050,0irq/27-eth0-tx-0-21swapper/007:35:160
29715050,0irq/26-eth0-rx-9654-21if_eth1.210:00:203
29715050,0irq/26-eth0-rx-27122-21cut10:50:233
29715050,0irq/26-eth0-rx-27034-21kthreadcore09:30:223
29715050,0irq/26-eth0-rx-14021-21cut12:05:173
29715050,0irq/26-eth0-rx-12732-21kthreadcore09:00:223
29715050,0irq/26-eth0-rx-0-21swapper/311:59:463
29715050,0irq/26-eth0-rx-0-21swapper/311:42:413
29715050,0irq/26-eth0-rx-0-21swapper/311:13:283
29715050,0irq/26-eth0-rx-0-21swapper/310:55:213
29715050,0irq/26-eth0-rx-0-21swapper/310:45:453
29715050,0irq/26-eth0-rx-0-21swapper/310:31:103
29715050,0irq/26-eth0-rx-0-21swapper/310:05:343
29715050,0irq/26-eth0-rx-0-21swapper/309:36:213
29715050,0irq/26-eth0-rx-0-21swapper/309:08:393
29715050,0irq/26-eth0-rx-0-21swapper/308:46:333
29715050,0irq/26-eth0-rx-0-21swapper/308:40:163
27150,0ktimersoftd/20-21swapper/209:13:462
259950,0migration/2375-21munin-node10:35:182
259950,0migration/227216-21kthreadcore08:25:212
259950,0migration/219349-21missed_timers11:45:222
259950,0migration/21789-21kthreadcore10:15:202
259950,0migration/215465-21munin-node09:00:232
259950,0migration/212794-21munin-node11:00:262
259950,0migration/212181-21kthreadcore07:25:222
249950,0watchdog/25394-21kthreadcore07:20:232
249950,0watchdog/232757-21ssh09:33:422
249950,0watchdog/22184-21cut08:30:232
249950,0watchdog/219418-21kthreadcore07:05:232
249950,0watchdog/214881-21grep09:20:222
196879955,0cyclictest0-21swapper/211:44:102
196879955,0cyclictest0-21swapper/211:15:292
196879955,0cyclictest0-21swapper/210:30:042
196879950,0cyclictest0-21swapper/212:02:472
196879950,0cyclictest0-21swapper/210:02:102
196879950,0cyclictest0-21swapper/208:58:382
196869955,0cyclictest0-21swapper/111:58:561
196869950,0cyclictest0-21swapper/111:18:531
196869950,0cyclictest0-21swapper/111:13:511
196869950,0cyclictest0-21swapper/109:23:011
196859955,0cyclictest0-21swapper/009:58:120
196859952,0cyclictest0-21swapper/011:45:030
196859950,0cyclictest0-21swapper/006:50:260
19150,0ktimersoftd/10-21swapper/111:54:541
179950,0migration/18614-21latency_hist10:00:041
179950,0migration/131875-21missed_timers06:50:221
179950,0migration/130830-21sh10:54:161
179950,0migration/119177-21kthreadcore10:25:221
179950,0migration/118424-21kthreadcore10:45:221
179950,0migration/110832-21idleruntime09:00:191
169950,0watchdog/16909-21df_inode11:20:141
149950,0migration/0712-21munin-node07:15:270
149950,0migration/05039-21kthreadcore09:15:210
149950,0migration/04248-21kthreadcore06:55:220
149950,0migration/03886-21irqcore07:45:210
149950,0migration/032025-21sh09:31:290
149950,0migration/030049-21runrttasks08:28:200
149950,0migration/029557-21kthreadcore09:50:230
149950,0migration/027942-21kthreadcore10:30:230
149950,0migration/027903-21munin-node11:30:230
149950,0migration/026300-21kthreadcore11:10:200
149950,0migration/026300-21kthreadcore10:50:230
149950,0migration/023504-21kthreadcore07:10:220
149950,0migration/022318-21kthreadcore06:45:210
149950,0migration/022142-21kthreadcore08:20:220
149950,0migration/018015-21kthreadcore10:45:210
149950,0migration/017625-21kthreadcore07:55:210
149950,0migration/012412-21kthreadcore09:40:210
149950,0migration/010331-21kthreadcore10:20:200
8215040,0irq/24-0000:00:0-21swapper/210:50:042
339940,0migration/35794-21kthreadcore07:20:233
339940,0migration/321591-21runrttasks07:34:503
339940,0migration/313062-21pmu-power07:00:253
339940,0migration/31249-21taskset07:16:523
339940,0migration/311665-21kthreadcore09:40:213
29725040,0irq/27-eth0-tx-23819-21kthreadcore11:50:222
29725040,0irq/27-eth0-tx-18763-21ssh12:05:222
29725040,0irq/27-eth0-tx-0-21swapper/211:10:382
29725040,0irq/27-eth0-tx-0-21swapper/210:45:162
29725040,0irq/27-eth0-tx-0-21swapper/210:40:202
29725040,0irq/27-eth0-tx-0-21swapper/210:26:212
29725040,0irq/27-eth0-tx-0-21swapper/210:05:432
29725040,0irq/27-eth0-tx-0-21swapper/209:50:072
29725040,0irq/27-eth0-tx-0-21swapper/209:45:102
29725040,0irq/27-eth0-tx-0-21swapper/208:49:012
29725040,0irq/27-eth0-tx-0-21swapper/007:50:240
29725040,0irq/27-eth0-tx-0-21swapper/007:40:230
29725040,0irq/27-eth0-tx-0-21swapper/007:00:180
29715040,0irq/26-eth0-rx-0-21swapper/311:26:173
29715040,0irq/26-eth0-rx-0-21swapper/311:15:233
29715040,0irq/26-eth0-rx-0-21swapper/310:27:163
29715040,0irq/26-eth0-rx-0-21swapper/310:15:173
29715040,0irq/26-eth0-rx-0-21swapper/309:52:083
29715040,0irq/26-eth0-rx-0-21swapper/309:25:373
29715040,0irq/26-eth0-rx-0-21swapper/308:56:453
29715040,0irq/26-eth0-rx-0-21swapper/308:50:463
29715040,0irq/26-eth0-rx-0-21swapper/308:20:173
29715040,0irq/26-eth0-rx-0-21swapper/308:10:233
29715040,0irq/26-eth0-rx-0-21swapper/307:40:123
259940,0migration/26552-21sendmail_mailqu06:55:262
259940,0migration/24706-21kthreadcore07:45:212
259940,0migration/230238-21latency_hist11:35:032
259940,0migration/222336-21taskset07:35:182
259940,0migration/215208-21aten_r1power_cu07:30:162
259940,0migration/214916-21fschecks_count11:25:172
259940,0migration/212249-21kthreadcore10:20:212
259940,0migration/211804-21kthreadcore07:50:212
196879943,0cyclictest3556-21lldpd09:40:482
196879943,0cyclictest3514-21snmpd09:16:362
196879943,0cyclictest3514-21snmpd08:43:212
196879943,0cyclictest3514-21snmpd08:35:062
196879943,0cyclictest3514-21snmpd08:20:062
196879943,0cyclictest3514-21snmpd08:10:062
196879943,0cyclictest3514-21snmpd08:04:212
196879943,0cyclictest3514-21snmpd07:18:362
196879943,0cyclictest3514-21snmpd07:12:512
196879943,0cyclictest27479-21awk06:50:192
196879943,0cyclictest20803-21awk06:45:192
196879943,0cyclictest19092-21awk09:05:202
196879943,0cyclictest1495-21awk09:55:182
196869944,0cyclictest0-21swapper/112:00:211
196869943,0cyclictest8561-21awk10:40:181
196869943,0cyclictest4743-21awk08:10:211
196869943,0cyclictest3556-21lldpd10:20:181
196869943,0cyclictest3556-21lldpd09:10:181
196869943,0cyclictest3514-21snmpd11:38:361
196869943,0cyclictest3514-21snmpd10:57:361
196869943,0cyclictest3514-21snmpd10:15:361
196869943,0cyclictest3514-21snmpd10:10:361
196869943,0cyclictest3514-21snmpd09:38:361
196869943,0cyclictest3514-21snmpd09:28:361
196869943,0cyclictest3514-21snmpd08:55:361
196869943,0cyclictest3514-21snmpd08:26:211
196869943,0cyclictest3514-21snmpd08:22:361
196869943,0cyclictest3514-21snmpd08:18:361
196869943,0cyclictest3514-21snmpd08:08:361
196869943,0cyclictest3514-21snmpd07:48:361
196869943,0cyclictest3514-21snmpd07:41:361
196869943,0cyclictest3514-21snmpd06:56:501
196869943,0cyclictest3241-21irqbalance11:45:121
196869943,0cyclictest3241-21irqbalance07:50:231
196869943,0cyclictest28366-21awk07:15:191
196869943,0cyclictest26950-21awk08:50:181
196869943,0cyclictest2625-21awk09:15:201
196869943,0cyclictest2616-21awk07:20:201
196869943,0cyclictest24901-21awk10:30:201
196869943,0cyclictest17841-21grep10:05:201
196869943,0cyclictest16108-21awk07:30:201
196869943,0cyclictest14286-21awk12:05:191
196869943,0cyclictest10114-21awk09:40:191
196859944,0cyclictest0-21swapper/012:12:310
196859944,0cyclictest0-21swapper/012:04:200
196859944,0cyclictest0-21swapper/011:02:120
196859943,0cyclictest9456-21awk07:25:200
196859943,0cyclictest3556-21lldpd10:00:480
196859943,0cyclictest3514-21snmpd09:06:510
196859943,0cyclictest3514-21snmpd09:03:060
196859943,0cyclictest3241-21irqbalance11:15:220
196859943,0cyclictest3241-21irqbalance11:08:120
196859943,0cyclictest3241-21irqbalance10:36:420
196859943,0cyclictest3241-21irqbalance10:27:220
196859943,0cyclictest31193-21awk11:35:180
196859943,0cyclictest17991-21awk09:45:180
196859943,0cyclictest17895-21kworker/0:112:06:590
19140,0ktimersoftd/10-21swapper/107:03:291
179940,0migration/13516-21kthreadcore09:55:221
179940,0migration/126600-21kthreadcore11:30:211
179940,0migration/123147-21kernelversion07:35:211
179940,0migration/123121-21kthreadcore06:45:211
179940,0migration/121198-21munin-node07:10:171
179940,0migration/120675-21kthreadcore09:05:221
179940,0migration/120507-21kthreadcore08:45:211
179940,0migration/119596-21kthreadcore09:45:211
179940,0migration/11859-21kthreadcore10:35:201
179940,0migration/117326-21irqcore07:55:211
179940,0migration/115910-21kthreadcore07:05:221
179940,0migration/115606-21irqcore11:25:201
179940,0migration/112027-21fschecks_time08:40:181
169940,0watchdog/19892-21kthreadcore08:35:231
169940,0watchdog/111715-21python11:40:261
169940,0watchdog/10-21swapper/108:00:231
149940,0migration/08725-21kthreadcore08:35:220
149940,0migration/0789-21kthreadcore08:05:210
149940,0migration/03664-21kthreadcore09:35:200
149940,0migration/030596-21kthreadcore08:50:210
149940,0migration/022704-21kthreadcore09:25:220
149940,0migration/02264-21fschecks_count07:20:190
149940,0migration/017967-21kthreadcore11:45:210
149940,0migration/011631-21kthreadcore11:20:190
29715030,0irq/26-eth0-rx-0-21swapper/308:35:173
29715030,0irq/26-eth0-rx-0-21swapper/307:55:063
29715030,0irq/26-eth0-rx-0-21swapper/307:50:153
29715030,0irq/26-eth0-rx-0-21swapper/306:50:153
196879932,0cyclictest3514-21snmpd08:17:362
196879932,0cyclictest3514-21snmpd08:05:212
196879932,0cyclictest3514-21snmpd07:40:062
196869932,0cyclictest3514-21snmpd07:28:361
196869930,0cyclictest30855-21awk08:30:181
196859933,0cyclictest17895-21kworker/0:111:55:070
196859933,0cyclictest17895-21kworker/0:111:25:090
196859933,0cyclictest17895-21kworker/0:110:05:090
196859933,0cyclictest12773-21kworker/0:208:55:080
196859933,0cyclictest12773-21kworker/0:208:30:180
196859933,0cyclictest12773-21kworker/0:208:10:120
196859933,0cyclictest12773-21kworker/0:208:00:120
196859933,0cyclictest12773-21kworker/0:207:05:160
196859930,0cyclictest15778-21fschecks_time07:30:180
169930,0watchdog/10-21swapper/112:10:261
169930,0watchdog/10-21swapper/111:00:101
29715020,0irq/26-eth0-rx-0-21swapper/307:45:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional