You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 20:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Aug 13, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450810,0irq/25-eth10-21swapper/306:43:403
1687327574,0sleep10-21swapper/106:43:481
1678126665,0sleep00-21swapper/006:42:430
1711323425,0sleep20-21swapper/206:46:372
4160,0ktimersoftd/00-21swapper/011:24:240
339960,0migration/33863-21munin-node06:57:183
339960,0migration/317694-21sh12:10:503
339960,0migration/312303-21sh10:24:433
29725060,0irq/27-eth0-tx-27004-21munin-node08:07:170
29715060,0irq/26-eth0-rx-32758-21cut10:37:163
29715060,0irq/26-eth0-rx-20164-21perl11:32:133
29715060,0irq/26-eth0-rx-15386-21grep10:47:153
172149960,0cyclictest0-21swapper/011:06:330
149960,0migration/03871-21sh11:01:490
149960,0migration/03707-21sh10:17:520
149960,0migration/026375-21sh11:56:190
149960,0migration/023965-21latency_hist06:51:590
149960,0migration/019378-21sh10:48:430
149960,0migration/018032-21sh11:50:020
149960,0migration/013139-21switchtime09:22:210
35150,0ktimersoftd/30-21swapper/311:24:243
339950,0migration/37914-21kthreadcore11:02:153
339950,0migration/37703-21kthreadcore07:27:163
339950,0migration/36098-21taskset09:19:143
339950,0migration/33756-21kthreadcore07:22:163
339950,0migration/329790-21aten_r1power_en10:17:103
339950,0migration/32895-21latency_hist11:41:583
339950,0migration/328627-21munin-node10:57:083
339950,0migration/327708-21kthreadcore06:52:163
339950,0migration/323967-21kthreadcore08:02:153
339950,0migration/322247-21munin-node10:12:103
339950,0migration/319434-21aten_r1power_en07:37:113
339950,0migration/318872-21fschecks_count07:12:113
339950,0migration/318280-21munin-node11:07:223
339950,0migration/313990-21cpuspeed_turbos07:57:123
339950,0migration/313926-21irqrtprio07:32:143
339950,0migration/313418-21runrttasks10:27:093
339950,0migration/311560-21kthreadcore09:02:163
339950,0migration/311149-21taskset07:02:313
29725050,0irq/27-eth0-tx-9632-21taskset12:05:262
29725050,0irq/27-eth0-tx-7038-21munin-node07:52:130
29725050,0irq/27-eth0-tx-5334-21munin-node10:22:112
29725050,0irq/27-eth0-tx-3542-21lldpd09:18:162
29725050,0irq/27-eth0-tx-330-21ssh09:57:152
29725050,0irq/27-eth0-tx-2982-21munin-node11:42:212
29725050,0irq/27-eth0-tx-28626-21munin-node10:57:162
29725050,0irq/27-eth0-tx-27786-21ssh10:55:152
29725050,0irq/27-eth0-tx-22270-21df_inode10:12:102
29725050,0irq/27-eth0-tx-19830-21ssh10:50:072
29725050,0irq/27-eth0-tx-12930-21proc_pri09:22:182
29725050,0irq/27-eth0-tx-10408-21ssh09:02:162
29725050,0irq/27-eth0-tx-0-21swapper/211:19:312
29725050,0irq/27-eth0-tx-0-21swapper/008:47:170
29725050,0irq/27-eth0-tx-0-21swapper/008:39:550
29715050,0irq/26-eth0-rx-6407-21ssh09:41:553
29715050,0irq/26-eth0-rx-3054-21kthreadcore08:57:163
29715050,0irq/26-eth0-rx-24787-21cut08:52:153
29715050,0irq/26-eth0-rx-12805-21ssh09:42:223
29715050,0irq/26-eth0-rx-0-21swapper/312:02:153
29715050,0irq/26-eth0-rx-0-21swapper/311:47:163
29715050,0irq/26-eth0-rx-0-21swapper/311:39:023
29715050,0irq/26-eth0-rx-0-21swapper/311:27:263
29715050,0irq/26-eth0-rx-0-21swapper/311:17:203
29715050,0irq/26-eth0-rx-0-21swapper/311:12:103
29715050,0irq/26-eth0-rx-0-21swapper/310:54:303
29715050,0irq/26-eth0-rx-0-21swapper/310:42:143
29715050,0irq/26-eth0-rx-0-21swapper/310:07:273
29715050,0irq/26-eth0-rx-0-21swapper/310:03:543
29715050,0irq/26-eth0-rx-0-21swapper/309:57:443
29715050,0irq/26-eth0-rx-0-21swapper/309:55:553
29715050,0irq/26-eth0-rx-0-21swapper/309:27:173
29715050,0irq/26-eth0-rx-0-21swapper/309:22:463
29715050,0irq/26-eth0-rx-0-21swapper/308:09:503
29715050,0irq/26-eth0-rx-0-21swapper/307:52:223
29715050,0irq/26-eth0-rx-0-21swapper/307:17:203
259950,0migration/231773-21irqcore06:57:152
259950,0migration/223319-21unixbench-2d06:47:212
259950,0migration/216354-21latency11:47:172
259950,0migration/214425-21latency_hist09:46:592
259950,0migration/213751-21latency_hist10:06:592
259950,0migration/212140-21sh11:07:062
249950,0watchdog/2324-21latency11:37:162
249950,0watchdog/20-21swapper/210:32:172
19150,0ktimersoftd/10-21swapper/111:30:071
19150,0ktimersoftd/10-21swapper/111:19:051
172179955,0cyclictest15441-21diskmemload10:07:512
172179955,0cyclictest0-21swapper/211:57:542
172179955,0cyclictest0-21swapper/209:32:232
172159955,0cyclictest0-21swapper/111:47:091
172159955,0cyclictest0-21swapper/111:09:471
172159955,0cyclictest0-21swapper/108:51:401
172159954,0cyclictest7108-21grep07:27:151
172159950,0cyclictest0-21swapper/112:12:511
172159950,0cyclictest0-21swapper/111:37:411
172159950,0cyclictest0-21swapper/111:00:101
172159950,0cyclictest0-21swapper/110:51:391
172159950,0cyclictest0-21swapper/110:31:381
172159950,0cyclictest0-21swapper/109:16:161
172149950,0cyclictest18433-21munin-node07:12:120
172149950,0cyclictest0-21swapper/011:18:220
172149950,0cyclictest0-21swapper/010:42:060
172149950,0cyclictest0-21swapper/009:00:340
179950,0migration/112893-21munin-node09:02:171
169950,0watchdog/11260-21cut09:37:171
169950,0watchdog/10-21swapper/111:52:161
149950,0migration/09126-21aten_r1power_fr08:42:090
149950,0migration/07572-21taskset08:15:060
149950,0migration/07198-21irqcore10:02:140
149950,0migration/06761-21kthreadcore11:42:150
149950,0migration/027354-21kthreadcore09:12:160
149950,0migration/027282-21sh11:57:100
149950,0migration/026947-21sh11:36:310
149950,0migration/026920-21kthreadcore09:52:160
149950,0migration/026107-21aten_r1power_en07:42:080
149950,0migration/024371-21cpuspeed_turbos06:52:110
149950,0migration/024313-21kthreadcore10:52:150
149950,0migration/024078-21kthreadcore08:27:140
149950,0migration/020929-21kthreadcore09:07:150
149950,0migration/019781-21kthreadcore09:27:160
149950,0migration/018332-21kthreadcore10:27:160
149950,0migration/017714-21taskset11:27:260
149950,0migration/017343-21kthreadcore09:47:170
149950,0migration/01578-21kthreadcore09:17:170
149950,0migration/015345-21kthreadcore07:57:160
149950,0migration/012108-21munin-node07:07:120
149950,0migration/01162-21kthreadcore10:37:160
149950,0migration/011079-21kthreadcore08:17:150
339940,0migration/33729-21kthreadcore08:12:153
339940,0migration/32340-21kthreadcore07:47:153
339940,0migration/323286-21aten_r1power_vo09:32:103
339940,0migration/322936-21kthreadcore08:27:143
339940,0migration/320366-21kthreadcore06:47:153
339940,0migration/320265-21kthreadcore12:12:153
29725040,0irq/27-eth0-tx-23526-21munin-node08:52:132
29725040,0irq/27-eth0-tx-0-21swapper/212:12:152
29725040,0irq/27-eth0-tx-0-21swapper/211:54:462
29725040,0irq/27-eth0-tx-0-21swapper/211:27:132
29725040,0irq/27-eth0-tx-0-21swapper/211:22:042
29725040,0irq/27-eth0-tx-0-21swapper/211:02:102
29725040,0irq/27-eth0-tx-0-21swapper/210:37:562
29725040,0irq/27-eth0-tx-0-21swapper/209:47:212
29725040,0irq/27-eth0-tx-0-21swapper/209:27:272
29725040,0irq/27-eth0-tx-0-21swapper/209:13:172
29725040,0irq/27-eth0-tx-0-21swapper/209:07:082
29725040,0irq/27-eth0-tx-0-21swapper/208:57:222
29725040,0irq/27-eth0-tx-0-21swapper/007:33:450
29715040,0irq/26-eth0-rx-0-21swapper/312:01:073
29715040,0irq/26-eth0-rx-0-21swapper/311:52:063
29715040,0irq/26-eth0-rx-0-21swapper/310:33:283
29715040,0irq/26-eth0-rx-0-21swapper/309:47:043
29715040,0irq/26-eth0-rx-0-21swapper/309:12:533
29715040,0irq/26-eth0-rx-0-21swapper/309:07:363
29715040,0irq/26-eth0-rx-0-21swapper/308:48:083
29715040,0irq/26-eth0-rx-0-21swapper/308:37:153
259940,0migration/29554-21kthreadcore10:42:142
259940,0migration/26648-21kthreadcore08:37:172
259940,0migration/23641-21kthreadcore08:12:152
259940,0migration/225603-21kthreadcore08:27:152
259940,0migration/224848-21munin-node06:52:122
259940,0migration/223305-21gltestperf09:52:122
259940,0migration/214693-21switchtime08:42:202
259940,0migration/213891-21fschecks_time10:27:112
259940,0migration/212813-21aten_r1power_fr07:32:092
259940,0migration/212378-21fschecks_time07:07:132
259940,0migration/211856-21kthreadcore12:07:132
249940,0watchdog/230398-21perl10:17:132
249940,0watchdog/20-21swapper/209:37:172
249940,0watchdog/20-21swapper/207:57:172
172179943,0cyclictest7907-21awk07:52:132
172179943,0cyclictest3556-21lldpd08:32:162
172179943,0cyclictest3556-21lldpd08:21:162
172179943,0cyclictest3556-21lldpd07:51:452
172179943,0cyclictest3556-21lldpd07:28:152
172179943,0cyclictest26900-21awk07:42:112
172179943,0cyclictest25935-21awk07:17:152
172179943,0cyclictest20959-21awk11:12:122
172179943,0cyclictest20404-21awk11:32:142
172179943,0cyclictest20265-21awk07:37:142
172179940,0cyclictest8210-21kthreadcore07:02:162
172179940,0cyclictest0-21swapper/208:47:552
172159944,0cyclictest0-21swapper/110:07:021
172159944,0cyclictest0-21swapper/109:53:381
172159944,0cyclictest0-21swapper/106:52:101
172159943,0cyclictest9959-21awk08:42:121
172159943,0cyclictest8157-21awk09:22:121
172159943,0cyclictest3556-21lldpd11:05:481
172159943,0cyclictest3556-21lldpd10:44:471
172159943,0cyclictest3556-21lldpd10:22:471
172159943,0cyclictest3556-21lldpd10:12:161
172159943,0cyclictest3556-21lldpd09:43:161
172159943,0cyclictest3556-21lldpd08:17:161
172159943,0cyclictest3556-21lldpd08:14:461
172159943,0cyclictest3556-21lldpd07:55:451
172159943,0cyclictest3556-21lldpd07:35:151
172159943,0cyclictest3556-21lldpd06:58:441
172159943,0cyclictest3241-21irqbalance11:57:561
172159943,0cyclictest3241-21irqbalance11:12:071
172159943,0cyclictest3241-21irqbalance10:02:371
172159943,0cyclictest3241-21irqbalance09:09:471
172159943,0cyclictest3241-21irqbalance08:57:071
172159943,0cyclictest28802-21awk08:32:121
172159943,0cyclictest22304-21awk10:32:141
172159943,0cyclictest20478-21awk11:32:151
172159943,0cyclictest19413-21awk07:12:141
172159943,0cyclictest15592-21awk09:47:151
172159943,0cyclictest15518-21awk08:22:111
172149944,0cyclictest0-21swapper/010:22:430
172149944,0cyclictest0-21swapper/010:10:250
172149943,0cyclictest22231-21awk10:32:130
172149943,0cyclictest21185-21awk08:02:120
172149943,0cyclictest20912-21awk11:12:120
172149943,0cyclictest1124-21awk07:47:130
172149942,0cyclictest31256-21kworker/0:111:08:260
179940,0migration/132461-21kthreadcore10:17:171
179940,0migration/127283-21cpuspeed_turbos08:07:111
179940,0migration/124895-21kthreadcore08:02:151
179940,0migration/12445-21kthreadcore09:57:161
179940,0migration/120120-21gltestperf07:37:131
179940,0migration/119293-21kthreadcore09:27:161
179940,0migration/115794-21mdstat12:07:151
179940,0migration/11389-21kthreadcore10:37:161
179940,0migration/111057-21unixbench_multi07:02:211
169940,0watchdog/19373-21ssh11:42:561
169940,0watchdog/132440-21taskset07:46:451
169940,0watchdog/129776-21ssh09:33:531
169940,0watchdog/127587-21ssh10:54:361
169940,0watchdog/10-21swapper/108:52:171
169940,0watchdog/10-21swapper/108:37:171
169940,0watchdog/10-21swapper/107:57:171
149940,0migration/08650-21sh12:02:240
149940,0migration/07985-21kthreadcore07:27:160
149940,0migration/02989-21kthreadcore07:22:160
149940,0migration/025418-21runrttasks12:15:140
29715030,0irq/26-eth0-rx-0-21swapper/308:43:193
29715030,0irq/26-eth0-rx-0-21swapper/308:32:093
29715030,0irq/26-eth0-rx-0-21swapper/308:24:083
29715030,0irq/26-eth0-rx-0-21swapper/308:17:103
29715030,0irq/26-eth0-rx-0-21swapper/307:11:103
172179933,0cyclictest3556-21lldpd08:11:462
172179932,0cyclictest5817-21sadc07:26:592
172179932,0cyclictest26319-21grep08:02:212
172179932,0cyclictest20999-21kthreadcore07:12:162
172179930,0cyclictest20298-21python08:22:192
172159933,0cyclictest3556-21lldpd09:17:161
172159932,0cyclictest3381-21if_eth1.212:02:131
172159932,0cyclictest32676-21awk07:22:141
172159932,0cyclictest25905-21awk07:17:141
172159932,0cyclictest12617-21awk07:07:141
172159930,0cyclictest2863-21kthreadcore07:47:151
172159930,0cyclictest18002-21perl06:47:111
172149933,0cyclictest31256-21kworker/0:110:12:560
172149933,0cyclictest31256-21kworker/0:109:42:020
172149933,0cyclictest31256-21kworker/0:109:32:080
172149933,0cyclictest31256-21kworker/0:108:52:100
172149933,0cyclictest31256-21kworker/0:108:32:020
172149933,0cyclictest31256-21kworker/0:108:22:020
172149933,0cyclictest31256-21kworker/0:107:37:020
172149933,0cyclictest31256-21kworker/0:107:17:020
172149933,0cyclictest31256-21kworker/0:107:02:090
172149933,0cyclictest31256-21kworker/0:106:57:190
172149932,0cyclictest8454-21awk09:02:140
172149932,0cyclictest31782-21fschecks_time09:37:130
172149932,0cyclictest31341-21awk09:57:130
172149932,0cyclictest28277-21awk11:37:130
172149932,0cyclictest11384-21awk12:07:120
169930,0watchdog/122288-21sh08:27:131
169930,0watchdog/10-21swapper/111:23:081
35120,0ktimersoftd/331062-21kthreadcore07:42:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional