You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 20:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack1slot1.osadl.org (updated Sun Mar 29, 2026 12:45:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253782215160,44sleep00-21swapper/007:09:200
251022210150,48sleep30-21swapper/307:05:453
251052205149,22sleep10-21swapper/107:05:481
252452203157,32sleep20-21swapper/207:07:382
275732610,0sleep00-21swapper/008:20:010
125522170,0sleep00-21swapper/010:24:000
2552999160,1cyclictest15379-21ssh11:10:123
2552999140,1cyclictest4799-21ssh11:37:413
2552999140,1cyclictest19530-21df09:10:143
2552999140,1cyclictest19530-21df09:10:143
2552999140,1cyclictest18138-21grep12:35:203
2552999132,10cyclictest18760-21diskmemload11:21:523
2552999132,10cyclictest18760-21diskmemload10:59:533
2552999130,1cyclictest30532-21ssh09:24:033
2552999130,1cyclictest0-21swapper/310:01:463
25522991311,1cyclictest28-21ksoftirqd/209:00:002
2551699130,13cyclictest0-21swapper/108:50:111
2552999122,9cyclictest19111-21ssh10:31:003
2552999122,9cyclictest18760-21diskmemload10:51:333
2552999121,1cyclictest0-21swapper/311:53:133
2552999120,2cyclictest15176-21munin-run07:55:003
2552999120,11cyclictest0-21swapper/311:09:563
2552999120,1cyclictest31863-21/usr/sbin/munin11:30:183
2552999120,1cyclictest27792-21ssh12:06:223
2552999120,1cyclictest27650-21kworker/u8:012:17:173
2552999120,1cyclictest17799-21ntp_states09:05:183
2552999120,1cyclictest10001-21ntp_states12:25:193
2552999120,1cyclictest0-21swapper/308:10:163
2552999120,0cyclictest0-21swapper/310:45:143
25502991211,1cyclictest9-21ksoftirqd/012:40:000
28242110,0sleep10-21swapper/109:30:071
2552999117,4cyclictest18760-21diskmemload10:36:343
2552999112,8cyclictest18760-21diskmemload12:04:003
2552999112,8cyclictest18760-21diskmemload09:29:353
2552999110,10cyclictest0-21swapper/311:26:273
2552999110,1cyclictest10429-21chrt07:44:353
2552999110,1cyclictest0-21swapper/311:17:343
2552999110,1cyclictest0-21swapper/309:46:573
2552999110,0cyclictest18760-21diskmemload12:20:123
2552999110,0cyclictest18760-21diskmemload11:02:063
2552999110,0cyclictest18760-21diskmemload10:25:473
2552999110,0cyclictest18760-21diskmemload09:56:103
2552999110,0cyclictest0-21swapper/309:40:153
2552999110,0cyclictest0-21swapper/309:17:273
2552999110,0cyclictest0-21swapper/307:25:113
25502991110,1cyclictest9-21ksoftirqd/012:30:000
25502991110,1cyclictest9-21ksoftirqd/009:25:010
5422100,0sleep20-21swapper/212:14:572
2552999105,4cyclictest6066-21ssh11:40:133
2552999103,6cyclictest28346-21entropy07:15:013
2552999100,10cyclictest0-21swapper/310:23:123
2552999100,1cyclictest6683-21irqstats07:35:183
2552999100,1cyclictest5362-21diskstats08:40:133
2552999100,1cyclictest21303-21sed08:05:183
2552999100,1cyclictest18760-21diskmemload09:53:243
2552999100,1cyclictest0-21swapper/310:19:333
2552999100,1cyclictest0-21swapper/309:35:223
2552999100,0cyclictest18760-21diskmemload10:13:483
2552999100,0cyclictest18760-21diskmemload10:13:483
2552999100,0cyclictest0-21swapper/311:56:093
2552999100,0cyclictest0-21swapper/310:09:073
2552299109,1cyclictest28-21ksoftirqd/212:19:592
2552299108,1cyclictest28-21ksoftirqd/208:54:592
2552299108,1cyclictest28-21ksoftirqd/208:30:002
2552299108,1cyclictest28-21ksoftirqd/207:50:002
2552299102,3cyclictest7735-21aten_r1power_cu11:00:122
2550299109,1cyclictest9-21ksoftirqd/011:40:000
2550299109,1cyclictest9-21ksoftirqd/009:40:140
2550299108,1cyclictest9-21ksoftirqd/010:45:140
2550299108,1cyclictest9-21ksoftirqd/007:55:000
2550299100,9cyclictest0-21swapper/010:40:120
2550299100,8cyclictest11935-1kworker/u9:212:00:160
255299994,4cyclictest5022-21ssh09:31:173
255299990,9cyclictest0-21swapper/310:41:133
255299990,1cyclictest31582-21cstates07:20:133
255299990,1cyclictest31582-21cstates07:20:133
255299990,1cyclictest30015-21diskstats12:10:143
255299990,1cyclictest0-21swapper/312:34:173
255299990,0cyclictest0-21swapper/311:49:453
255299990,0cyclictest0-21swapper/309:00:133
255299990,0cyclictest0-21swapper/307:45:133
255229998,1cyclictest28-21ksoftirqd/209:20:132
255229998,1cyclictest28-21ksoftirqd/209:10:012
255229998,1cyclictest28-21ksoftirqd/208:30:002
255229998,1cyclictest28-21ksoftirqd/207:20:012
255229998,1cyclictest28-21ksoftirqd/207:20:002
255229997,1cyclictest28-21ksoftirqd/211:20:012
255229990,8cyclictest3782-21ssh09:30:162
255229990,4cyclictest240-21systemd-journal08:40:002
255029998,1cyclictest9-21ksoftirqd/007:35:010
255029997,1cyclictest9-21ksoftirqd/009:30:010
255029997,1cyclictest9-21ksoftirqd/007:59:590
255029996,1cyclictest0-21swapper/010:12:260
255029996,1cyclictest0-21swapper/010:12:250
255029990,3cyclictest0-21swapper/008:00:120
255299980,7cyclictest311-21cpuspeed_turbos08:30:143
255299980,7cyclictest28414-21grep08:20:143
255299980,2cyclictest240-21systemd-journal07:33:533
255299980,1cyclictest240-21systemd-journal07:55:003
255229987,1cyclictest15259-21sh10:25:572
255229986,1cyclictest61650irq/122-eno111:55:192
255229986,1cyclictest28-21ksoftirqd/209:45:142
255169980,4cyclictest0-21swapper/111:30:131
255169980,4cyclictest0-21swapper/110:41:011
255169980,3cyclictest0-21swapper/111:45:101
255169980,0cyclictest0-21swapper/112:30:131
255029987,1cyclictest9-21ksoftirqd/012:15:130
255029987,1cyclictest9-21ksoftirqd/010:35:130
255029987,1cyclictest7586-21ssh12:23:060
255029986,1cyclictest9-21ksoftirqd/012:10:010
255029986,1cyclictest9-21ksoftirqd/011:30:150
255029986,1cyclictest9-21ksoftirqd/011:05:140
255029986,1cyclictest9-21ksoftirqd/010:20:010
255029984,2cyclictest240-21systemd-journal07:45:000
255029984,0cyclictest0-21swapper/009:07:510
255029984,0cyclictest0-21swapper/008:45:270
255029983,4cyclictest9-21ksoftirqd/008:05:160
255029980,7cyclictest9237-21ssh11:44:170
255029980,0cyclictest18760-21diskmemload10:58:360
255299970,1cyclictest9684-21aten2.4-expect08:50:133
255299970,1cyclictest7556-21expr08:45:123
255299970,1cyclictest3719-21awk08:35:193
255299970,1cyclictest29996-21apt-get08:25:123
255299970,1cyclictest25717-21apt-get07:10:093
255299970,1cyclictest25669-21fschecks_time08:15:143
255299970,1cyclictest25669-21fschecks_time08:15:133
255299970,1cyclictest17990-21apt-get08:00:113
255299970,1cyclictest12135-21cat08:55:133
255229977,0cyclictest28-21ksoftirqd/212:35:142
255229977,0cyclictest28-21ksoftirqd/210:50:132
255229976,1cyclictest61650irq/122-eno111:45:152
255229976,1cyclictest61650irq/122-eno111:44:592
255229976,1cyclictest61650irq/122-eno111:20:092
255229976,1cyclictest61650irq/122-eno111:06:242
255229976,1cyclictest28-21ksoftirqd/212:30:002
255229976,1cyclictest28-21ksoftirqd/210:05:012
255229976,1cyclictest28-21ksoftirqd/209:50:202
255229976,1cyclictest28-21ksoftirqd/209:00:102
255229975,1cyclictest28-21ksoftirqd/210:45:002
255229970,7cyclictest0-21swapper/212:20:252
255229970,6cyclictest0-21swapper/212:34:522
255229970,0cyclictest0-21swapper/211:25:122
255169970,6cyclictest165512sleep109:45:371
255169970,3cyclictest0-21swapper/111:52:411
255169970,2cyclictest0-21swapper/109:35:131
255029976,1cyclictest9-21ksoftirqd/011:55:010
255029976,1cyclictest9-21ksoftirqd/010:25:010
255029976,1cyclictest9-21ksoftirqd/009:10:140
255029976,1cyclictest9-21ksoftirqd/009:10:130
255029976,1cyclictest9-21ksoftirqd/008:41:350
255029976,1cyclictest31580-21ssh12:11:080
255029976,1cyclictest17734-21ssh09:48:460
255029976,1cyclictest15181-1kworker/u9:112:34:570
255029975,1cyclictest9-21ksoftirqd/011:45:130
255029975,1cyclictest9-21ksoftirqd/008:55:130
255029974,2cyclictest18501-21ssh09:50:110
255029972,4cyclictest0-21swapper/007:35:180
255029971,5cyclictest15521-21ssh11:10:130
255029971,1cyclictest17071-21apt-get10:30:100
255029971,1cyclictest0-21swapper/009:00:110
255029970,6cyclictest20998-21ssh11:15:220
255029970,6cyclictest1435-21perf10:10:010
255029970,6cyclictest10003-21expr08:50:120
255029970,6cyclictest0-21swapper/011:25:120
255029970,6cyclictest0-21swapper/010:00:150
255029970,6cyclictest0-21swapper/009:35:150
255029970,6cyclictest0-21swapper/009:30:110
255029970,6cyclictest0-21swapper/008:30:130
255029970,1cyclictest4105-21sed08:35:220
255029970,1cyclictest18760-21diskmemload11:20:410
255029970,1cyclictest13848-21ssh11:50:100
255029970,1cyclictest0-21swapper/010:50:150
255229966,0cyclictest61650irq/122-eno112:00:252
255229966,0cyclictest61650irq/122-eno111:51:172
255229966,0cyclictest61650irq/122-eno111:35:172
255229966,0cyclictest61650irq/122-eno111:30:152
255229966,0cyclictest61650irq/122-eno111:10:132
255229966,0cyclictest61650irq/122-eno110:55:152
255229966,0cyclictest61650irq/122-eno110:38:422
255229966,0cyclictest61650irq/122-eno110:30:112
255229966,0cyclictest61650irq/122-eno110:21:332
255229966,0cyclictest61650irq/122-eno110:10:592
255229966,0cyclictest61650irq/122-eno110:10:582
255229966,0cyclictest61650irq/122-eno110:05:102
255229966,0cyclictest61650irq/122-eno109:57:022
255229966,0cyclictest61650irq/122-eno109:35:092
255229966,0cyclictest61650irq/122-eno109:26:282
255229966,0cyclictest61650irq/122-eno109:15:152
255229966,0cyclictest61650irq/122-eno109:11:082
255229966,0cyclictest61650irq/122-eno109:11:072
255229966,0cyclictest61650irq/122-eno108:47:332
255229966,0cyclictest61650irq/122-eno108:15:202
255229966,0cyclictest61650irq/122-eno108:15:192
255229966,0cyclictest61650irq/122-eno107:54:202
255229966,0cyclictest61650irq/122-eno107:40:032
255229966,0cyclictest61650irq/122-eno107:35:142
255229966,0cyclictest61650irq/122-eno107:30:132
255229966,0cyclictest61650irq/122-eno107:25:112
255229965,1cyclictest61650irq/122-eno108:05:132
255229965,1cyclictest61650irq/122-eno107:10:172
255229965,1cyclictest28-21ksoftirqd/208:40:132
255229965,1cyclictest28-21ksoftirqd/208:20:012
255229965,1cyclictest26350-21ssh12:05:152
255229965,0cyclictest61650irq/122-eno109:40:172
255229964,1cyclictest61650irq/122-eno110:15:112
255229961,4cyclictest0-21swapper/207:55:112
255229960,4cyclictest28618-21apt-get10:45:102
255169966,0cyclictest0-21swapper/109:23:151
255169960,6cyclictest0-21swapper/110:23:431
255169960,4cyclictest0-21swapper/111:56:541
255169960,3cyclictest0-21swapper/110:53:551
255169960,3cyclictest0-21swapper/109:40:121
255169960,2cyclictest0-21swapper/112:02:041
255169960,2cyclictest0-21swapper/110:34:381
255169960,2cyclictest0-21swapper/108:10:191
255169960,2cyclictest0-21swapper/107:56:351
255169960,1cyclictest0-21swapper/111:10:131
255029965,1cyclictest25260-1kworker/u9:109:15:030
255029964,1cyclictest28117-21latency_hist07:15:010
255029964,1cyclictest1957-21if_err_eno107:25:140
255029963,2cyclictest29773-21cat07:15:160
255029961,0cyclictest22349-21apt-get09:55:100
255029960,2cyclictest27304-21latency_hist08:20:010
255029960,2cyclictest27304-21latency_hist08:20:000
255029960,0cyclictest0-21swapper/011:00:490
255029960,0cyclictest0-21swapper/007:45:130
255229955,0cyclictest61650irq/122-eno108:10:182
255229950,3cyclictest29678-21/usr/sbin/munin07:15:162
255229950,1cyclictest0-21swapper/208:00:122
255169955,0cyclictest0-21swapper/112:20:201
255169955,0cyclictest0-21swapper/109:50:281
255169951,4cyclictest0-21swapper/109:07:511
255169951,4cyclictest0-21swapper/108:45:271
255169951,4cyclictest0-21swapper/108:34:181
255169951,4cyclictest0-21swapper/108:00:401
255169951,3cyclictest0-21swapper/110:15:101
255169951,1cyclictest0-21swapper/112:15:121
255169951,1cyclictest0-21swapper/111:44:491
255169951,1cyclictest0-21swapper/111:00:141
255169951,1cyclictest0-21swapper/109:15:191
255169950,5cyclictest0-21swapper/112:11:451
255169950,5cyclictest0-21swapper/112:06:591
255169950,5cyclictest0-21swapper/111:35:391
255169950,5cyclictest0-21swapper/111:22:141
255169950,5cyclictest0-21swapper/108:55:151
255169950,5cyclictest0-21swapper/107:24:581
255169950,5cyclictest0-21swapper/107:24:581
255169950,3cyclictest0-21swapper/111:29:471
255169950,3cyclictest0-21swapper/111:17:241
255169950,3cyclictest0-21swapper/111:08:531
255169950,3cyclictest0-21swapper/110:03:321
255169950,3cyclictest0-21swapper/109:55:101
255169950,3cyclictest0-21swapper/109:28:151
255169950,3cyclictest0-21swapper/109:10:121
255169950,3cyclictest0-21swapper/109:10:121
255169950,3cyclictest0-21swapper/108:25:201
255169950,2cyclictest0-21swapper/110:45:111
255169950,2cyclictest0-21swapper/110:11:541
255169950,2cyclictest0-21swapper/110:11:541
255169950,2cyclictest0-21swapper/110:06:441
255169950,1cyclictest0-21swapper/112:35:111
255169950,1cyclictest0-21swapper/112:25:011
255169950,1cyclictest0-21swapper/110:56:131
255169950,1cyclictest0-21swapper/110:26:021
255169950,1cyclictest0-21swapper/107:35:141
255169950,0cyclictest0-21swapper/110:36:231
255169950,0cyclictest0-21swapper/107:44:411
255029951,1cyclictest31138-21/usr/sbin/munin07:20:170
255029951,1cyclictest31138-21/usr/sbin/munin07:20:160
255029950,4cyclictest22692-21/usr/sbin/munin08:10:130
255029950,1cyclictest0-21swapper/008:25:130
255169943,1cyclictest0-21swapper/108:20:101
255169941,2cyclictest0-21swapper/109:00:091
255169940,4cyclictest0-21swapper/108:40:181
255169940,3cyclictest0-21swapper/107:25:091
255169940,1cyclictest0-21swapper/108:35:131
255169940,1cyclictest0-21swapper/108:05:191
255169940,1cyclictest0-21swapper/107:30:121
255169940,1cyclictest0-21swapper/107:15:011
255169940,0cyclictest0-21swapper/107:50:171
255169931,1cyclictest0-21swapper/107:10:091
255169930,1cyclictest0-21swapper/108:15:111
255169930,1cyclictest0-21swapper/108:15:111
255169930,1cyclictest0-21swapper/107:45:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional