You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 00:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot2.osadl.org (updated Wed Jun 10, 2026 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
105071499164110,49cyclictest81-21hwrng10:25:253
105071499148128,18cyclictest461ktimers/312:15:173
105071399148102,42cyclictest1234713-21ssh12:21:002
1050713991441,77cyclictest1111967-21cat09:31:112
10507139914139,26cyclictest1086260-21kworker/u16:18+rpciod09:05:012
10507139914139,26cyclictest1086260-21kworker/u16:18+rpciod09:05:012
10507149914055,13cyclictest0-21swapper/307:40:253
105071499135124,7cyclictest81-21hwrng11:10:293
105071199135116,7cyclictest81-21hwrng11:29:560
10507129913489,34cyclictest0-21swapper/112:00:191
105071499133118,12cyclictest81-21hwrng10:53:043
105071499133118,12cyclictest81-21hwrng10:53:043
105071399133121,6cyclictest81-21hwrng07:52:512
105071499130120,6cyclictest81-21hwrng12:24:123
105071299130115,6cyclictest81-21hwrng10:41:481
10507119913012,17cyclictest1154043-21/usr/sbin/munin10:30:360
105071199129125,2cyclictest10550irq/171-8000000.ethernet-tx710:00:570
1050713991278,34cyclictest1105169-21kworker/u16:13+xprtiod09:40:032
1050713991278,34cyclictest1105169-21kworker/u16:13+xprtiod09:40:032
10507129912787,36cyclictest0-21swapper/111:20:061
105071299127118,6cyclictest81-21hwrng08:05:081
105071299126118,5cyclictest81-21hwrng12:34:271
10507119912688,29cyclictest171ktimers/010:45:230
1050714991254,91cyclictest1191378-21ntpq11:21:013
105071499125109,13cyclictest81-21hwrng08:51:133
105071499125109,13cyclictest81-21hwrng08:51:133
105071299125106,15cyclictest81-21hwrng07:23:091
10507139912458,61cyclictest0-21swapper/208:40:172
10507139912458,61cyclictest0-21swapper/208:40:172
105071499123113,6cyclictest81-21hwrng10:21:203
105071499123113,6cyclictest81-21hwrng10:21:203
105071399123113,6cyclictest81-21hwrng11:36:052
105071399123113,6cyclictest81-21hwrng11:36:052
105071399123110,4cyclictest81-21hwrng11:40:102
105071199123112,6cyclictest81-21hwrng12:03:440
105071399122114,5cyclictest81-21hwrng10:30:332
105071399122108,11cyclictest81-21hwrng10:46:562
1050713991211,74cyclictest1100678-21ntpq09:15:512
1050713991211,74cyclictest1100678-21ntpq09:15:512
105071299121112,6cyclictest81-21hwrng08:25:371
105071299121111,6cyclictest81-21hwrng08:03:051
105071299121111,6cyclictest81-21hwrng08:03:051
10507149912068,46cyclictest0-21swapper/311:16:043
1050713991197,58cyclictest1144315-21ntpq10:16:022
1050713991197,58cyclictest1144315-21ntpq10:16:022
10507139911971,40cyclictest381ktimers/211:00:412
10507119911813,19cyclictest1158070-21df10:35:330
10507119911813,19cyclictest1158070-21df10:35:330
105071399117106,6cyclictest81-21hwrng07:15:592
105071299117108,6cyclictest81-21hwrng11:54:311
105071299117103,5cyclictest81-21hwrng09:59:491
105071299117103,5cyclictest81-21hwrng09:59:491
10507119911756,40cyclictest10650irq/205-8000000.ethernet-rx012:05:410
105071299116107,6cyclictest81-21hwrng09:46:311
105071199116107,7cyclictest0-21swapper/009:21:190
105071499115105,5cyclictest81-21hwrng07:45:413
105071499115105,5cyclictest81-21hwrng07:45:413
10507139911598,6cyclictest81-21hwrng10:23:222
10507139911598,6cyclictest81-21hwrng10:23:222
10507139911551,53cyclictest0-21swapper/208:05:252
10507149911499,7cyclictest81-21hwrng09:15:473
10507149911499,7cyclictest81-21hwrng09:15:473
1050711991146,92cyclictest1173012-21sed10:55:420
10507149911397,6cyclictest81-21hwrng11:52:283
10507119911331,65cyclictest16-21ksoftirqd/010:10:200
10507139911296,12cyclictest81-21hwrng12:10:542
105071299112106,4cyclictest81-21hwrng12:27:171
10507119911227,25cyclictest1050452-21kworker/u16:0+xprtiod08:20:030
105071399111101,6cyclictest81-21hwrng10:03:552
10507119911125,14cyclictest0-21swapper/007:20:020
105071199111101,6cyclictest81-21hwrng11:48:220
105071199111101,6cyclictest81-21hwrng11:24:490
10507149911056,12cyclictest0-21swapper/310:40:373
105071399110102,5cyclictest81-21hwrng07:27:152
105071399110100,7cyclictest81-21hwrng08:55:192
10507129911098,7cyclictest81-21hwrng08:58:231
1050711991102,71cyclictest16-21ksoftirqd/009:35:160
1050711991102,71cyclictest16-21ksoftirqd/009:35:160
10507139910967,35cyclictest0-21swapper/209:40:272
10507139910848,56cyclictest0-21swapper/211:11:102
1050714991075,23cyclictest1205595-21/usr/sbin/munin11:40:473
10507139910797,5cyclictest0-21swapper/211:16:082
10507129910792,6cyclictest81-21hwrng11:03:191
10507119910788,15cyclictest81-21hwrng10:52:030
10507119910788,15cyclictest81-21hwrng10:52:030
10507119910680,19cyclictest0-21swapper/011:00:120
1050714991054,54cyclictest1119875-21kworker/u16:8+rpciod10:00:033
1050714991054,54cyclictest1119875-21kworker/u16:8+rpciod10:00:033
10507119910578,24cyclictest10650irq/205-8000000.ethernet-rx012:15:150
10507139910494,6cyclictest81-21hwrng07:48:452
10507139910494,6cyclictest81-21hwrng07:48:452
10507149910393,6cyclictest81-21hwrng07:55:553
10507149910393,6cyclictest81-21hwrng07:55:553
10507129910388,12cyclictest81-21hwrng09:43:261
10507129910296,4cyclictest81-21hwrng09:19:531
10507129910296,4cyclictest81-21hwrng09:19:531
10507119910281,18cyclictest0-21swapper/009:30:550
10507139910192,5cyclictest81-21hwrng10:26:272
10507139910166,30cyclictest0-21swapper/209:25:142
10507129910186,6cyclictest81-21hwrng07:46:421
10507129910186,6cyclictest81-21hwrng07:46:421
1050711991012,45cyclictest1197526-21apt-get11:30:170
10507139910056,39cyclictest1061745-21kworker/u16:10+xprtiod07:55:242
10507139910056,39cyclictest1061745-21kworker/u16:10+xprtiod07:55:242
1050714999989,6cyclictest81-21hwrng08:59:243
1050713999988,6cyclictest81-21hwrng09:21:562
1050712999991,6cyclictest81-21hwrng12:37:311
1050712999989,7cyclictest81-21hwrng08:32:471
105071199995,46cyclictest1071404-21latency_hist08:05:010
105071199995,46cyclictest1071404-21latency_hist08:05:010
1050711999954,37cyclictest171ktimers/012:26:040
105071499983,86cyclictest0-21swapper/310:35:463
105071499983,86cyclictest0-21swapper/310:35:463
1050713999890,5cyclictest81-21hwrng10:05:582
1050711999733,56cyclictest0-21swapper/007:45:380
1050711999733,56cyclictest0-21swapper/007:45:380
1050711999639,42cyclictest0-21swapper/010:20:280
1050711999639,42cyclictest0-21swapper/010:20:280
1050711999634,47cyclictest0-21swapper/007:56:230
1050711999634,47cyclictest0-21swapper/007:56:230
105071199962,65cyclictest1202097-21ntpq11:35:490
105071199962,65cyclictest1202097-21ntpq11:35:490
1050714999479,6cyclictest81-21hwrng09:27:033
1050713999434,25cyclictest0-21swapper/209:45:362
1050711999453,35cyclictest0-21swapper/009:05:220
1050711999428,9cyclictest1048727-21kworker/u16:19+nfsiod07:40:160
1050714999384,6cyclictest81-21hwrng07:21:063
1050713999382,6cyclictest81-21hwrng11:46:192
1050712999383,7cyclictest81-21hwrng09:02:291
1050712999383,7cyclictest81-21hwrng09:02:291
105071199936,30cyclictest1058444-21apt-get07:30:250
105071199936,30cyclictest1058444-21apt-get07:30:250
1050711999330,55cyclictest0-21swapper/009:25:160
1050711999329,7cyclictest1073475-21apt-get08:10:110
1050711999329,7cyclictest1073475-21apt-get08:10:110
105071199931,28cyclictest107862850kworker/u16:11+xprtiod08:40:280
105071199931,28cyclictest107862850kworker/u16:11+xprtiod08:40:280
1050714999283,5cyclictest81-21hwrng08:24:353
1050714999283,5cyclictest81-21hwrng08:24:353
1050711999222,30cyclictest1184111-21ntpq11:10:550
1050711999215,18cyclictest1211957-21apt-get11:50:220
1050714999182,6cyclictest81-21hwrng08:15:223
1050712999179,8cyclictest81-21hwrng07:42:361
1050711999179,8cyclictest81-21hwrng10:09:020
105071199913,48cyclictest1229902-21sort12:15:020
1050711999134,30cyclictest1180480-21ssh11:05:550
1050711999130,46cyclictest0-21swapper/008:05:140
1050713999059,27cyclictest0-21swapper/208:15:142
1050712999057,31cyclictest0-21swapper/111:40:171
105071199902,80cyclictest1153101-21sleep10:28:270
1050714998959,20cyclictest1116639-21kworker/u16:0+xprtiod09:40:513
1050712998972,5cyclictest81-21hwrng09:25:001
1050711998933,48cyclictest0-21swapper/007:35:360
1050714998875,8cyclictest81-21hwrng12:01:413
1050713998854,27cyclictest10650irq/205-8000000.ethernet-rx009:11:112
105071199881,49cyclictest0-21swapper/012:38:130
1050714998776,8cyclictest81-21hwrng07:26:133
1050714998773,5cyclictest81-21hwrng09:33:123
1050713998711,5cyclictest1125777-21irqstats09:50:402
1050711998775,5cyclictest81-21hwrng11:15:360
1050711998738,5cyclictest1236932-21cut12:25:000
1050711998736,44cyclictest0-21swapper/009:50:370
105071199872,42cyclictest1067646-21latency_hist07:55:020
1050712998678,5cyclictest81-21hwrng07:32:221
1050712998678,5cyclictest81-21hwrng07:32:221
1050712998665,14cyclictest0-21swapper/109:25:231
1050714998575,5cyclictest81-21hwrng09:01:273
1050714998575,5cyclictest81-21hwrng09:01:273
105071199852,34cyclictest1093165-21ps09:01:090
105071199852,34cyclictest1093165-21ps09:01:090
1050713998474,7cyclictest81-21hwrng12:36:302
1050711998474,6cyclictest81-21hwrng09:10:400
1050711998434,9cyclictest171ktimers/007:25:270
1050714998332,9cyclictest0-21swapper/310:10:133
105071199835,10cyclictest0-21swapper/007:10:350
105071199835,10cyclictest0-21swapper/007:10:350
105071199834,33cyclictest1162313-21ssh10:40:540
1050711998328,27cyclictest1131458-21sh09:58:450
1050711998328,27cyclictest1131458-21sh09:58:450
1050711998326,12cyclictest0-21swapper/011:40:360
1050711998321,7cyclictest0-21swapper/007:20:290
1050714998253,24cyclictest0-21swapper/309:05:243
1050712998211,62cyclictest31-21ksoftirqd/110:13:531
1050711998216,29cyclictest1084594-21date08:40:020
1050711998216,29cyclictest1084594-21date08:40:020
1050713998172,7cyclictest0-21swapper/210:55:292
1050713998146,27cyclictest0-21swapper/212:16:132
1050711998146,31cyclictest1216370-21ls11:55:430
1050711998135,41cyclictest171ktimers/008:25:150
1050711998128,17cyclictest1742-21lldpd08:24:490
1050711998128,17cyclictest1742-21lldpd08:24:490
105071199811,39cyclictest1122706-21grep09:46:090
1050714998072,5cyclictest81-21hwrng08:45:043
105071499801,72cyclictest1217298-21vmstat11:56:163
1050712998052,16cyclictest0-21swapper/112:15:581
105071299803,21cyclictest1170907-21kworker/u16:12+rpciod11:00:021
105071199803,34cyclictest10650irq/205-8000000.ethernet-rx009:40:470
1050712997931,40cyclictest0-21swapper/107:15:091
105071299792,72cyclictest1227518-21ntpq12:11:011
1050711997933,5cyclictest1100526-21missed_timers09:15:430
1050711997933,5cyclictest1100526-21missed_timers09:15:430
1050712997844,15cyclictest0-21swapper/110:06:091
105071199783,36cyclictest1081948-21grep08:31:050
105071199782,43cyclictest1240828-21ssh12:30:150
1050711997735,35cyclictest0-21swapper/008:55:340
1050711997731,8cyclictest0-21swapper/010:17:050
1050711997731,8cyclictest0-21swapper/010:17:050
1050712997620,53cyclictest31-21ksoftirqd/111:27:161
1050714997538,17cyclictest1080557-21kworker/u16:2+xprtiod09:20:223
1050713997569,4cyclictest81-21hwrng10:44:532
1050713997564,7cyclictest0-21swapper/210:10:502
1050713997527,22cyclictest37-21rcuc/208:25:182
1050712997568,5cyclictest301ktimers/111:16:001
1050711997527,7cyclictest1050762-21latency_hist07:10:020
1050711997527,7cyclictest1050762-21latency_hist07:10:020
1050714997443,22cyclictest0-21swapper/308:05:133
1050714997413,41cyclictest1050710-21cyclictest10:45:233
1050713997464,8cyclictest81-21hwrng07:14:582
1050713997464,8cyclictest81-21hwrng07:14:582
1050713997459,7cyclictest81-21hwrng11:31:592
105071299746,63cyclictest1171771-21sshd-auth10:54:451
105071299746,63cyclictest1171771-21sshd-auth10:54:451
1050712997438,33cyclictest0-21swapper/111:35:121
1050712997438,33cyclictest0-21swapper/111:35:121
1050711997420,20cyclictest1050710-21cyclictest08:46:050
1050714997358,12cyclictest81-21hwrng07:12:553
1050714997358,12cyclictest81-21hwrng07:12:553
105071399738,63cyclictest0-21swapper/208:40:022
105071399738,63cyclictest0-21swapper/208:40:022
1050712997345,23cyclictest29-21rcuc/108:35:171
1050712997345,23cyclictest29-21rcuc/108:35:171
1050712997338,19cyclictest1056209-21kworker/u16:9+xprtiod08:00:031
1050712997338,19cyclictest1056209-21kworker/u16:9+xprtiod08:00:031
1050714997260,10cyclictest81-21hwrng08:43:013
1050714997260,10cyclictest81-21hwrng08:43:013
1050714997253,15cyclictest10650irq/205-8000000.ethernet-rx012:35:243
1050714997250,15cyclictest0-21swapper/310:05:333
1050714997238,31cyclictest0-21swapper/311:25:343
1050713997261,8cyclictest81-21hwrng12:06:482
105071399721,48cyclictest1047049-21kworker/u16:1+rpciod07:40:132
1050712997260,9cyclictest1084501-21sendmail-msp08:40:301
1050712997260,9cyclictest1084501-21sendmail-msp08:40:301
1050712997259,8cyclictest301ktimers/111:05:151
105071299723,59cyclictest31-21ksoftirqd/111:11:441
1050714997162,6cyclictest81-21hwrng07:39:323
1050714997147,18cyclictest0-21swapper/312:05:173
105071499714,60cyclictest1242405-21unixbench-2d12:31:143
1050714997132,30cyclictest0-21swapper/311:30:143
1050713997160,5cyclictest81-21hwrng08:01:022
1050713997160,5cyclictest81-21hwrng08:01:022
1050712997144,14cyclictest301ktimers/112:05:181
105071199717,25cyclictest1089278-21ntpq08:50:510
105071199717,25cyclictest1089278-21ntpq08:50:510
1050714997056,11cyclictest81-21hwrng08:28:413
1050714997044,18cyclictest0-21swapper/309:45:303
1050713997046,20cyclictest0-21swapper/207:30:502
1050713997046,20cyclictest0-21swapper/207:30:502
105071399701,52cyclictest0-21swapper/212:00:082
1050712997062,5cyclictest0-21swapper/109:10:171
1050712997052,14cyclictest1075115-21apt-get08:15:121
1050712997029,36cyclictest1198419-21/usr/sbin/munin11:30:571
1050712997021,42cyclictest0-21swapper/112:20:101
1050712997016,51cyclictest31-21ksoftirqd/109:37:281
1050712997016,51cyclictest31-21ksoftirqd/109:37:281
105071299701,19cyclictest1111534-21ntpq09:30:511
1050714996957,9cyclictest0-21swapper/307:15:233
1050713996954,11cyclictest0-21swapper/208:20:182
1050713996954,11cyclictest0-21swapper/208:20:182
105071399692,34cyclictest1216625-21ntpq11:55:552
105071499685,43cyclictest1176610-21latency11:00:463
1050714996850,15cyclictest461ktimers/308:00:463
1050714996850,15cyclictest461ktimers/308:00:463
1050714996849,17cyclictest461ktimers/311:35:373
1050714996849,17cyclictest461ktimers/311:35:373
1050714996843,22cyclictest461ktimers/307:50:173
1050713996844,20cyclictest0-21swapper/210:35:472
1050713996844,20cyclictest0-21swapper/210:35:472
1050712996843,17cyclictest0-21swapper/109:10:011
1050712996832,32cyclictest1061184-21ntpq07:36:011
105071399677,7cyclictest1169361-21memory10:50:422
105071399677,7cyclictest1169361-21memory10:50:422
105071299678,48cyclictest1074349-21908:11:001
105071299678,48cyclictest1074349-21908:11:001
105071299674,38cyclictest31-21ksoftirqd/107:50:201
1050712996737,23cyclictest0-21swapper/107:30:011
105071299671,31cyclictest1144116-21sshd-auth10:15:451
105071299671,31cyclictest1144116-21sshd-auth10:15:451
1050713996657,6cyclictest81-21hwrng07:38:312
1050713996633,30cyclictest0-21swapper/211:05:432
1050712996649,11cyclictest301ktimers/110:20:441
1050712996649,11cyclictest301ktimers/110:20:441
1050712996647,16cyclictest0-21swapper/110:00:291
105071299664,39cyclictest31-21ksoftirqd/110:47:371
1050712996616,47cyclictest31-21ksoftirqd/110:26:291
1050714996545,14cyclictest461ktimers/308:35:283
1050714996545,14cyclictest461ktimers/308:35:283
1050714996535,27cyclictest0-21swapper/309:10:123
1050714996510,44cyclictest1208424-21ssh11:45:253
1050713996525,33cyclictest1240894-21ssh12:30:252
1050712996543,14cyclictest0-21swapper/107:10:451
1050712996543,14cyclictest0-21swapper/107:10:451
1050712996532,27cyclictest1087343-21ntpq08:45:451
1050714996454,6cyclictest1058444-21apt-get07:30:223
1050714996454,6cyclictest1058444-21apt-get07:30:223
1050714996438,22cyclictest1050710-21cyclictest12:25:133
1050713996440,20cyclictest0-21swapper/211:50:322
1050713996438,23cyclictest0-21swapper/211:30:022
1050712996452,9cyclictest0-21swapper/111:45:291
1050712996444,9cyclictest1158886-21rm10:36:061
1050712996444,9cyclictest1158886-21rm10:36:061
1050714996352,9cyclictest81-21hwrng08:34:503
1050713996350,11cyclictest381ktimers/209:05:282
1050713996332,25cyclictest0-21swapper/211:25:022
1050712996344,17cyclictest0-21swapper/110:30:591
105071299631,31cyclictest1127453-21sh09:52:481
1050714996240,18cyclictest1154947-21sleep10:30:453
1050713996238,16cyclictest1237204-21ssh12:25:102
1050714996139,19cyclictest0-21swapper/309:36:123
1050714996139,19cyclictest0-21swapper/309:36:123
1050714996132,21cyclictest0-21swapper/310:55:593
1050714996123,35cyclictest10450irq/163-8000000.ethernet-tx610:00:493
1050713996139,18cyclictest0-21swapper/208:50:352
1050713996139,18cyclictest0-21swapper/208:50:352
1050714996045,11cyclictest0-21swapper/311:05:313
1050714996030,26cyclictest1126017-21ssh09:50:463
1050713996039,17cyclictest0-21swapper/208:31:082
105071299601,24cyclictest1216644-21ntpq11:55:561
105071499597,48cyclictest1144106-21ssh10:15:443
105071499597,48cyclictest1144106-21ssh10:15:443
1050714995939,16cyclictest0-21swapper/312:10:333
1050713995924,25cyclictest381ktimers/210:00:032
1050713995924,25cyclictest381ktimers/210:00:032
1050712995926,25cyclictest1-21systemd08:50:131
1050712995926,25cyclictest1-21systemd08:50:131
1050713995838,17cyclictest381ktimers/208:45:292
1050713995825,30cyclictest1055507-21ntpq07:20:552
1050712995830,23cyclictest0-21swapper/108:20:241
1050712995830,23cyclictest0-21swapper/108:20:241
1050713995642,5cyclictest1075260-21latency_hist08:15:022
1050713995642,5cyclictest1075260-21latency_hist08:15:022
1050714995346,5cyclictest81-21hwrng08:13:203
1050714995346,5cyclictest81-21hwrng08:13:203
1050714995132,16cyclictest0-21swapper/307:10:023
1050714995132,16cyclictest0-21swapper/307:10:023
1050713994932,9cyclictest0-21swapper/207:10:022
1050713994932,9cyclictest0-21swapper/207:10:022
1050712994325,11cyclictest0-21swapper/107:10:031
1050712993933,4cyclictest10250irq/147-8000000.ethernet-tx407:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional