You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 15:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Tue Sep 15, 2026 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332640199197136,46cyclictest461ktimers/307:30:303
3326401991872,121cyclictest3512451-21sendmail-msp12:22:163
332640199147137,7cyclictest0-21swapper/310:40:543
332640199147137,7cyclictest0-21swapper/310:40:543
332640199144138,4cyclictest0-21swapper/309:25:183
332640099142100,38cyclictest0-21swapper/212:01:312
33264019914167,19cyclictest10150irq/147-8000000.ethernet-tx411:01:203
33264019914167,19cyclictest10150irq/147-8000000.ethernet-tx411:01:203
3326399991396,66cyclictest3413145-21switchtime10:06:071
332639999138119,7cyclictest79-21hwrng09:05:281
33264009913335,73cyclictest10550irq/205-8000000.ethernet-rx010:01:382
332640199129113,6cyclictest79-21hwrng08:05:043
33263999912950,70cyclictest0-21swapper/112:11:411
33263999912950,70cyclictest0-21swapper/112:11:411
33263999912895,20cyclictest0-21swapper/107:41:111
33263989912856,56cyclictest10150irq/147-8000000.ethernet-tx408:01:020
332640199127112,12cyclictest79-21hwrng09:43:223
33264009912696,14cyclictest3422486-21sendmail-msp10:20:392
332639999126117,5cyclictest79-21hwrng11:00:101
332639999126117,5cyclictest79-21hwrng11:00:101
332639999126115,7cyclictest79-21hwrng09:13:401
332640199125116,7cyclictest461ktimers/310:45:173
33263999912589,20cyclictest3409522-21ssh10:01:371
332639999125110,11cyclictest79-21hwrng11:40:061
33263989912574,37cyclictest0-21swapper/011:01:250
33263989912574,37cyclictest0-21swapper/011:01:250
332640199124111,5cyclictest0-21swapper/311:15:433
33263999912452,50cyclictest0-21swapper/112:20:081
332639999124106,8cyclictest79-21hwrng11:34:591
332639899124117,4cyclictest79-21hwrng10:13:030
332639899124117,4cyclictest79-21hwrng10:13:030
33264019912392,28cyclictest45-21rcuc/311:20:293
332640199123109,5cyclictest79-21hwrng07:51:453
332640199122108,8cyclictest79-21hwrng09:07:313
332640199121112,6cyclictest79-21hwrng12:26:113
332640099121112,6cyclictest79-21hwrng09:24:562
332640099119102,6cyclictest79-21hwrng12:10:492
332640099119102,6cyclictest79-21hwrng12:10:492
3326399991192,67cyclictest3471405-21ntpq11:26:001
332639999119109,6cyclictest79-21hwrng09:45:251
332639999119107,10cyclictest301ktimers/109:30:331
33264009911842,59cyclictest0-21swapper/209:45:292
332640099118106,7cyclictest79-21hwrng09:35:102
332640199117103,5cyclictest79-21hwrng07:44:353
332639999117100,6cyclictest79-21hwrng10:45:501
33264019911686,19cyclictest461ktimers/310:10:133
33264019911686,19cyclictest461ktimers/310:10:133
33264019911667,37cyclictest0-21swapper/309:39:583
3326399991161,66cyclictest0-21swapper/108:25:141
332640199115101,10cyclictest79-21hwrng07:36:233
332639899115104,8cyclictest0-21swapper/011:21:120
33263999911494,17cyclictest0-21swapper/109:41:061
3326398991146,24cyclictest3377670-21kworker/u16:8+rpciod09:19:580
332640199113103,7cyclictest79-21hwrng08:19:243
33263999911351,55cyclictest0-21swapper/111:05:251
3326398991132,107cyclictest3433887-21ssh10:35:350
33264019911299,11cyclictest79-21hwrng08:36:483
3326401991126,82cyclictest3433746-21ssh10:35:143
33264009911271,29cyclictest37-21rcuc/210:50:472
3326399991128,73cyclictest3437084-21sendmail-msp10:41:541
3326399991128,73cyclictest3437084-21sendmail-msp10:41:541
3326399991127,78cyclictest3484773-21acpi11:45:081
332639999112103,6cyclictest79-21hwrng11:37:021
332639999112103,6cyclictest79-21hwrng11:37:021
332639999112101,6cyclictest79-21hwrng08:40:541
33263989911278,26cyclictest0-21swapper/010:21:050
33264009911136,42cyclictest3451704-21munin-run10:59:572
33264009911136,42cyclictest3451704-21munin-run10:59:572
3326399991115,78cyclictest3448331-21apt-get10:55:091
3326399991115,78cyclictest3448331-21apt-get10:55:091
33263989911110,40cyclictest3461551-21kworker/u16:7+rpciod11:59:590
33264009911097,5cyclictest3431113-21sh10:30:542
33263999911060,11cyclictest0-21swapper/112:01:401
3326399991101,24cyclictest3328100-21kworker/u16:7+rpciod07:19:591
33264019910999,7cyclictest79-21hwrng08:46:013
33264009910976,7cyclictest10550irq/205-8000000.ethernet-rx009:41:092
33263999910945,20cyclictest0-21swapper/107:21:241
33263999910945,20cyclictest0-21swapper/107:21:241
33263999910939,29cyclictest3523874-21ssh12:35:261
33263999910939,29cyclictest3523874-21ssh12:35:261
332639999109100,5cyclictest79-21hwrng09:21:521
3326401991071,65cyclictest3372068-21diskstats09:10:333
33263999910756,20cyclictest3433462-21cut10:34:591
33263989910750,10cyclictest10150irq/147-8000000.ethernet-tx407:20:570
33263989910750,10cyclictest10150irq/147-8000000.ethernet-tx407:20:570
3326400991065,90cyclictest3401857-21ntpq09:50:562
3326400991065,90cyclictest3401857-21ntpq09:50:562
33263999910649,42cyclictest0-21swapper/111:19:581
3326398991067,92cyclictest3489725-21ssh11:51:120
33264019910566,36cyclictest0-21swapper/312:15:243
33264019910531,52cyclictest3375686-21df09:15:313
33264009910568,26cyclictest381ktimers/211:25:182
3326400991051,78cyclictest3480909-21sendmail-msp11:41:112
33263999910529,36cyclictest3459332-21ssh11:10:131
3326400991045,76cyclictest3516299-21/usr/sbin/munin12:26:032
33263999910447,51cyclictest0-21swapper/108:20:341
33264019910394,6cyclictest79-21hwrng07:28:123
33264019910394,6cyclictest79-21hwrng07:28:123
33264019910363,30cyclictest45-21rcuc/312:10:393
33264019910363,30cyclictest45-21rcuc/312:10:393
33263999910388,11cyclictest79-21hwrng10:36:371
33263999910334,31cyclictest3510891-21ssh12:16:321
33263989910359,8cyclictest10150irq/147-8000000.ethernet-tx409:40:210
33263989910350,27cyclictest3513480-21irqstats12:20:450
33264019910296,4cyclictest79-21hwrng07:49:423
33264019910250,30cyclictest461ktimers/309:45:323
33264009910289,7cyclictest0-21swapper/211:01:142
33264009910289,7cyclictest0-21swapper/211:01:142
33264019910193,5cyclictest79-21hwrng08:22:283
33264019910189,5cyclictest79-21hwrng11:51:223
3326401991012,69cyclictest3407859-21sendmail-msp09:59:573
33263999910192,6cyclictest79-21hwrng08:54:131
33264009910063,31cyclictest0-21swapper/210:35:222
33263999910052,21cyclictest0-21swapper/111:20:431
33263999910047,18cyclictest301ktimers/109:50:121
33263999910047,18cyclictest301ktimers/109:50:121
33263999910046,48cyclictest0-21swapper/109:39:581
3326398999929,54cyclictest0-21swapper/012:36:110
3326398999929,54cyclictest0-21swapper/012:36:110
3326401999857,34cyclictest461ktimers/308:55:163
3326401999857,34cyclictest461ktimers/308:55:163
3326399999833,34cyclictest0-21swapper/110:20:121
3326401999783,12cyclictest461ktimers/308:30:193
332640099972,82cyclictest3510937-21ssh12:16:372
3326401999659,23cyclictest3424888-21kworker/u16:19+rpciod10:24:593
3326400999578,6cyclictest79-21hwrng12:09:482
3326399999586,5cyclictest79-21hwrng10:14:051
3326399999586,5cyclictest79-21hwrng10:14:051
3326401999480,7cyclictest3478686-21ntpq11:35:593
3326401999480,7cyclictest3478686-21ntpq11:35:593
332640099941,47cyclictest39-21ksoftirqd/210:05:382
3326399999486,5cyclictest79-21hwrng12:32:191
3326399999486,5cyclictest79-21hwrng12:32:191
3326399999467,22cyclictest3326396-21cyclictest07:11:031
3326399999467,22cyclictest3326396-21cyclictest07:11:031
332639999945,62cyclictest0-21swapper/111:50:401
332640199933,62cyclictest3426932-21tune2fs10:25:343
3326398999377,7cyclictest0-21swapper/007:49:590
3326399999284,5cyclictest79-21hwrng10:50:571
3326401999131,24cyclictest3439255-21kworker/u16:22+rpciod10:50:083
3326400999148,15cyclictest0-21swapper/210:45:512
3326399999145,10cyclictest0-21swapper/107:50:251
3326398999169,16cyclictest171ktimers/011:35:340
3326398999169,16cyclictest171ktimers/011:35:340
3326400999079,8cyclictest0-21swapper/212:20:452
3326399999012,60cyclictest3367598-21sendmail-msp09:00:571
332639899906,7cyclictest0-21swapper/008:21:190
3326401998983,4cyclictest79-21hwrng07:59:563
3326401998983,4cyclictest79-21hwrng07:59:563
3326401998942,36cyclictest0-21swapper/310:00:133
3326400998984,3cyclictest39-21ksoftirqd/207:55:522
3326400998984,3cyclictest39-21ksoftirqd/207:55:522
332639999891,78cyclictest3405523-21ssh09:55:541
3326398998858,24cyclictest0-21swapper/012:10:360
3326398998858,24cyclictest0-21swapper/012:10:360
3326398998847,23cyclictest171ktimers/010:25:480
332640099878,62cyclictest0-21swapper/211:45:422
3326400998766,10cyclictest37-21rcuc/207:20:572
3326400998766,10cyclictest37-21rcuc/207:20:572
3326400998763,19cyclictest1-21systemd09:19:302
332640099873,64cyclictest395-21dbus-broker10:14:432
332640099873,64cyclictest395-21dbus-broker10:14:432
3326401998660,13cyclictest0-21swapper/309:20:073
3326401998650,33cyclictest0-21swapper/312:00:133
332640099863,52cyclictest3437084-21sendmail-msp10:40:352
332640099863,52cyclictest3437084-21sendmail-msp10:40:352
3326398998626,54cyclictest3485920-21ssh11:45:570
3326401998566,12cyclictest0-21swapper/309:01:073
3326398998562,12cyclictest0-21swapper/012:01:420
3326398998559,16cyclictest0-21swapper/010:55:360
3326398998559,16cyclictest0-21swapper/010:55:360
332639899853,8cyclictest3439246-21kworker/u16:13+xprtiod11:19:590
3326400998476,4cyclictest10550irq/205-8000000.ethernet-rx011:22:242
3326399998448,10cyclictest301ktimers/108:15:421
332639899845,58cyclictest1-21systemd09:36:210
332640199835,51cyclictest3520286-21awk12:30:293
332640199835,51cyclictest3520286-21awk12:30:293
332640199831,64cyclictest3459722-21diskstats11:10:343
332640099838,54cyclictest39-21ksoftirqd/210:15:502
3326400998374,6cyclictest79-21hwrng07:50:432
3326400998366,11cyclictest0-21swapper/209:00:092
3326400998353,22cyclictest0-21swapper/207:30:112
3326400998314,40cyclictest37-21rcuc/208:10:482
3326399998365,13cyclictest79-21hwrng08:56:161
3326399998365,13cyclictest79-21hwrng08:56:161
3326399998356,19cyclictest3461551-21kworker/u16:7+rpciod11:59:581
3326400998260,14cyclictest381ktimers/208:45:202
3326400998225,41cyclictest10550irq/205-8000000.ethernet-rx011:15:562
3326398998215,44cyclictest3401472-21irqstats09:50:380
3326398998215,44cyclictest3401472-21irqstats09:50:380
3326401998164,13cyclictest0-21swapper/310:05:083
332640099819,12cyclictest381ktimers/207:40:212
332640099814,50cyclictest0-21swapper/211:36:042
332640099814,50cyclictest0-21swapper/211:36:042
3326399998130,42cyclictest0-21swapper/108:39:591
332639899819,53cyclictest3502733-21ssh12:09:490
3326398998138,15cyclictest3328097-21kworker/u16:2+rpciod07:40:240
332639899811,70cyclictest0-21swapper/010:00:300
3326400998036,37cyclictest0-21swapper/210:00:002
3326398998029,43cyclictest0-21swapper/011:40:470
3326399997965,8cyclictest79-21hwrng10:15:061
3326399997965,11cyclictest0-21swapper/110:25:441
3326398997971,5cyclictest10550irq/205-8000000.ethernet-rx009:30:180
3326399997846,18cyclictest0-21swapper/107:30:111
3326398997847,28cyclictest3437084-21sendmail-msp10:41:420
3326398997847,28cyclictest3437084-21sendmail-msp10:41:420
332640199771,63cyclictest3387596-21sh09:31:083
3326398997763,11cyclictest79-21hwrng10:34:340
332639899774,65cyclictest0-21swapper/008:35:480
3326400997672,2cyclictest0-21swapper/210:25:182
3326400997659,13cyclictest0-21swapper/207:39:582
332640099765,33cyclictest3387109-21modprobe09:30:442
3326399997643,29cyclictest3383558-21ntpq09:25:511
3326399997636,29cyclictest3326396-21cyclictest07:35:551
3326398997635,22cyclictest0-21swapper/010:50:460
3326398997631,29cyclictest3321041-21kworker/u16:1+rpciod08:40:390
3326401997566,6cyclictest0-21swapper/311:05:363
3326401997545,19cyclictest0-21swapper/307:21:033
3326401997545,19cyclictest0-21swapper/307:21:033
3326400997550,21cyclictest381ktimers/207:10:312
3326400997550,21cyclictest381ktimers/207:10:312
332640099753,63cyclictest3520988-21ssh12:30:442
332640099753,63cyclictest3520988-21ssh12:30:442
332640099751,48cyclictest39-21ksoftirqd/208:41:132
3326398997568,3cyclictest3455621-21apt-get11:05:260
3326398997550,22cyclictest0-21swapper/012:16:450
3326398997549,19cyclictest0-21swapper/009:21:020
3326401997466,5cyclictest0-21swapper/311:42:173
3326401997460,10cyclictest461ktimers/310:15:453
3326400997449,20cyclictest3461551-21kworker/u16:7+rpciod11:50:102
3326398997416,22cyclictest0-21swapper/010:49:580
3326401997334,32cyclictest3499429-21ssh12:05:133
3326401997250,16cyclictest19-21rcu_preempt08:25:483
3326401997241,21cyclictest461ktimers/310:55:123
3326401997241,21cyclictest461ktimers/310:55:123
3326399997247,21cyclictest301ktimers/107:25:111
3326399997247,21cyclictest301ktimers/107:25:111
332639999722,59cyclictest3499428-21ssh12:05:131
3326398997254,14cyclictest0-21swapper/012:25:390
3326401997138,25cyclictest3326640-21sleep07:10:133
3326401997138,25cyclictest3326640-21sleep07:10:133
332640099712,47cyclictest39-21ksoftirqd/211:10:572
3326398997146,15cyclictest0-21swapper/012:30:540
3326398997146,15cyclictest0-21swapper/012:30:540
3326398997145,19cyclictest0-21swapper/011:30:360
332639899712,58cyclictest3412689-21ssh10:05:420
3326398997120,38cyclictest0-21swapper/009:55:350
3326400997048,17cyclictest0-21swapper/208:01:012
3326399997054,9cyclictest10550irq/205-8000000.ethernet-rx008:00:531
3326399997048,19cyclictest301ktimers/107:45:091
3326398997051,10cyclictest171ktimers/008:05:460
3326398997047,17cyclictest0-21swapper/011:25:340
3326398997044,13cyclictest3346777-21kworker/u16:15+rpciod09:00:580
3326398997016,28cyclictest3375177-21sed09:14:590
3326401996947,11cyclictest0-21swapper/311:46:043
3326401996937,26cyclictest1-21systemd12:38:513
3326401996937,26cyclictest1-21systemd12:38:513
3326400996944,20cyclictest0-21swapper/211:30:282
3326400996938,22cyclictest0-21swapper/209:05:332
3326398996946,18cyclictest0-21swapper/007:10:110
3326398996946,18cyclictest0-21swapper/007:10:110
332639899691,48cyclictest3397048-21ssh09:45:070
3326401996854,12cyclictest461ktimers/308:11:013
3326400996851,13cyclictest10550irq/205-8000000.ethernet-rx011:55:332
3326399996855,7cyclictest79-21hwrng07:57:531
3326399996855,7cyclictest79-21hwrng07:57:531
3326399996854,5cyclictest79-21hwrng08:12:141
3326401996742,16cyclictest0-21swapper/308:00:393
3326400996756,7cyclictest79-21hwrng07:25:072
3326400996756,7cyclictest79-21hwrng07:25:072
3326399996727,34cyclictest3326396-21cyclictest12:25:111
332639899672,58cyclictest3419178-21ssh10:15:190
3326401996646,16cyclictest0-21swapper/308:40:563
3326400996646,16cyclictest0-21swapper/212:39:582
3326400996646,16cyclictest0-21swapper/212:39:582
3326400996612,44cyclictest39-21ksoftirqd/208:14:592
3326398996617,42cyclictest3357897-21/usr/sbin/munin08:31:070
3326400996551,10cyclictest0-21swapper/207:46:032
3326399996542,19cyclictest0-21swapper/107:09:591
3326398996541,15cyclictest0-21swapper/009:25:350
332639899651,49cyclictest3351069-21aten_r8power_fr08:15:260
332640199644,57cyclictest47-21ksoftirqd/311:26:003
3326400996449,10cyclictest0-21swapper/208:50:332
3326400996439,14cyclictest381ktimers/208:20:512
3326399996442,19cyclictest0-21swapper/108:05:261
3326398996450,11cyclictest0-21swapper/007:09:570
3326398996434,25cyclictest3336417-21grep07:35:350
3326398996418,40cyclictest0-21swapper/011:10:220
3326401996332,23cyclictest395-21dbus-broker07:19:093
332640199632,48cyclictest3430072-21ssh10:30:123
3326400996341,19cyclictest381ktimers/207:15:222
3326400996341,18cyclictest0-21swapper/209:10:402
3326400996323,37cyclictest37-21rcuc/208:05:322
3326398996315,18cyclictest3370346-21sh09:05:360
3326400996246,12cyclictest0-21swapper/209:26:102
3326398996225,31cyclictest0-21swapper/007:29:580
3326398996225,31cyclictest0-21swapper/007:29:580
3326398996137,19cyclictest0-21swapper/007:19:580
3326398996137,18cyclictest0-21swapper/008:25:210
3326398996135,20cyclictest0-21swapper/008:50:210
3326401996046,8cyclictest10550irq/205-8000000.ethernet-rx007:09:573
332640199604,40cyclictest47-21ksoftirqd/309:50:203
332640199604,40cyclictest47-21ksoftirqd/309:50:203
3326401996042,14cyclictest0-21swapper/311:30:363
3326401996011,46cyclictest0-21swapper/311:59:583
3326400996038,14cyclictest381ktimers/208:55:102
3326400996038,14cyclictest381ktimers/208:55:102
332639999601,53cyclictest3357239-21memory08:30:391
3326398996017,36cyclictest3365948-21sh08:55:170
3326398996017,36cyclictest3365948-21sh08:55:170
332639899601,55cyclictest3334888-21ntpq07:30:530
3326398996010,47cyclictest3341023-21grep07:46:030
3326400995839,14cyclictest0-21swapper/211:05:542
3326398995852,4cyclictest171ktimers/007:55:510
3326398995852,4cyclictest171ktimers/007:55:510
3326398995714,40cyclictest0-21swapper/008:45:370
3326400995636,16cyclictest0-21swapper/208:30:342
3326400995530,20cyclictest37-21rcuc/208:35:172
3326400995529,21cyclictest395-21dbus-broker08:25:282
332639999556,33cyclictest3376393-21ntpq09:15:571
3326399995536,16cyclictest0-21swapper/108:46:031
3326398995527,16cyclictest3350216-21/usr/sbin/munin08:11:040
3326401995222,23cyclictest3364075-21apt-get08:50:213
3326400995127,17cyclictest0-21swapper/207:09:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional