You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 20:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Tue Jun 16, 2026 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33924999136124,9cyclictest45-21rcuc/309:30:163
339248991313,90cyclictest455197-21ssh10:50:212
33924899131116,6cyclictest81-21hwrng12:11:232
33924999128117,6cyclictest81-21hwrng10:49:283
33924799128100,9cyclictest0-21swapper/109:10:361
33924999127110,14cyclictest0-21swapper/310:26:003
33924799124107,13cyclictest81-21hwrng11:17:071
339249991236,91cyclictest463323-21ntpq11:01:083
33924999123113,7cyclictest81-21hwrng11:29:243
33924799123115,4cyclictest81-21hwrng11:33:301
3392499912211,30cyclictest421075-21ntpq10:01:123
3392499912211,30cyclictest421075-21ntpq10:01:123
33924999120108,6cyclictest0-21swapper/310:06:033
3392489911927,54cyclictest0-21swapper/209:30:392
33924799119105,10cyclictest81-21hwrng10:10:331
3392489911814,15cyclictest490236-21ssh11:40:022
3392489911814,15cyclictest490236-21ssh11:40:022
3392469911762,53cyclictest10050irq/131-8000000.ethernet-tx212:16:200
3392489911638,40cyclictest0-21swapper/212:20:302
339249991151,9cyclictest0-21swapper/311:05:473
339249991151,9cyclictest0-21swapper/311:05:473
3392469911495,16cyclictest406411-21if_eth109:40:450
33924699114105,4cyclictest81-21hwrng09:53:090
33924999112103,6cyclictest81-21hwrng09:07:043
3392469911276,32cyclictest376685-21latency_hist08:50:000
3392499911198,10cyclictest81-21hwrng07:51:173
33924999111103,5cyclictest81-21hwrng08:37:223
3392489911138,23cyclictest476396-21sleep11:20:312
3392489911138,23cyclictest476396-21sleep11:20:312
339248991111,79cyclictest435183-21ntpq10:21:102
3392479911192,14cyclictest81-21hwrng12:05:141
3392499911097,5cyclictest81-21hwrng08:32:153
3392499911097,5cyclictest81-21hwrng08:32:153
33924999110102,5cyclictest81-21hwrng08:53:453
33924999110102,5cyclictest81-21hwrng08:53:453
33924999110101,6cyclictest81-21hwrng07:26:433
33924999109100,6cyclictest81-21hwrng07:18:313
3392479910791,11cyclictest81-21hwrng07:30:481
3392469910719,84cyclictest508977-21ld12:05:510
33924999106102,2cyclictest0-21swapper/311:51:033
33924999106102,2cyclictest0-21swapper/311:51:033
3392479910697,6cyclictest81-21hwrng11:39:381
3392479910697,6cyclictest81-21hwrng11:39:381
339246991063,6cyclictest421798-21kworker/u16:7+rpciod10:05:010
339246991063,6cyclictest421798-21kworker/u16:7+rpciod10:05:010
3392479910596,7cyclictest0-21swapper/109:25:281
3392479910596,7cyclictest0-21swapper/109:25:281
339247991056,34cyclictest77-21kswapd010:40:411
3392499910477,25cyclictest461ktimers/309:56:073
3392499910477,25cyclictest461ktimers/309:56:073
3392479910294,4cyclictest81-21hwrng07:22:371
3392479910290,7cyclictest81-21hwrng11:40:401
3392499910187,12cyclictest461ktimers/310:10:523
3392479910171,18cyclictest0-21swapper/110:55:241
3392479910139,51cyclictest0-21swapper/112:15:161
339247991013,34cyclictest352574-21apt-get07:45:121
3392479910090,5cyclictest81-21hwrng11:28:221
3392479910074,16cyclictest0-21swapper/110:20:181
3392479910025,7cyclictest0-21swapper/110:26:021
339247991002,35cyclictest519506-21ssh12:20:541
339249999939,44cyclictest45-21rcuc/310:40:543
339247999985,10cyclictest81-21hwrng11:46:481
33924799992,41cyclictest522059-21ssh12:25:151
339248999883,12cyclictest81-21hwrng09:21:242
339248999858,31cyclictest0-21swapper/209:40:422
339247999830,32cyclictest399790-21ntpq09:31:041
33924799982,29cyclictest403079-21ntpq09:35:481
33924799982,29cyclictest403079-21ntpq09:35:481
339249999790,3cyclictest0-21swapper/309:40:523
339249999757,25cyclictest461ktimers/309:00:503
339246999756,17cyclictest0-21swapper/010:50:490
339248999664,27cyclictest0-21swapper/208:40:172
339248999637,52cyclictest0-21swapper/209:25:492
339248999637,52cyclictest0-21swapper/209:25:492
339247999687,5cyclictest81-21hwrng10:16:421
339247999687,5cyclictest81-21hwrng10:16:421
339247999628,21cyclictest405843-21/usr/sbin/munin09:40:331
33924999951,34cyclictest337269-21kworker/u16:3+rpciod07:40:023
33924999951,34cyclictest337269-21kworker/u16:3+rpciod07:40:023
339249999512,77cyclictest504806-21grep12:00:343
339247999565,24cyclictest0-21swapper/111:00:111
339247999528,53cyclictest510301-21kworker/u16:7+xprtiod12:30:491
339247999524,63cyclictest0-21swapper/108:40:161
339247999414,25cyclictest9950irq/123-8000000.ethernet-tx112:35:281
339248999314,69cyclictest516396-21ssh12:16:392
33924799932,13cyclictest419845-21apt-get10:00:241
33924799932,13cyclictest419845-21apt-get10:00:241
339247999310,18cyclictest388371-21df09:15:321
339246999310,9cyclictest326639-21kworker/u16:5+rpciod08:20:010
339249999283,6cyclictest81-21hwrng12:18:333
33924999921,63cyclictest529448-21cpuspeed12:35:323
33924799923,24cyclictest497790-21/usr/sbin/munin11:50:341
33924799923,24cyclictest497790-21/usr/sbin/munin11:50:341
33924799921,32cyclictest361921-21apt-get08:10:151
33924899914,41cyclictest529156-21ssh12:35:212
339248999141,37cyclictest381ktimers/211:15:202
339248999135,9cyclictest9950irq/123-8000000.ethernet-tx111:30:552
339247999180,7cyclictest450405-21kworker/u16:20+events_unbound11:14:341
339247999177,5cyclictest81-21hwrng09:45:581
339246999144,16cyclictest471376-21kworker/u16:7+rpciod12:00:090
339246999143,21cyclictest21-21rcuc/010:25:160
339248999018,54cyclictest449279-21ssh10:41:112
33924799909,19cyclictest452630-21ntpq10:45:531
33924799904,56cyclictest339245-21cyclictest08:50:401
33924799904,56cyclictest339245-21cyclictest08:50:401
339247999013,15cyclictest339049-21kworker/u16:6+rpciod07:20:001
33924699901,82cyclictest0-21swapper/012:15:010
339249998970,12cyclictest0-21swapper/311:30:093
339247998932,43cyclictest10650irq/205-8000000.ethernet-rx008:40:011
339247998929,48cyclictest0-21swapper/109:20:581
339247998928,6cyclictest0-21swapper/111:55:511
339249998868,7cyclictest0-21swapper/309:25:443
339249998868,7cyclictest0-21swapper/309:25:443
339248998860,22cyclictest0-21swapper/207:45:002
339248998860,22cyclictest0-21swapper/207:45:002
339247998859,23cyclictest0-21swapper/108:10:001
339247998824,24cyclictest339050-21kworker/u16:10+rpciod07:35:371
339247998824,24cyclictest339050-21kworker/u16:10+rpciod07:35:371
33924799881,31cyclictest368511-21ps08:26:031
339248998739,21cyclictest0-21swapper/212:06:022
33924799877,25cyclictest505381-21ssh12:00:481
339247998758,23cyclictest0-21swapper/109:55:391
339247998758,23cyclictest0-21swapper/109:55:391
339247998751,33cyclictest0-21swapper/110:30:311
339249998634,28cyclictest461ktimers/308:05:463
33924799864,21cyclictest350882-21aten_r8power_vo07:40:351
33924799864,21cyclictest350882-21aten_r8power_vo07:40:351
339247998626,21cyclictest455689-21ssh10:50:391
33924799861,6cyclictest0-21swapper/107:10:011
339246998672,6cyclictest81-21hwrng08:50:410
339246998672,6cyclictest81-21hwrng08:50:410
339246998662,19cyclictest171ktimers/008:55:150
339249998577,5cyclictest81-21hwrng08:02:333
339249998577,5cyclictest0-21swapper/311:40:443
33924999854,9cyclictest458384-21latency_hist10:55:003
33924999852,77cyclictest477543-21ps11:21:143
33924999852,77cyclictest477543-21ps11:21:143
339247998567,8cyclictest0-21swapper/108:00:311
339247998558,22cyclictest301ktimers/107:55:231
339247998558,22cyclictest301ktimers/107:55:231
33924799855,31cyclictest466072-21911:05:321
33924799855,31cyclictest466072-21911:05:321
339248998475,5cyclictest81-21hwrng07:45:092
339248998428,54cyclictest0-21swapper/210:55:562
33924799842,30cyclictest513383-21ssh12:11:411
339246998458,20cyclictest171ktimers/012:25:170
339249998376,4cyclictest410183-21ntpq09:45:483
339249998346,31cyclictest45-21rcuc/311:15:493
33924999834,59cyclictest339245-21cyclictest07:10:193
339249998312,44cyclictest45-21rcuc/309:35:523
339249998312,44cyclictest45-21rcuc/309:35:523
33924799833,25cyclictest340405-21ps07:11:031
339247998328,10cyclictest0-21swapper/108:20:261
339247998318,26cyclictest414211-21/usr/sbin/munin09:51:111
33924799831,30cyclictest445226-21/usr/sbin/munin10:35:391
33924799831,30cyclictest445226-21/usr/sbin/munin10:35:391
339249998255,20cyclictest0-21swapper/310:56:123
339249998247,30cyclictest461ktimers/312:20:583
339248998220,23cyclictest0-21swapper/211:59:592
33924799822,30cyclictest476429-21/usr/sbin/munin11:20:341
33924799822,30cyclictest476429-21/usr/sbin/munin11:20:341
33924799821,13cyclictest376808-21latency_hist08:50:011
339249998174,5cyclictest461ktimers/311:56:063
339249998160,12cyclictest0-21swapper/310:24:223
33924799816,25cyclictest381426-21ntpq09:00:511
339246998163,13cyclictest0-21swapper/010:56:290
339248998018,40cyclictest352104-21kworker/u16:16+xprtiod08:50:152
339248998018,40cyclictest352104-21kworker/u16:16+xprtiod08:50:152
33924899801,71cyclictest427927-21ssh10:10:542
33924799803,20cyclictest345669-21/usr/sbin/munin07:25:391
33924799801,38cyclictest354446-21sleep07:50:171
339248997949,20cyclictest381ktimers/207:30:222
33924799793,71cyclictest423582-21aten_r8power_fr10:05:321
33924799791,26cyclictest379310-21/usr/sbin/munin08:55:381
339246997970,4cyclictest10650irq/205-8000000.ethernet-rx011:35:360
339246997970,4cyclictest10650irq/205-8000000.ethernet-rx011:35:360
339246997947,23cyclictest10650irq/205-8000000.ethernet-rx010:20:020
339246997947,23cyclictest10650irq/205-8000000.ethernet-rx010:20:020
33924699794,41cyclictest171ktimers/007:10:190
339248997852,22cyclictest0-21swapper/211:45:012
33924899782,28cyclictest388848-21cat09:15:422
33924799782,33cyclictest364554-21ntpq08:15:471
339247997815,13cyclictest0-21swapper/109:05:381
33924699783,54cyclictest448775-21/usr/sbin/munin10:40:450
339249997758,13cyclictest10650irq/205-8000000.ethernet-rx011:40:023
339249997758,13cyclictest10650irq/205-8000000.ethernet-rx011:40:023
339248997760,14cyclictest0-21swapper/209:55:342
339248997760,14cyclictest0-21swapper/209:55:342
339246997744,28cyclictest0-21swapper/011:31:110
339246997744,28cyclictest0-21swapper/011:20:360
339246997744,28cyclictest0-21swapper/011:20:360
339246997713,50cyclictest9850irq/115-8000000.ethernet-tx009:35:450
339246997713,50cyclictest9850irq/115-8000000.ethernet-tx009:35:450
339249997657,5cyclictest445964-21switchtime10:36:103
339249997657,5cyclictest445964-21switchtime10:36:103
339249997642,27cyclictest0-21swapper/309:50:383
339249997550,14cyclictest0-21swapper/307:40:283
339249997550,14cyclictest0-21swapper/307:40:283
339249997549,22cyclictest461ktimers/312:25:163
339248997550,12cyclictest0-21swapper/212:01:162
339248997528,43cyclictest409372-21sh09:45:312
339248997452,13cyclictest0-21swapper/209:10:012
33924799741,28cyclictest369810-21/usr/sbin/munin08:30:351
33924799741,28cyclictest369810-21/usr/sbin/munin08:30:351
33924999735,15cyclictest0-21swapper/310:15:353
33924999735,15cyclictest0-21swapper/310:15:353
339248997313,42cyclictest380431-21sendmail-msp09:00:272
339248997313,33cyclictest10650irq/205-8000000.ethernet-rx010:10:002
339246997367,4cyclictest0-21swapper/011:26:000
33924699736,55cyclictest501928-21ntpq11:55:530
339246997313,55cyclictest391261-21sendmail-msp09:20:180
339249997265,5cyclictest0-21swapper/309:10:293
339249997263,5cyclictest461ktimers/308:10:513
33924999722,46cyclictest47-21ksoftirqd/311:45:163
33924899726,51cyclictest438488-21ssh10:25:492
339248997252,15cyclictest381ktimers/208:45:112
339248997245,20cyclictest0-21swapper/208:10:292
339248997245,18cyclictest81-21hwrng11:04:492
339248997230,37cyclictest0-21swapper/210:00:092
339248997230,37cyclictest0-21swapper/210:00:092
339246997251,18cyclictest0-21swapper/011:00:160
339246997236,29cyclictest0-21swapper/009:25:360
339246997236,29cyclictest0-21swapper/009:25:360
339249997153,14cyclictest461ktimers/309:18:103
339249997148,20cyclictest461ktimers/308:55:153
339249997147,19cyclictest0-21swapper/308:40:123
339248997150,17cyclictest0-21swapper/211:25:092
339248997129,24cyclictest369013-21kworker/u16:13+rpciod09:00:012
339248997128,38cyclictest0-21swapper/208:20:002
339248997119,23cyclictest373072-21grep08:40:012
339246997148,19cyclictest171ktimers/007:50:160
339246997142,25cyclictest0-21swapper/008:40:100
33924699711,45cyclictest21-21rcuc/008:10:500
33924999702,46cyclictest439696-21kworker/u16:3+rpciod11:10:493
339246997041,21cyclictest0-21swapper/011:15:360
339246997031,32cyclictest0-21swapper/009:45:420
339249996953,12cyclictest0-21swapper/307:45:123
339249996944,22cyclictest461ktimers/308:45:143
339249996941,16cyclictest461ktimers/307:30:523
339248996961,5cyclictest0-21swapper/210:15:442
339248996961,5cyclictest0-21swapper/210:15:442
339248996951,8cyclictest0-21swapper/211:45:292
339248996929,31cyclictest451632-21ssh10:45:142
339248996919,17cyclictest466090-21ssh11:05:342
339248996919,17cyclictest466090-21ssh11:05:342
33924699697,44cyclictest441945-21ntpq10:30:430
339246996949,12cyclictest0-21swapper/007:45:120
339246996947,19cyclictest0-21swapper/009:10:140
339249996852,14cyclictest461ktimers/307:56:023
339249996852,14cyclictest461ktimers/307:56:023
339248996845,19cyclictest0-21swapper/210:30:232
339248996829,36cyclictest0-21swapper/209:51:122
339248996825,37cyclictest405595-21ls09:40:022
339248996825,37cyclictest405595-21ls09:40:022
339248996825,22cyclictest322898-21kworker/u16:0+rpciod07:20:012
339248996819,44cyclictest0-21swapper/211:55:012
339248996819,44cyclictest0-21swapper/211:55:012
339246996827,34cyclictest426975-21ssh10:10:220
339249996745,17cyclictest0-21swapper/307:20:313
339248996755,9cyclictest0-21swapper/208:00:102
339248996755,10cyclictest0-21swapper/210:35:272
339248996755,10cyclictest0-21swapper/210:35:272
339246996743,16cyclictest0-21swapper/010:45:360
33924699671,52cyclictest10650irq/205-8000000.ethernet-rx009:30:510
339249996630,27cyclictest461ktimers/312:10:483
339246996653,10cyclictest0-21swapper/011:45:290
339246996642,17cyclictest0-21swapper/008:00:330
33924699662,28cyclictest0-21swapper/011:40:050
339249996545,15cyclictest0-21swapper/309:20:133
339249996542,17cyclictest0-21swapper/312:30:263
339248996540,21cyclictest0-21swapper/209:10:362
339248996530,31cyclictest367807-21df08:25:302
339248996522,28cyclictest381ktimers/207:55:132
339248996522,28cyclictest381ktimers/207:55:132
339248996521,10cyclictest527179-21grep12:31:132
339246996540,21cyclictest171ktimers/008:25:140
339246996539,18cyclictest171ktimers/007:30:150
33924699651,57cyclictest519558-21ssh12:20:580
339249996439,11cyclictest0-21swapper/308:20:103
339248996429,25cyclictest355750-21/usr/sbin/munin07:51:102
339248996427,33cyclictest523078-21ssh12:25:542
339246996445,14cyclictest171ktimers/011:50:140
339246996445,14cyclictest171ktimers/011:50:140
339246996431,19cyclictest339050-21kworker/u16:10+rpciod07:40:280
339246996431,19cyclictest339050-21kworker/u16:10+rpciod07:40:280
339248996328,28cyclictest369405-21apt-get08:30:152
339248996328,28cyclictest369405-21apt-get08:30:152
339248996323,36cyclictest345428-21/usr/sbin/munin07:25:352
339248996313,45cyclictest0-21swapper/207:20:192
339246996344,17cyclictest171ktimers/008:35:510
339246996319,33cyclictest466084-21diskstats11:05:330
339246996319,33cyclictest466084-21diskstats11:05:330
339246996317,27cyclictest0-21swapper/010:40:020
339246996317,27cyclictest0-21swapper/010:40:020
33924999621,28cyclictest442137-21ntpq10:30:583
339248996255,3cyclictest0-21swapper/207:35:462
339248996255,3cyclictest0-21swapper/207:35:462
339246996240,13cyclictest0-21swapper/009:15:360
339246996237,15cyclictest171ktimers/007:35:270
339246996237,15cyclictest171ktimers/007:35:270
339246996231,27cyclictest416344-21ssh09:55:180
339246996231,27cyclictest416344-21ssh09:55:180
339246996211,44cyclictest16-21ksoftirqd/008:20:570
339248996122,33cyclictest470327-21ntp_states11:11:022
33924699611,57cyclictest433716-21sendmail-msp10:20:230
339248996035,21cyclictest366229-21/usr/sbin/munin08:20:422
339248996015,41cyclictest340348-21ntp_states07:10:592
339246996044,12cyclictest0-21swapper/007:15:340
339246996037,19cyclictest0-21swapper/008:35:010
339246996037,19cyclictest0-21swapper/008:35:010
339246996029,19cyclictest423424-21ssh10:05:180
339249995927,22cyclictest364586-21ntpq08:15:503
339248995927,28cyclictest360464-21/usr/sbin/munin08:05:362
33924699596,43cyclictest0-21swapper/012:36:140
339246995943,11cyclictest0-21swapper/009:00:330
339246995924,22cyclictest360439-21fschecks_time08:05:360
33924699591,48cyclictest526894-21mailstats12:31:100
33924999581,45cyclictest47-21ksoftirqd/312:07:183
339246995838,14cyclictest171ktimers/007:55:550
339246995838,14cyclictest171ktimers/007:55:550
339246995813,42cyclictest0-21swapper/011:11:110
339246995639,14cyclictest0-21swapper/009:06:090
339246995635,9cyclictest0-21swapper/007:25:230
339249995540,11cyclictest0-21swapper/308:25:343
339246995529,21cyclictest343001-21sendmail-msp07:20:110
33924899511,37cyclictest337269-21kworker/u16:3+rpciod07:10:012
339246994623,17cyclictest339373-21latency_hist07:10:010
339249994427,6cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional